Law / United States / 
New York
Artificial Intelligence Companion Models safeguards
N.Y. Gen. Bus. Law art. 47 (§§ 1700-1704)
In force since .
An AI transparency rule binding private bodies.
- Enforcement body
- New York Attorney General
- Audit expectation
- none
What it requires
- Give users a clear and conspicuous notification, at the start of an AI companion interaction and at least every three hours of continued use, that they are not communicating with a human.NIST AI RMFMEASURE 2.8
- Implement a protocol to detect a user's expressions of suicidal ideation or self-harm and refer them to appropriate crisis services such as the 9-8-8 suicide prevention and behavioral health crisis hotline.NIST AI RMFMEASURE 2.6
These lines are LexLint's reading of the law's text.
In the frameworks
- NIST AI RMF
- MEASURE 2.6The AI system is evaluated regularly for safety risks – as identified in the MAP function. The AI system to be deployed is demonstrated to be safe, its residual negative risk does not exceed the risk tolerance, and it can fail safely, particularly if made to operate beyond its knowledge limits. Safety metrics reflect system reliability and robustness, real-time monitoring, and response times for AI system failures.
- MEASURE 2.8Risks associated with transparency and accountability – as identified in the MAP function – are examined and documented.
Our reading of where this law's duties sit in each framework, and in the NIST AI RMF, line by line beside each duty above. It never says that running a control meets the law. How we read a framework against the law
If you get it wrong
Penalty structure
Civil penalty of up to $15,000 per day for a violation of the self-harm detection duty (section 1701) or the notification duty (section 1702), sought by the Attorney General.
- Rule
- Per violation only
- As of
- Currency
- USD
- Per violation unit
- Day
- Per violation amount
- 15,000
Over one month of continuous breach, USD 456,600.
What it makes you log
Logging duty
Section 1701 requires an AI companion to contain a protocol for detecting and addressing a user's expressions of suicidal ideation or self-harm, and section 1702 requires a recurring notification that the user is not communicating with a human. Neither section requires the operator to create, keep, or produce a log or record of a detection, a notification, or an individual interaction.
- Kind
- None
- As of
What this law does
An operator of an AI companion, a system using artificial intelligence, generative AI or emotional-recognition algorithms to simulate a sustained human-like relationship with a user, must provide a clear and conspicuous notification at the start of an interaction and at least every three hours that the user is not communicating with a human, and must implement a protocol reasonably designed to detect and respond to a user's expressions of suicidal ideation or self-harm by referring them to crisis services such as the 9-8-8 hotline.
The Attorney General may enjoin a violation and seek civil penalties of up to $15,000 per day per violation of the notification or self-harm-detection duties. The article defines the operator bound by these duties as any person, partnership, association, firm or business entity that operates for or provides an AI companion to a user.
When LexLint raises it
When your app profile says your app generates content with AI or deploys a companion chatbot.
Back to the example · Lint your app
Page updated .