NIST AI RMF, MeasureMEASURE 2.6

Do not let a companion chatbot on your platform engage with users unless you maintain, and publish on your website, a protocol for preventing it from producing suicidal ideation, suicide, or self-harm content, including a notification referring the user to a crisis hotline or crisis text line

For a user you know is a minor, take reasonable measures to prevent your companion chatbot from producing visual sexually explicit material or directly telling the minor to engage in sexually explicit conduct (Section 22602(c)(3), deleted by SB 1119 effective January 1, 2027)

Starting January 1, 2027, if you know an account holder or user is a minor, institute technically feasible measures preventing the service from producing explicit sexual content or intimate digital depictions involving a minor, or from engaging in or encouraging explicit sexual conduct with a minor, and reasonable measures preventing it from claiming to be human or sentient, simulating a romantic companionship, or role-playing an adult-minor romantic relationship

If you know or have reason to believe a user is a minor, do not let the companion encourage self-harm, suicide, violence, disordered eating, or unlawful drug or alcohol use.

Implement and publicly disclose a protocol for detecting and responding to expressions of severe harm, including self-harm and suicidal ideation, with referral to crisis resources, and publish an annual count of crisis referrals.

Adopt a protocol using evidence-based methods for the AI companion to respond to a user's prompts about suicidal ideation or self-harm, making reasonable efforts to refer the user to crisis-intervention services, and do not represent or program the AI companion to represent itself as providing professional mental or behavioral health care.

Adopt a protocol for the service to respond to user prompts about suicidal ideation, including reasonable efforts to refer users to crisis services such as a suicide hotline or crisis text line, and do not cause the service to represent that it provides professional mental or behavioral health care.

Adopt a protocol for responding to a user's expressions of suicidal ideation or self-harm, including referral to crisis services.

Adopt a protocol for the service to respond to a user's suicidal-ideation or self-harm prompts, including reasonable efforts to refer the user to a crisis service.

Implement a protocol to detect a user's expressions of suicidal ideation or self-harm and refer them to appropriate crisis services such as the 9-8-8 suicide prevention and behavioral health crisis hotline.

Maintain a protocol using evidence-based methods to detect suicidal or self-harm ideation, refer the user to the 988 crisis lifeline or to a youth-specific lifeline for a user you identify as under 25, and publish the details of that protocol.

If you are an investment firm engaged in algorithmic trading, including high-frequency algorithmic trading technique, apply suitable and effective systems and risk controls so that the trading IT system is resilient, has sufficient capacity, applies appropriate trading thresholds and limits and prevents erroneous orders, following Delegated Regulation (EU) 2017/589 and Regulation (EU) 2022/2554 (Väärtpaberituru seadus, section 82^15(1)).

If you are a manufacturer of a safety component with fully or partially self-evolving behaviour using machine learning approaches ensuring safety functions, or of machinery that embeds such a system and has not placed it independently on the market, apply one of the conformity assessment procedures in Article 25(2): EU type-examination (module B) followed by conformity to type (module C), full quality assurance (module H), or unit verification (module G) (Annex I, Part A, points 5 and 6).

It reaches you if you are an investment firm that engages in algorithmic trading, meaning trading in financial instruments where a computer algorithm automatically determines individual parameters of orders such as whether to initiate the order, the timing, price or quantity of the order or how to manage the order after its submission, with limited or no human intervention; a system used only to route orders to one or more trading venues, to process orders involving no determination of any trading parameters, or to confirm orders or process executed transactions after the trade is outside that meaning (Directive 2014/65/EU, Article 4(1), point (39)). Have in place effective systems and risk controls suitable to the business you operate to ensure that your trading systems are resilient and have sufficient capacity, are subject to appropriate trading thresholds and limits, and prevent the sending of erroneous orders or the systems otherwise functioning in a way that may create or contribute to a disorderly market (Article 17(1)).

Carry out pre-trade controls on order entry for all financial instruments, namely price collars, maximum order values, maximum order volumes and maximum messages limits, immediately include all orders sent to a trading venue in the calculation of those limits, and have repeated automated execution throttles that disable the trading system after a pre-determined number of repeated executions until a designated staff member re-enables it (Article 15(1) to (3)); set market and credit risk limits based on your capital base, clearing arrangements, trading strategy, risk tolerance, experience and certain variables (Article 15(4)).

The Commission says robustness testing should be treated as a continuous process, so that you adapt your testing strategies as AI technologies evolve.

If you provide or develop prompt-based image-generation technology, put reasonable safeguards in place against its use to generate this kind of deepfake visual material; without them, the Attorney General may sue you directly over material it was used to create.

Do not develop, test, verify, oversee, manage, or otherwise use an artificial intelligence system in a way that creates a danger to a person's life or body, or to property on a large scale, in Croatia. This is a criminal offence.

Do not operate an AI chatbot or other generative-communication application that, knowing it is directing a communication to a child, facilitates, encourages, offers, solicits, or recommends that the child imminently engage in sexually explicit conduct, illegal drug or alcohol use, self-harm or suicide, or violence against another person.

Build your high-risk AI system to be as resilient as possible to errors, faults or inconsistencies, including those arising from its interaction with people or other systems, through technical and organisational measures.

Adopt the technical safety measures provided for the design, training, production and placing on the market of high-risk AI systems, suited to prevent malfunctions or alterations of how the systems work, and adopt human-oversight measures, where omitting them would endanger life or public or individual safety, or the security of the State (Codice Penale art. 437-bis, first paragraph).

Do not alter a high-risk AI system where danger to life or to public or individual safety, or to the security of the State, results (Codice Penale art. 437-bis, second paragraph).

Prepare and keep documents that confirm the content of the measures you took to secure your AI's safety and reliability.