

This is also a problem for search engines.
A problem that while not solved has been somewhat mitigated by including suicide prevention resources at the top of search results.
This is a bare minimum AI can’t meet, and in conversation with AI vulnerable people can get more than just information, there are confirmed cases of the AI encouraging harmful behaviors up to and including suicide.
I mean, I would recommend condoms for other reasons.