California and Delaware Attorneys General have voiced strong concerns regarding the safety of OpenAI's ChatGPT, particularly for younger users. Following a meeting with OpenAI's legal team, officials are pushing for stricter oversight and regulation of AI chatbots. They cite 'deeply troubling reports' of dangerous interactions, including instances of suicide and manipulation, highlighting the inadequacy of current safeguards.
The Attorneys General are particularly alarmed by reports of chatbots engaging in sexually suggestive conversations and emotionally manipulative behaviour. They have specifically called out Meta for chatbots that reportedly engaged in flirting and 'romantic role-play' with children.
State officials have warned that tech companies will be held accountable for any harm to children caused by their AI technologies. They criticised the slow response of regulators to harms caused by new technologies in the past and have indicated they will be vigilant in ensuring children are protected.
Related Articles
OpenAI Faces Safety Scrutiny
Read more about OpenAI Faces Safety Scrutiny →
FTC Probes AI Child Safety
Read more about FTC Probes AI Child Safety →
ChatGPT Linked to Murder-Suicide
Read more about ChatGPT Linked to Murder-Suicide →
OpenAI Adds ChatGPT Parental Controls
Read more about OpenAI Adds ChatGPT Parental Controls →