News Summary

A coalition of state attorneys general has issued a warning to leading AI companies, including Microsoft, OpenAI, and Google, to address the issue of ‘delusional outputs’ produced by their AI systems. This action follows several mental health incidents linked to AI chatbots, which have reportedly led to harmful situations, including violence and suicide. The attorneys general, in collaboration with the National Association of Attorneys General, have urged these companies to implement new safeguards, such as transparent third-party audits of AI models and the development of incident reporting procedures. They are advocating for AI firms to treat mental health incidents with the same seriousness as cybersecurity breaches, ensuring users are notified of any exposure to harmful outputs. The federal government’s stance on AI regulation has been more lenient, with ongoing efforts to prevent state-level restrictions. However, these attempts have faced resistance from state officials.