Natural language processing

Meta AI chatbot fabricates sexual harassment allegations against US politicians

Meta AI chatbot fabricates sexual harassment allegations against US politicians



summary
Summary

Meta’s new chatbot invents sexual harassment allegations against US politicians. The allegations are fictitious, but the chatbot backs them up with a ton of details.

City & State obtained a screenshot of a Meta AI conversation in which the name of a lawmaker was typed into the chatbot along with the phrase “sexual harassment.” In response, the chatbot generated a completely fabricated incident and consequences that never happened.

The magazine applied this principle to more than a dozen other members of Congress from both parties. In most cases, Meta AI spread similar stories about fabricated sexual harassment allegations and investigations that never took place. Sometimes, the chatbot provided correct answers and source links. Incorrect answers did not include links.

Meta AI chatbot fabricates sexual harassment allegations against US politicians
Image: via City&State

New York State Senators Kristen Gonzalez and Clyde Vanel, who are responsible for overseeing emerging technologies and regulating AI, were also targeted by the chatbot’s lies.

Ad

Ad

Gonzalez told City & State that the incident shows the need to hold companies like Meta accountable for their role in spreading misinformation. Vanel expressed concern, but cautioned against allowing problems to stifle innovation.

In a statement, a Meta spokesperson defended the company’s technology as new and in need of improvement, saying, “As we said when we launched these new features in September, this is new technology and it may not always return the response we intend, which is the same for all generative AI systems.”

Other major tech companies, such as Microsoft, Google, and OpenAI, have also faced criticism for their systems spreading misinformation. None of the leading AI companies have yet managed to reliably address the hallucinations of generative AI, whether in text or images.

It remains to be seen whether a heads-up that the chatbot might be lying is enough to justify its distribution and the potential reputational damage. That decision will be left to policymakers and, if necessary, the courts.

Meta AI chatbot fabricates sexual harassment allegations against US politicians

Source link