\n <\/p>\n
Chatbots give positive, human-like responses to prompts from users.<\/span>Credit: Jaap Arriens\/NurPhoto via Getty<\/span><\/p>\n Accounts of people developing psychosis \u2014 which renders them unable to distinguish between what is and is not reality \u2014 after interacting with generative artificial intelligence (AI) chatbots have increased in the past few months.<\/p>\n Supportive? Addictive? Abusive? How AI companions affect our mental health<\/p>\n<\/p>\n At least 17 people have been reported to have developed psychosis, according to a preprint posted online last month1. After engaging with chatbots such as ChatGPT and Microsoft Copilot, some of these people experienced spiritual awakenings or uncovered what they thought were conspiracies. <\/p>\n So far, there has been little research into this rare phenomenon, called AI psychosis, and most of what we know comes from individual instances. Nature explores the emerging theories and evidence, and what AI companies are doing about the problem.<\/p>\n Psychosis is characterized by disruptions to how a person thinks and perceives reality, including hallucinations, delusions or false beliefs. It can be triggered by brain disorders such as schizophrenia and bipolar disorder, severe stress or drug use.<\/p>\n That AI can trigger psychosis is still a hypothesis, says S\u00f8ren \u00d8stergaard, a psychiatrist at Aarhus University in Denmark. But theories are emerging about how this could happen, he adds. For instance, chatbots are designed to craft positive, human-like responses to prompts from users, which could increase the risk of psychosis among people already having trouble distinguishing between what is and is not real, says \u00d8stergaard.<\/p>\n UK researchers have proposed that conversations with chatbots can fall into a feedback loop, in which the AI reinforces paranoid or delusional beliefs mentioned by users, which condition the chatbot\u2019s responses as the conversation continues. In a preprint published in July2, which has not been peer reviewed, the scientists simulated user\u2013chatbot conversations using prompts with varying levels of paranoia, finding that the user and chatbot reinforced each other\u2019s paranoid beliefs.<\/p>\n Studies involving people without mental-health conditions or tendencies towards paranoid thinking are needed to establish whether there is a connection between psychosis and chatbot use, \u00d8stergaard says.<\/p>\n People who have already experienced some kind of mental-health issue are at the greatest risk of developing psychosis, \u00d8stergaard says. It seems that some people can experience their first psychotic break from interacting with chatbots, he adds, but most of them will already be susceptible to developing delusions or paranoia owing to genetics, stress or misuse of drugs or alcohol. \u00d8stergaard also theorizes that chatbots could worsen or trigger mania, a period of extremely elevated energy and mood associated with bipolar disorder, because they reinforce symptoms such as elated mood. <\/p>\n People who are isolated and do not interact with friends, family or other people are also at risk, says Kiley Seymour, a neuroscientist at the University of Technology Sydney in Australia. Interacting with other people protects against psychosis, she adds, because \u201cthey can offer those counterfactual pieces of evidence to help you think about how you\u2019re thinking\u201d.<\/p>\n But the risk of developing psychosis for people without a predisposition is the same whether they do or don\u2019t interact with chatbots, adds Seymour.<\/p>\n Chatbots can remember information from conversations that occurred months earlier, which can trigger users to think that they are \u201cbeing watched or that their thoughts are being extracted, because they can\u2019t remember ever sharing that information\u201d, says Seymour. Grandiose delusions, in which users think they are speaking to a god through the chatbot or have discovered a truth about the world, can also be reinforced, she adds. In an analysis of chats posted online, the Wall Street Journal reported finding dozens of instances in which chatbots validated mystical or delusional beliefs or made claims that they were in contact with extraterrestrial beings.<\/p>\n","protected":false},"excerpt":{"rendered":" Chatbots give positive, human-like responses to prompts from users.Credit: Jaap Arriens\/NurPhoto via Getty Accounts of people developing psychosis \u2014 which renders them unable to distinguish between what is and is not reality \u2014 after interacting with generative artificial intelligence (AI) chatbots have increased in the past few months. Supportive? Addictive? Abusive? How AI companions affect<\/p>\n","protected":false},"author":1,"featured_media":22221,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[58],"tags":[3739,11179,516,3317],"class_list":{"0":"post-22220","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-science","8":"tag-chatbots","9":"tag-psychosis","10":"tag-science","11":"tag-trigger"},"_links":{"self":[{"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/posts\/22220","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=22220"}],"version-history":[{"count":0,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/posts\/22220\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/media\/22221"}],"wp:attachment":[{"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=22220"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=22220"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=22220"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}Can AI trigger psychosis?<\/h2>\n
Who is at risk?<\/h2>\n
How might AI reinforce delusional beliefs?<\/h2>\n