\n <\/p>\n
AI\u2019s inclination to be helpful affects many of the tasks that researchers use LLMs for.<\/span>Credit: Smith Collection\/Gado\/Getty<\/span><\/p>\n Artificial intelligence (AI) models are 50% more sycophantic than humans, an analysis published this month has found.<\/p>\n The study, which was posted as a preprint1 on the arXiv server, tested how 11 widely used large language models (LLMs) responded to more than 11,500 queries seeking advice, including many describing wrongdoing or harm.<\/p>\n AI Chatbots \u2014 including ChatGPT and Gemini \u2014 often cheer users on, give them overly flattering feedback and adjust responses to echo their views, sometimes at the expense of accuracy. Researchers analysing AI behaviours say that this propensity for people-pleasing, known as sycophancy, is affecting how they use AI in scientific research, in tasks from brainstorming ideas and generating hypotheses to reasoning and analyses.<\/p>\n \u201cSycophancy essentially means that the model trusts the user to say correct things,\u201d says Jasper Dekoninck, a data science PhD student at the Swiss Federal Institute of Technology in Zurich. \u201cKnowing that these models are sycophantic makes me very wary whenever I give them some problem,\u201d he adds. \u201cI always double-check everything that they write.\u201d<\/p>\n Marinka Zitnik, a researcher in biomedical informatics at Harvard University in Boston, Massachusetts, says that AI sycophancy \u201cis very risky in the context of biology and medicine, when wrong assumptions can have real costs\u201d. <\/p>\n In a study posted on the preprint server arXiv on 6 October2, Dekoninck and his colleagues tested whether AI sycophancy affects the technology\u2019s performance in solving mathematical problems. The researchers designed experiments using 504 mathematical problems from competitions held this year, altering each theorem statement to introduce subtle errors. They then asked four LLMs to provide proofs for these flawed statements.<\/p>\n The authors considered a model\u2019s answer to be sycophantic if it failed to detect the errors in a statement and went on to hallucinate a proof for it.<\/p>\n GPT-5 showed the least sycophantic behaviour, generating sycophantic answers 29% of the time. DeepSeek-V3.1 was the most sycophantic, generating sycophantic answers 70% of the time. Although the LLMs have the capability to spot the errors in the mathematical statements, they \u201cjust assumed what the user says is correct\u201d, says Dekoninck.<\/p>\n AI chatbots are already biasing research \u2014 we must establish guidelines for their use now<\/p>\n<\/p>\n When Dekoninck and his team changed the prompts to ask each LLM to check whether a statement was correct before proving it, DeepSeek\u2019s sycophantic answers fell by 34%.<\/p>\n The study is \u201cnot really indicative of how these systems are used in real-world performance, but it gives an indication that we need to be very careful with this\u201d, says Dekoninck.<\/p>\n Simon Frieder, a PhD student studying mathematics and computer science at the University of Oxford, UK, says the work \u201cshows that sycophancy is possible\u201d. But he adds that AI sycophancy tends to appear most clearly when people are using AI chatbots to learn, so future studies should explore \u201cerrors that are typical for humans that learn math\u201d.<\/p>\n Researchers told Nature that AI sycophancy creeps into many of the tasks that they use LLMs for.<\/p>\n Yanjun Gao, an AI researcher at the University of Colorado Anschutz Medical Campus in Aurora, uses ChatGPT to summarize papers and organize her thoughts, but says the tools sometimes mirror her inputs without checking the sources. \u201cWhen I have a different opinion than what the LLM has said, it follows what I said instead of going back to the literature\u201d to try to understand it, she adds.<\/p>\n Zitnik and her colleagues have observed similar patterns when using their multi-agent systems, which integrate several LLMs to carry out complex, multi-step processes such as analysing large biological data sets, identifying drug targets and generating hypotheses.<\/p>\n How AI agents will change research: a scientist\u2019s guide<\/p><\/p>\n","protected":false},"excerpt":{"rendered":" AI\u2019s inclination to be helpful affects many of the tasks that researchers use LLMs for.Credit: Smith Collection\/Gado\/Getty Artificial intelligence (AI) models are 50% more sycophantic than humans, an analysis published this month has found. The study, which was posted as a preprint1 on the arXiv server, tested how 11 widely used large language models (LLMs)<\/p>\n","protected":false},"author":1,"featured_media":30391,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[58],"tags":[3739,16083,5265,516,17841],"class_list":{"0":"post-30390","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-science","8":"tag-chatbots","9":"tag-harming","10":"tag-researchers","11":"tag-science","12":"tag-sycophants"},"_links":{"self":[{"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/posts\/30390","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=30390"}],"version-history":[{"count":0,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/posts\/30390\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/media\/30391"}],"wp:attachment":[{"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=30390"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=30390"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=30390"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}People pleasers<\/h2>\n
Unreliable assistance<\/h2>\n