\n <\/p>\n
The statue of Alan Turing at Bletchley Park, UK.<\/span>Credit: Steve Meddle\/Shutterstock<\/span><\/p>\n Today\u2019s best artificial intelligence (AI) models sail through the Turing test, a famous thought experiment that asks whether a computer can pass as a human by interacting via text.<\/p>\n Some see an upgraded test as a necessary benchmark for progress towards artificial general intelligence (AGI) \u2014 an ambiguous term used by many technology firms to mean an AI system with the resourcefulness to match any human cognitive ability. But at an event at London\u2019s Royal Society on 2 October, several researchers said that the Turing test should be scrapped altogether, and that developers should instead focus on evaluating AI safety and building specific capabilities that could be of benefit to the public.<\/p>\n \u201cLet\u2019s figure out the kind of AI we want, and test for those things instead,\u201d said Anil Seth, a neuroscientist at the University of Sussex in Brighton, UK. In focusing on \u201cthis march towards AGI, I think we\u2019re really limiting our imaginations about what kind of systems we might want \u2014 and, more importantly, what kinds of systems we really don\u2019t want \u2014 in our society\u201d.<\/p>\n The event was organized to mark the 75-year anniversary of the publication of British mathematician Alan Turing’s seminal paper describing the test, which he called the imitation game. Addressing the philosophically gnarly question of whether machines can think1, the test involves a series of short, text-based conversations between a judge and either a human or a computer. To win, the machine must convince the judge that it is human.<\/p>\n ChatGPT broke the Turing test \u2014 the race is on for new ways to assess AI<\/p>\n<\/p>\n The meeting\u2019s low-hype approach to machine intelligence proved popular. At the oversubscribed event, speaker Gary Marcus was introduced by Peter Gabriel, the frontman of the rock band Genesis, and, as a personal friend of Marcus, Matrix star Laurence Fishburne had a spot in the audience. More than 1,000 people also watched the event online.<\/p>\n \u201cThe idea of AGI might not even be the right goal, at least not now,\u201d said Marcus, a neuroscientist at New York University in New York City, during one of the keynote addresses. Some of the best AI models are highly specialized, such as AlphaFold, Google DeepMind\u2019s protein-structure predictor, he said. \u201cIt does a single thing. It does not try to write sonnets,\u201d he said.<\/p>\n Turing\u2019s playful thought experiment has often been used as a gauge of machine intelligence, but it was never meant as a serious or practical test, said Sarah Dillon, a literature researcher at the University of Cambridge, UK, who studies the mathematician\u2019s works.<\/p>\n Some of today\u2019s most capable AI systems are refined versions of large language models (LLMs) that predict text on the basis of associations made in learning from internet data. In March, researchers tested four chatbots in a version of the Turing test, and found that the best models passed.<\/p>\n Yet the fact that chatbots can imitate speech credibly does not mean that they can understand, said several researchers at the event. Although LLM responses can be uncannily human, \u201cwhen you go outside the box of what you normally ask of these systems, they have a lot of trouble,\u201d said Marcus. As examples, he cited the inability of some models to label the parts on an elephant correctly, or to draw clock hands in anywhere but the ten and two positions. For this reason, models could still fail the Turing test if they are challenged by a scientist who knows their weaknesses.<\/p>\n AI researcher Gary Marcus (left) with actor Laurence Fishburne at the Turing event.<\/span>Credit: Courtesy of the Web Science Institute at the University of Southampton<\/span><\/p>\n Still, the rapid improvement of LLM-based systems in a broad range of areas, especially reasoning tasks, has prompted speculation about whether machines will soon reach human-level performance on cognitive tests. To chart AI\u2019s growing capabilities, and to capture non-language-based skills, researchers have sought to construct harder tests. One of the most recent is the second version of the puzzle-based Abstract and Reasoning Corpus for AGI (ARC-AGI-2), which is supposed to assess an AI\u2019s ability to adapt efficiently to new problems. Such tests are often framed as milestones on the route to general intelligence, but researchers don\u2019t agree on any one benchmark for achieving AGI.<\/p>\n","protected":false},"excerpt":{"rendered":" The statue of Alan Turing at Bletchley Park, UK.Credit: Steve Meddle\/Shutterstock Today\u2019s best artificial intelligence (AI) models sail through the Turing test, a famous thought experiment that asks whether a computer can pass as a human by interacting via text. Some see an upgraded test as a necessary benchmark for progress towards artificial general intelligence<\/p>\n","protected":false},"author":1,"featured_media":29417,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[58],"tags":[627],"class_list":{"0":"post-29416","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-science","8":"tag-replacement"},"_links":{"self":[{"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/posts\/29416","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=29416"}],"version-history":[{"count":0,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/posts\/29416\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/media\/29417"}],"wp:attachment":[{"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=29416"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=29416"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=29416"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}Beyond Turing<\/h2>\n