\n<\/p>\n
If there is any field<\/span> in which the rise of AI is already said to be rendering humans obsolete\u2014in which the dawn of superintelligence is already upon us\u2014it is coding. This makes the results of a recent study genuinely astonishing.<\/p>\n In the study, published in July, the think tank Model Evaluation & Threat Research randomly assigned a group of experienced software developers to perform coding tasks with or without AI tools. It was the most rigorous test to date of how AI would perform in the real world. Because coding is one of the skills that existing models have largely mastered, just about everyone involved expected AI to generate huge productivity gains. In a pre-experiment survey of experts, the mean prediction was that AI would speed developers\u2019 work by nearly 40 percent. Afterward, the study participants estimated that AI had made them 20 percent faster.<\/p>\n But when the METR team looked at the employees\u2019 actual work output, they found that the developers had completed tasks 20 percent slower<\/em> when using AI than when working without it. The researchers were stunned. \u201cNo one expected that outcome,\u201d Nate Rush, one of the authors of the study, told me. \u201cWe didn\u2019t even really consider a slowdown as a possibility.\u201d<\/p>\n No individual experiment should be treated as the final word. But the METR study is, according to many AI experts, the best we have\u2014and it helps make sense of an otherwise paradoxical moment for AI. On the one hand, the United States is undergoing an extraordinary, AI-fueled economic boom: The stock market is soaring thanks to the frothy valuations of AI-associated tech giants, and the real economy is being propelled by hundreds of billions of dollars of spending on data centers and other AI infrastructure. Undergirding all of the investment is the belief that AI will make workers dramatically more productive, which will in turn boost corporate profits to unimaginable levels.<\/p>\n On the other hand, evidence is piling up that AI is failing to deliver in the real world. The tech giants pouring the most money into AI are nowhere close to recouping their investments. Research suggests that the companies trying to incorporate AI have seen virtually no impact on their bottom line. And economists looking for evidence of AI-replaced job displacement have mostly come up empty.<\/p>\n None of that means that AI can\u2019t eventually be every bit as transformative as its biggest boosters claim it will be. But eventually <\/em>could turn out to be a long time. This raises the possibility that we\u2019re currently experiencing an AI bubble, in which investor excitement has gotten too far ahead of the technology\u2019s near-term productivity benefits. If that bubble bursts, it could put the dot-com crash to shame\u2014and the tech giants and their Silicon Valley backers won\u2019t be the only ones who suffer.<\/p>\n Almost everyone agrees<\/span> that coding is the most impressive use case for current AI technology. Before its most recent study, METR was best known for a March analysis showing that the most advanced systems could handle coding tasks that take a typical human developer nearly an hour to finish. So how could AI have made the developers in its experiment less <\/em>productive?<\/p>\n The answer has to do with the \u201ccapability-reliability gap.\u201d Although AI systems have learned to perform an impressive set of tasks, they struggle to complete those tasks with the consistency and accuracy demanded in real-world settings. The results of the March METR study, for example, were based on a \u201c50 percent success rate,\u201d meaning the AI system could reliably complete the task only half the time\u2014making it essentially useless on its own. This gap makes using AI in a work context challenging. Even the most advanced systems make small mistakes or slightly misunderstand directions, requiring a human to carefully review their work and make changes where needed.<\/p>\n This appears to be what happened during the newer study. Developers ended up spending a lot of time checking and redoing the code that AI systems had produced\u2014often more time than it would have taken to simply write it themselves. One participant later described the process\u00a0 as the \u201cdigital equivalent of shoulder-surfing an overconfident junior developer.\u201d<\/p>\n Since the experiment was conducted, AI coding tools have gotten more reliable. And the study focused on expert developers, whereas the biggest productivity gains could come from enhancing\u2014or replacing\u2014the capabilities of less experienced workers. But the METR study might just as easily be over<\/em>estimating AI-related productivity benefits. Many knowledge-work tasks are harder to automate than coding, which benefits from huge amounts of training data and clear definitions of success. \u201cProgramming is something that AI systems tend to do extremely well,\u201d Tim Fist, the director of Emerging Technology Policy at the Institute for Progress, told me. \u201cSo if it turns out they aren\u2019t even making developers<\/em> more productive, that could really change the picture of how AI might impact economic growth in general.\u201d<\/p>\n [Read: Tesla wants out of the car business]<\/p>\n The capability-reliability gap might explain why generative AI has so far failed to deliver tangible results for businesses that use it. When researchers at MIT recently tracked the results of 300 publicly disclosed AI initiatives, they found that 95 percent of projects failed to deliver any boost to profits. A March report from McKinsey & Company found that 71 percent of\u00a0 companies reported using generative AI, and more than 80 percent of them reported that the technology had no \u201ctangible impact\u201d on earnings. In light of these trends, Gartner, a tech-consulting firm, recently declared that AI has entered the \u201ctrough of disillusionment\u201d phase of technological development.<\/p>\n Perhaps AI advancement is experiencing only a temporary blip. According to Erik Brynjolfsson, an economist at Stanford University, every new technology experiences a \u201cproductivity J-curve\u201d: At first, businesses struggle to deploy it, causing productivity to fall. Eventually, however, they learn to integrate it, and productivity soars. The canonical example is electricity, which became available in the 1880s but didn\u2019t begin to generate big productivity gains for firms until Henry Ford reimagined factory production in the 1910s. Some experts believe that this process will play out much faster for AI. \u201cWith AI, we\u2019re in the early, negative part of the J-curve,\u201d Brynjolfsson told me. \u201cBut by the second half of the 2020s, it\u2019s really going to take off.\u201d Anthropic CEO Dario Amodei has predicted that by 2027, or \u201cnot much longer than that,\u201d AI will be \u201cbetter than humans at almost everything.\u201d<\/p>\n These forecasts assume that AI will continue to improve as fast as it has over the past few years. This is not a given. Newer models have been marred by delays and cancellations, and those released this year have generally shown fewer big improvements than past models despite being far more expensive to develop. In a March survey, the Association for the Advancement of Artificial Intelligence asked 475 AI researchers whether current approaches to AI development could produce a system that matches or surpasses human intelligence; more than three-fourths said that it was \u201cunlikely\u201d or \u201cvery unlikely.\u201d<\/p>\n OpenAI\u2019s latest model, GPT-5, was released early last month after nearly three years of work and billions in spending. (The Atlantic<\/em> entered into a corporate partnership with OpenAI in 2024.) <\/strong>Before the launch, CEO Sam Altman declared that using it would be the equivalent of having \u201ca legitimate Ph.D.-level expert in anything\u201d at your fingertips. In a few areas, including coding, GPT-5 was indeed a major step up. But by most rigorous measures of AI performance, GPT-5 turned out to be, at best, a modest improvement over previous models.<\/p>\n The dominant view within the industry is that it is only a matter of time before companies find the next way to supercharge AI progress. That could turn out to be true, but it is far from guaranteed.<\/p>\n Generative AI<\/span> would not be the first tech fad to experience a wave of excessive hype. What makes the current situation distinctive is that AI appears to be propping up something like the entire U.S. economy. More than half of the growth of the S&P 500 since 2023 has come from just seven companies: Alphabet, Amazon, Apple, Meta, Microsoft, Nvidia, and Tesla. These firms, collectively known as the Magnificent Seven, are seen as especially well positioned to prosper from the AI revolution.<\/p>\n That prosperity has largely yet to materialize anywhere other than their share prices. (The exception is Nvidia, which provides the crucial inputs\u2014advanced chips\u2014that the rest of the Magnificent Seven are buying.) As The Wall Street Journal<\/em> reports, Alphabet, Amazon, Meta, and Microsoft have seen their free cash flow decline by 30 percent over the past two years. By one estimate, Meta, Amazon, Microsoft, Google, and Tesla will by the end of this year have collectively spent $560 billion on AI-related capital expenditures since the beginning of 2024 and have brought in just $35 billion in AI-related revenue. OpenAI and Anthropic are bringing in lots of revenue and are growing fast, but they are still nowhere near profitable. Their valuations\u2014roughly $300 billion and $183 billion, respectively, and rising\u2014are many multiples higher than their current revenues. (OpenAI projects about $13 billion in revenues this year; Anthropic, $2 billion to $4 billion.) Investors are betting heavily on the prospect that all of this spending will soon generate record-breaking profits. If that belief collapses, however, investors might start to sell en masse, causing the market to experience a large and painful correction.<\/p>\n During the internet revolution of the 1990s, investors poured their money into basically every company with a \u201c.com\u201d in its name, based on the belief that the internet was about to revolutionize business. By 2000, however, it had become clear that companies were burning through cash with little to show for it, and investors responded by dumping the most overpriced tech stocks. From March 2000 to October 2002, the S&P 500 fell by nearly 50 percent. Eventually, the internet did indeed transform the economy and lead to some of the most profitable companies in human history. But that didn\u2019t prevent a whole lot of investors from losing their shirts.<\/p>\n The dot-com crash was bad, but it did not trigger a crisis. An AI-bubble crash could be different. AI-related investments have already surpassed the level that telecom hit at the peak of the dot-com boom as a share of the economy. In the first half of this year, business spending on AI added more to GDP growth than all consumer spending combined<\/em>. Many experts believe that a major reason the U.S. economy has been able to weather tariffs and mass deportations without a recession is because all of this AI spending is acting, in the words of one economist, as a \u201cmassive private sector stimulus program.\u201d An AI crash could lead broadly to less spending, fewer jobs, and slower growth, potentially dragging the economy into a recession. The economist Noah Smith argues that it could even lead to a financial crisis if the unregulated \u201cprivate credit\u201d loans funding much of the industry\u2019s expansion all go bust at once.<\/p>\n [Rog\u00e9 Karma: Does the stock market know something we don\u2019t?]<\/p>\n If we do turn out to be in an AI bubble, the silver lining would be that fears of sudden AI-driven job displacement are overblown. In a recent analysis, the economists Sarah Eckhardt and Nathan Goldschlag used five different measurements of AI exposure to estimate how the new technology might be affecting a range of labor-market indicators and found virtually no effect on any of them. For example, they note that the unemployment rate for the workers least exposed to AI, such as construction workers and fitness trainers, has risen three times faster than the rate for the workers most exposed to it, such as telemarketers and software developers. Most other studies, though not all, have come to similar conclusions.<\/p>\n But there\u2019s also a weirder, in-between possibility. Even if AI tools don\u2019t increase productivity, the hype surrounding them could push businesses to keep expanding their use anyway. \u201cI hear the same story over and over again from companies,\u201d Daron Acemoglu, an economist at MIT, told me. \u201cMid-to-high-level managers are being told by their bosses that they need to use AI for X percent of their job to satisfy the board.\u201d These companies might even lay off workers or slow their hiring because they are convinced\u2014like the software developers from the METR study\u2014that AI has made them more productive, even when it hasn\u2019t. The result would be an increase in unemployment that isn\u2019t offset by actual gains in productivity.<\/p>\n As unlikely as this scenario sounds, a version of it happened in the not-so-distant past. In his 2021 book, A World Without Email<\/em>, the computer scientist Cal Newport points out that beginning in the 1980s, tools such as computers, email, and online calendars allowed knowledge workers to handle their own communications and schedule their own meetings. In turn, many companies decided to lay off their secretaries and typists. In a perverse result, higher-skilled employees started spending so much of their time sending emails, writing up meeting notes, and scheduling meetings that they became far less<\/em> productive at their actual job, forcing the companies to hire more of them to do the same amount of work. A later study of 20 Fortune<\/em> 500 companies found that those with computer-driven \u201cstaffing imbalances\u201d were spending 15 percent more on salary than they needed to. \u201cEmail was one of those technologies that made us feel more productive but actually did the opposite,\u201d Newport told me. \u201cI worry we may be headed down the same path with AI.\u201d<\/p>\n Then again, if the alternative is a stock-market crash that precipitates a recession or a financial crisis, that scenario might not be so bad.<\/p>\n","protected":false},"excerpt":{"rendered":" If there is any field in which the rise of AI is already said to be rendering humans obsolete\u2014in which the dawn of superintelligence is already upon us\u2014it is coding. This makes the results of a recent study genuinely astonishing. In the study, published in July, the think tank Model Evaluation & Threat Research randomly<\/p>\n","protected":false},"author":1,"featured_media":19747,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[55],"tags":[1295,904],"class_list":{"0":"post-19746","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-social-issues","8":"tag-bad","9":"tag-bubble"},"_links":{"self":[{"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/posts\/19746","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=19746"}],"version-history":[{"count":0,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/posts\/19746\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/media\/19747"}],"wp:attachment":[{"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=19746"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=19746"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=19746"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}