\n<\/p>\n
Whenever I\u00a0hear the phrase \u201chuman in the loop\u201d as a desirable or best practice in reference to AI\u00a0and education, I\u00a0think of Homer Simpson.<\/p>\n
As fans of The Simpsons<\/em> know, Homer Simpson is both an idiot and a technician at Springfield\u2019s nuclear power plant. He is literally the human in the loop for plant safety, meant to monitor processes that are mostly automated.<\/p>\n In one classic episode, Homer spills jelly from a doughnut on a temperature gauge meant to signal impending meltdown, obscuring the reading and allowing the levels to reach a crisis point before an alarm forces Homer to act. Unfortunately, because he is an idiot who was not paying attention in his training, he has no idea which button to push. Fortunately, the round of eeny, meeny, miny, moe he deploys in order to make a choice lands on the proper button. Homer becomes a hero in town for averting a meltdown.<\/p>\n The need for humans in the loop when automated systems are doing the bulk of the work is obvious. When the automation breaks, we need human judgment to set things right. The challenge for the humans in the loop is to make sure you understand the loop (Homer\u2019s failure) and to maintain sufficient attention over the automated loop to detect when intervention is necessary (also Homer\u2019s failure).<\/p>\n Autopilot on planes is an obvious example of a human-in-the-loop system that seems to work. In this particular case, the human pilots are literally trained to maintain vigilance over these systems, and the systems are designed to require active input before changing something like heading or altitude. <\/p>\n But there are other human-in-the-loop systems where the human is not trained to practice vigilance and where the use of automation over time lulls the human into inattention because the automation appears to work so well\u2014until it suddenly doesn\u2019t. <\/p>\n A recent article in The Atlantic<\/em> by Raffi Krikorian, the former head of the self-driving car division at Uber, illustrates this issue. Kirkorian says, \u201cMy Tesla was driving itself perfectly\u2014until it crashed.\u201d<\/p>\n While driving his son to a Boy Scouts meeting on a route he\u2019d taken \u201chundreds of times,\u201d Krikorian suddenly felt himself experiencing the aftermath of a crash\u2014airbag deployed, glasses askew\u2014but thankfully, everyone in the car intact. He\u2019d been using self-driving mode as a matter of \u201chabit\u201d without issue, right up until the car was totaled. He notes that cars in self-driving mode go millions of miles between accidents, but \u201cthat\u2019s the problem.\u201d <\/p>\n We are asking humans to supervise systems designed to make supervision feel pointless. A machine that constantly fails keeps you sharp. A machine that works perfectly needs no oversight. But a machine that works almost perfectly? That\u2019s where the danger lies.\u201d<\/p>\n I\u00a0have been thinking recently that much of what it being talked about as \u201chumans in the loop\u201d in education is maybe, possibly, quite probably not a thing. It is a way to dodge the more immediate and necessary conversations about the nature of automation and human responses inside automated systems while maintaining a fig leaf of concern for humans working in those systems.<\/p>\n In an example close to my personal expertise, I\u00a0consider automated grading of student writing, where a human in the loop is maintained as a way to \u201ccheck\u201d the automated AI\u00a0outputs. In theory, this maintains human agency and judgment over the process, but does it?<\/p>\n The way that an LLM responds to a piece of writing and issues a grade or comment is fundamentally different than what a human does when they read a piece of writing, even when those judgments may be similar in terms of their outputs. <\/p>\n Does this matter? I\u00a0think so. I\u00a0think it means that we are not talking about a system with a human in the loop, but a system with two different loops that occasionally intersect. Unlike autopilot or self-driving cars, the automation and the human are not traversing the same paths to get to the destination. <\/p>\n The way to close the gaps between the human and the automated loop is to constrain the acceptable outcomes as much as possible. We don\u2019t want our self-driving cars to suddenly decide that we should drive across the country when we\u2019re just trying to get to the store. <\/p>\n But education does not\u2014or at least should not\u2014work this way. There must always be some aspect of self-determination to our work for both student and<\/em> instructor. For sure, the system prior to the arrival of generative AI\u00a0has leaned against this notion, particularly in writing instruction, as we\u2019ve been asked to lean into rubrics and other quasi-quantifiable outcomes. <\/p>\n But the attempts at quantification squeeze out the kinds of experiences and struggle that are most meaningful. The best favor I\u00a0ever did for my<\/em> students was to ditch my rather elaborate rubrics. I\u00a0was trying to put them on a track so they could drive to the proper destination (grade), but by doing so I\u00a0was denying them the very things they needed to develop as writers and thinkers\u2014the freedom to range.<\/p>\n I\u00a0suppose it is possible that AI\u00a0automation will prove useful in helping college faculty do their work more efficiently, but I\u00a0think it is most likely that this help will be in areas where we can allow the automation to work\u00a0\u2026 autonomously. Where we believe humans should be in the loop, I\u00a0think deep consideration of what we\u2019re trying to achieve will reveal that humans are<\/em> the loop, or that perhaps learning is not a loop at all, but is instead many loops\u2014and swirls and curlicues and other scribbles that may not be wholly quantifiable but still add up to something meaningful.<\/p>\n Introducing automation to student-produced products before they\u2019ve developed the necessary judgment for evaluation or practice in maintaining vigilance looks to me like a steady slide to disempowerment and disengagement. <\/p>\n I\u00a0hear claims that we need to get students working with AI\u00a0so they\u2019re prepared for the future, but how sure are we that we\u2019re not turning them into a generation of Homer Simpsons?<\/p>\n","protected":false},"excerpt":{"rendered":" Whenever I\u00a0hear the phrase \u201chuman in the loop\u201d as a desirable or best practice in reference to AI\u00a0and education, I\u00a0think of Homer Simpson. As fans of The Simpsons know, Homer Simpson is both an idiot and a technician at Springfield\u2019s nuclear power plant. He is literally the human in the loop for plant safety, meant<\/p>\n","protected":false},"author":1,"featured_media":47118,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[57],"tags":[1326,496,3698,14939,4802],"class_list":{"0":"post-47117","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-education","8":"tag-dont","9":"tag-education","10":"tag-humans","11":"tag-loop","12":"tag-mix"},"_links":{"self":[{"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/posts\/47117","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=47117"}],"version-history":[{"count":0,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/posts\/47117\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=\/wp\/v2\/media\/47118"}],"wp:attachment":[{"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=47117"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=47117"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/naijaglobalnews.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=47117"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}