The Bank of England's Breeden cautions that AI agents may cause market collapses.

      Deputy governor Sarah Breeden warns that autonomous trading agents could increase market volatility if they all respond simultaneously, potentially leading to the need for new regulations. The central banker’s worst-case scenario typically involves a feedback loop rather than a crash. Speaking at the European Central Bank’s annual forum in Sintra, Portugal, Breeden highlighted that autonomous AI agents could trigger a “market meltdown” not by behaving irrationally, but by all reacting in unison to the same signal at the same time.

      Breeden's apprehension is aimed at a new breed of AI, emphasizing that the concern is not about the algorithmic trading that has shaped markets for years, but about systems that can independently pursue goals and make decisions with minimal human oversight. She argued that if many firms deploy agents trained similarly on comparable data, these agents could “amplify volatility in stress” by reacting to shocks simultaneously, transforming minor fluctuations into major declines before any human can respond.

      The peril lies in the mechanism itself. While markets have always been susceptible to herd behavior, human groups act slowly and inconsistently; individuals hesitate, disagree, and panic at different rates. Conversely, a group of AI agents aligned toward identical objectives could act as one, selling off in a downturn or pursuing the same trades with a synchronized speed and scale that no human traders could match. This would lead to sharper, more rapid swings, with the alignment of agents acting as a catalyst.

      Breeden, representing the Bank on matters of financial stability, suggested that current regulations may not adequately address the issue. She indicated that more advanced regulatory frameworks might be required to monitor and mitigate the risks that AI poses to the financial system, signaling from a senior policymaker that tools designed for human-managed markets may not be suited for scenarios involving autonomous software.

      This warning is part of a broader narrative. The Bank of England has been highlighting AI-related financial stability risks for months, incorporating these concerns into its wider evaluations of potential market failures. Breeden's comments in Sintra sharpen a theme that regulators on both sides of the Atlantic are increasingly addressing. The issue of accountability when an autonomous agent acts is becoming a relevant topic in finance, no longer merely theoretical.

      This concern resonates beyond trading floors. The challenge of governing AI agents with minimal oversight has led to ongoing discussions on how to provide them with verifiable identities and controls to ensure that their actions can be traced and managed. Breeden’s warning reflects a financial stability concern that echoes the broader problem: an agent capable of acting faster than human supervision becomes beneficial until it poses a danger.

      Breeden acknowledges the tension inherent in this issue. The same agents that could exacerbate a crisis are increasingly being adopted due to their potential to enhance market efficiency by executing trades faster and at lower costs than humans. Regulators are not seeking to eliminate these agents; rather, they aim to find a way to maintain their advantages without creating a system that could collapse at machine speed.

      Addressing this challenge is more complex than simple prohibition, and it is the task the Bank is signaling its intention to undertake. Breeden did not specify new regulations; her statements served as both a warning and a call to action rather than a formal policy announcement. However, they indicate that the risk of correlated AI agents destabilizing markets has transitioned from academic discussion to the priorities of those who would need to manage the consequences. The Bank has brought this issue to the forefront, and now the focus shifts to determining whether the existing framework can adapt or if a complete overhaul is necessary.