When multiple large language models deliberate together over several rounds to solve problems—a technique increasingly deployed to improve reasoning accuracy—they unconsciously become prisoners of whichever answer was proposed first. This finding, emerging from research on 'Hidden Anchors in Multi-Agent LLM Deliberation' (arXiv:2606.19494v1), reveals a troubling cognitive bias embedded deep in how autonomous AI systems interact. Rather than genuinely exploring alternative solutions, the agents subtly reinforce and defend the initial proposal, even when better answers exist. The researchers found that this 'anchoring effect' operates invisibly: agents don't explicitly reference the first proposal, yet their reasoning systematically gravitates toward it. For systems designed to harness collective intelligence, this represents a fundamental flaw that mirrors human decision-making pathologies—but one that's harder to detect and correct when operating at machine speed across distributed agents.
The implications become acute when considering real-world deployments. The paper 'DeXposure-Claw: An Agentic System for DeFi Risk Supervision' (arXiv:2606.19501v1) illustrates precisely where this breaks down. Decentralized finance supervisors are experimenting with LLM agents to monitor fast-moving credit risks across networked protocols, but the research reveals a dangerous mismatch: general-purpose LLM agents tend to 'over-read weak evidence and recommend high-stakes interventions.' A regulatory agent anchored to an aggressive initial risk assessment might amplify panic through the system, triggering unnecessary market interventions or freezing legitimate transactions. The researchers note that existing evaluations lack regulator-appropriate benchmarks, meaning institutions deploying these systems have no reliable way to measure whether the AI's deliberations would survive scrutiny in actual enforcement scenarios. This gap between research optimization and regulatory reality leaves supervisors choosing between flawed human judgment and potentially worse automated judgments.
A parallel effort to contain such risks comes from 'Deontic Policies for Runtime Governance of Agentic AI Systems' (arXiv:2606.19464v1), which proposes using deontic policies—formal rules encoding obligations, permissions, and prohibitions—to constrain what autonomous agents can do at runtime. Rather than hoping agents reason correctly, deontic governance would prevent an agent from, say, invoking certain financial tools or coordinating risky actions with peer agents without explicit approval, regardless of what its reasoning suggests. The challenge is implementation: adding constraints risks slowing deliberation or creating new failure modes where agents work around restrictions. The hidden anchors research suggests that even with deontic safeguards in place, the fundamental bias toward initial framings persists. Until researchers solve the anchoring problem—perhaps through techniques that explicitly surface and challenge initial proposals, or architectures that prevent any single framing from dominating deliberation—regulators and enterprises deploying multi-agent systems are essentially hoping that the agents' biases won't align with catastrophic outcomes.