Ben Murphy: ‘we are going to quickly need to adapt to a world with omnipresent swarms’
Ben Murphy @benjaminmmurphyX
Why it matters
Policy reaction to the Anthropic study from a researcher whose profile lists RAND CAST, IFP and FAI.
Summary
Posted Oct 12, 2026 (19:54 UTC). Ben Murphy quotes @scaling01’s post: ‘If small models are capable of self-replication on consumer-grade hardware, such swarms will inevitably exist out in the world. A developer will launch such a model for fun; a misaligned large model will do so intentionally; or criminal groups will build organic botnets based on model-led exploitation.’ He argues that ‘we need the capability to monitor and shut down these models where necessary, rapidly roll out software patches to targeted hardware, and understand ... what the agents’ aims are’.
Metrics as of 2026-10-13 via api.fxtwitter.com: 6,736 views, 72 likes, 22 reposts.
Archived text
If small models are capable of self-replication on consumer-grade hardware, such swarms will inevitably exist out in the world. A developer will launch such a model for fun; a misaligned large model will do so intentionally; or criminal groups will build organic botnets based on model-led exploitation.
While control and monitoring remain incredibly important for risks caused by lab-hosted agents, we are going to quickly need to adapt to a world with omnipresent swarms. This means we need the capability to monitor and shut down these models where necessary, rapidly roll out software patches to targeted hardware, and understand—from external signals or from the swarm itself—what the agents’ aims are.
Quoting @scaling01: ANTHROPIC: “small AI models may be months away from being capable enough to self-replicate on commercial IoT devices”
“In our evals, a 9B model got inference running on 8 of the 9 hardware types we tested”