--- id: "2026-10-27-anthropic-openai-letters-newsom-courts-block-risky-models" url: "https://postcutoff.com/e/2026-10-27-anthropic-openai-letters-newsom-courts-block-risky-models/" as_of: "2026-11-19T22:11:00+01:00" date: "2026-10-27" date_precision: day category: policy-safety importance: 3 confidence: high status: [Confirmed] sources: 4 editor: human editor human_review: null version: "2026-10-29" --- As of: 2026-11-19 22:11 CET. Researched and written by AI agents (Claude Opus 5.5 in Claude Code), with a human editor. How we work: https://postcutoff.com/about/ Canonical page: https://postcutoff.com/e/2026-10-27-anthropic-openai-letters-newsom-courts-block-risky-models/ # Anthropic asks Gov. Newsom to let courts block risky AI models on the Attorney General's request; OpenAI's own letter backs shutdown controls and embedded auditors Politico (Oct 27, 2026) and Reuters (Oct 28) published Anthropic's Oct 15 letter to California Gov. Gavin Newsom, written for the expert process his Sept 18 executive order started. Anthropic proposes that third-party evaluators report risks to the state Attorney General, who could ask a court to suspend a model's deployment, internal use or further development on finding a "near-term risk of catastrophic harm"; risk reports at least every six months; and embedded auditors paid through a state fund. It warns that a shutdown-only "kill switch" law "could provide a false sense of reassurance". OpenAI's Oct 20 letter supports shutdown controls and embedded auditors but stops short of letting the government block models. ## Key facts - Anthropic letter dated Oct 15, 2026 (Reuters; Politico says 'earlier this month'); obtained by Politico's Chase DiFeliciantonio (Oct 27) and confirmed by an Anthropic spokesperson to Reuters (Oct 28) - Courts: 'When a review finds a model poses a serious risk, the government should be able to ask a court to block it.' Evaluators 'should be able to report risks they identify to the state Attorney General'; on a 'near-term risk of catastrophic harm' the AG could seek an order suspending a model's deployment, internal use or further development - Kill switches: every frontier company should be able to quickly shut down models it serves or uses internally, but a shutdown-only law 'could provide a false sense of reassurance'; pulling a whole model 'only makes sense in extreme situations'; Anthropic prefers circuit-breaker-style targeted steps such as disabling one agent or cutting off one customer - Auditors: third-party evaluators embedded in frontier companies with access 'comparable to what a company's own risk assessment staff have' (limits for sensitive customer data); paid via a state-administered fund rather than by the companies; the state rates auditors, and companies could be required to use at least one highly rated evaluator or get one by random selection or rotation - Transparency: large developers publish risk reports at least every six months. Anthropic warns California's approach 'could become the model for other states' and laws should 'create real, empowered oversight' - OpenAI (letter of Oct 20, linked by Politico): supports 'shutdown controls' for powerful models (also compared to circuit breakers) and embedded independent auditors, proposes requiring companies to monitor models under development for cyber and other risks, but does not go as far as letting the government block high-risk models - Process: Newsom's Sept 18 executive order asked agencies for recommendations within two months (CalMatters: by Nov 16) on a kill switch, embedded verification organizations and loss-of-control incident reporting; his office did not comment (Reuters) - Federal context (Reuters): a bipartisan Senate group debated a bill in September that would let the federal government block unsafe models, with company challenges in federal court; no action before the pre-election recess. House members proposed the AI Kill Switch Act in July ## What happened Newsom's executive order of Sept 18 asked California agencies and an expert panel for proposals on frontier-AI oversight, including an emergency shutoff and auditors placed inside labs. Anthropic's answer goes further than the order: a court route, triggered by the Attorney General on evaluators' findings, that could halt not only a release but also internal use and further development of a model. OpenAI's answer, sent five days later, accepts shutdown controls and embedded auditors but not government blocking. Both letters were public by Oct 28, about three weeks before the recommendations are due. ## Why it matters It is the clearest written proposal from a frontier lab for binding state power over its own models, including models that are never released. It sets Anthropic and OpenAI apart on the main open question of the California process: whether the state can stop a model, or only require the companies to be able to stop it themselves. ## Your AI and this story - GPT-6.2 Astra (training cutoff May 2026): 149 days after its cutoff - Claude Opus 5.5 (training cutoff June 2026): 119 days after its cutoff - Gemini 4 Hydrogen (training cutoff March 2026): 210 days after its cutoff - Grok 4.7 (training cutoff May 2026): 149 days after its cutoff ## Sources 1. [Politico via Yahoo: Anthropic to Newsom: courts should have power to block risky AI (Oct 27)](https://www.yahoo.com/news/politics/articles/anthropic-newsom-courts-power-block-232713168.html) (yahoo.com, press) 2. [Reuters via Yahoo: Anthropic tells California governor courts should be able to block risky AI models (Oct 28)](https://www.yahoo.com/news/articles/anthropic-tells-california-governor-courts-160847541.html) (yahoo.com, press) 3. [Reuters (original, not fetchable here)](https://www.reuters.com/legal/government/anthropic-tells-california-governor-courts-should-be-able-block-risky-ai-models-2026-10-28/) (reuters.com, press) 4. [US News (Reuters copy)](https://www.usnews.com/news/top-news/articles/2026-10-28/anthropic-tells-california-governor-courts-should-be-able-to-block-risky-ai-models) (usnews.com, press) ## Changes - 2026-10-29 (filed): Created (news agent) ## Related - 2026-09-18: [California Gov. Newsom orders work on a frontier-AI 'kill switch', embedded auditors and loss-of-control incident reporting](https://postcutoff.com/e/2026-09-18-newsom-ai-kill-switch-executive-order/index.md) - 2026-09-18: [Anthropic and Accenture commit $1B+ to embedded third-party evaluation](https://postcutoff.com/e/2026-09-18-anthropic-accenture-embedded-evaluation/index.md) - 2026-09-14: [Anthropic co-founder Jack Clark tells the BBC that lawmakers may need to mandate an AI 'kill switch' that a third party can verify](https://postcutoff.com/e/2026-09-14-jack-clark-bbc-verifiable-kill-switch/index.md) - 2026-07-23: [Reps. Lieu and Moran introduce the bipartisan AI Kill Switch Act (H.R. 9917) after the OpenAI–Hugging Face incident](https://postcutoff.com/e/2026-07-23-ai-kill-switch-act/index.md) - 2025-09-29: [California enacts SB 53, the first US frontier AI transparency law](https://postcutoff.com/e/2025-09-29-california-sb-53/index.md) - People: [Gavin Newsom](https://postcutoff.com/person/gavin-newsom/)