California Gov. Newsom orders work on a frontier-AI ‘kill switch’, embedded auditors and loss-of-control incident reporting
Confirmed
The takeaway
On Sept 18, 2026 Gov. Gavin Newsom signed an executive order directing California’s Government Operations Agency and Office of Emergency Services to have experts recommend, within two months, stronger frontier-AI rules.
Status
- Claim
Confirmed
- Our reporting
- High confidence
- Importance
- 3 of 5
- Last verified
- 18 October 2026
Your AI and this story
- GPT-6.2 Astra110 days after its cutoff
- Claude Opus 5.580 days after its cutoff
- Gemini 4 Hydrogen171 days after its cutoff
- Grok 4.7110 days after its cutoff
None of these four assistants can know about it. The closest, Claude Opus 5.5, stops 80 days before it.
Key facts
- Signed Sept 18, 2026; agencies: Government Operations Agency and the Governor’s Office of Emergency Services; expert recommendations due in two months (CalMatters: by Nov 16, 2026)
- Measures under consideration: independent third parties writing safety plans for frontier AI companies; a requirement that developers can shut down frontier models in an emergency (‘kill switch’); designated independent verification organizations embedded onsite for regular audits; verification of safety frameworks, transparency reports and risk assessments
- Would widen SB 53’s ‘critical safety incident’ definition to include ‘loss-of-control incidents such as the Hugging Face attack’ (the July 2026 OpenAI-agent intrusion)
- Newsom: ‘We’re not waiting to act – we’re going to speed up our work on substantial and responsible AI oversight before it’s too late’
- Sept 23 advisers: Jason Goldman (first White House Chief Digital Officer), Gillian Hadfield (Johns Hopkins / Vector Institute), Alondra Nelson (IAS, former acting OSTP director), Rob Reich (Stanford, former senior adviser to the US AI Safety Institute)
- Related bills signed in Sept 2026 (Kelley Drye tracker): SB 813 (process to select independent verification organizations by Jan 1, 2028) and AB 1405 (AI Auditor Registry by Jan 1, 2029) on Sept 9; SB 1119 (companion-chatbot safety, audits from 2029) and SB 867 (bans companion chatbots in toys) on Sept 10; SB 1050 (synthetic-performer ad disclosures) on Sept 16; AB 1609 (customer-service chatbot disclosure, human agent within 15 minutes) on Sept 28
- Final bill actions on Sept 30, 2026: SB 947 (No Robo Bosses), SB 951, SB 1000, AB 2713, AB 1864 and others signed; AB 2575, SB 903, AB 2656 and SB 1130 vetoed. No frontier-model bill was on the desk (see Newsom’s final 2026 AI bill decisions)
- Second wave (Al Jazeera, Saumya Roy, Oct 17, 2026): framed the order as part of Newsom positioning for a 2028 presidential run; recommendations due from the Office of Emergency Services by Nov 15, and Newsom could call a special legislative session before his term ends in January. Christabel Randolph (CAIDP): “It seems the governor operated from the premise that a slower pace of regulation would be sufficient”; Alex Hanna (DAIR): “He is in a lame duck period here… He is setting up his next thing.”
What happened
After a summer of agent incidents (the July Hugging Face intrusion by OpenAI agents, sandbox escapes) and lab leaders’ calls to “pace the frontier”, Newsom moved from SB 53’s transparency approach toward the mandates he vetoed in SB 1047 (third-party audits, a shutdown capability). He did it by executive order and an expert process rather than a bill. The Legislature’s session had already ended. Bills on the governor’s desk must be signed or vetoed by Sept 30, 2026.
Why it matters
California hosts most US frontier labs, and its SB 53 is the main US frontier-AI law. The recommendations (due mid-November 2026) could become 2027 legislation for kill switches and embedded auditors, while the federal government is relying on voluntary commitments.
Sources
8 sources from 7 sites. Numbers match the chips in the text.
8 sources: 2 primary, 6 press
Primary
- Governor of California: executive order to accelerate independent oversight and advance an AI kill switchgov.ca.gov, official
- Governor of California: world-leading experts to deliver on the AI executive order (Sept 23)gov.ca.gov, official
Press
- CalMatters: Newsom orders California agencies to develop new AI safety plans after rejecting tougher lawcalmatters.org, press
- Washington Post: California governor signs order pushing for an AI ‘kill switch’washingtonpost.com, press
- NBC News: Newsom inks AI oversight executive ordernbcnews.com, press
- KPBS: a kill switch is one of the possible AI regulationskpbs.org, press
- Kelley Drye: California’s 2026 session — AI bills signed into law (updated Sept 29)kelleydrye.com, press
- Al Jazeera: California Gov Newsom boosts AI regulation as he eyes 2028 presidential run (Oct 17)aljazeera.com, press
Changes
- Added Al Jazeera second-wave coverage (Oct 17: 2028 framing, Nov 15 deadline, possible special session, Randolph and Hanna quotes)
- Added the Sept 30 final bill actions
- Filed (missed earlier; found while checking the California bill-signing deadline)