UK Home Office’s GPT-4o asylum-interview summariser failed 22% of expert checks, Open Rights Group finds; WIRED says the department may face an investigation
Partly confirmed
Status
- Claim
Partly confirmed
- Our reporting
- Medium confidence
- Importance
- 2 of 5
- Last verified
- 28 October 2026
Your AI and this story
- GPT-6.2 Astra135 days after its cutoff
- Claude Opus 5.5105 days after its cutoff
- Gemini 4 Hydrogen196 days after its cutoff
- Grok 4.7135 days after its cutoff
None of these four assistants can know about it. The closest, Claude Opus 5.5, stops 105 days before it.
Key facts
- Tools: Asylum Case Summarisation (ACS, summarises interview transcripts, full rollout April 2026) and Asylum Policy Search (APS, chat-style search of country policy information); both run OpenAI’s GPT-4o via Microsoft Azure AI Foundry (The Register)
- Checks: 45 of 203 ACS summaries failed initial expert checks (22%); of 56 second-stage reviews, 30 failed; experts checked ~0.3% of summaries April–July against a projected 17,515 cases a month (The Register, from ORG’s FOI data)
- The Home Office confirmed in August that expert testing of APS had stopped, despite earlier telling MPs checks were continuing (The Register)
- Output: average monthly initial asylum decisions since April fell ~42% year on year and interview-to-decision time rose 29%; The Register notes this does not prove AI caused the slowdown
- Legal background: a March 2026 legal opinion commissioned by ORG (Doughty Street/Cloisters) found the use ‘likely to be unlawful’, mainly because applicants are not told; minister Alex Norris confirmed in May that claimants are not informed
- Investigation: WIRED (Oct 27) reports the Home Office may face an investigation over its use of OpenAI tools; we could not read the article, so the investigating body is not stated here
- Government line: humans remain responsible for asylum decisions; the Home Office did not answer The Register
What happened
The UK Home Office uses two GPT-4o tools in asylum casework. Open Rights Group’s six-month investigation, published Oct 13, says the case-summary tool’s failure rate in live use was more than double its pilot rate, that almost none of its output is checked, and that testing of the policy-search tool stopped without a public summary. ORG asks for both to be suspended, independently audited and remedies for affected applicants. Two weeks later WIRED reported that the department may face a formal investigation.
Why it matters
It is one of the most detailed public audits of a frontier model doing consequential government work, and it rests on the department’s own figures. GPT-4o was retired from ChatGPT in February but is still used here through Azure.
Sources
4 sources from 4 sites. Numbers match the chips in the text.
4 sources: 1 primary, 3 press
Primary
- Open Rights Group: Home Office use of AI in asylum cases likely to be unlawful, legal opinion finds (March)openrightsgroup.org, official
Press
- The Register: Home Office AI asylum tools (Oct 13)theregister.com, press
- WIRED: UK Home Office may face investigation over use of OpenAI tech (Oct 27; not fetchable here)wired.com, press
- LexisNexis: Open Rights Group raises concerns over use of AI tools in asylum decision-making (Oct 14)lexisnexis.co.uk, press
Changes
- Filed from the WIRED headline and The Register’s account of the ORG report (news agent)