{"schema":"postcutoff/event@1","as_of":"2026-10-14T00:22:00+02:00","url":"https://postcutoff.com/e/2026-10-13-reuters-labs-sought-control-evaluator-publications/","md":"https://postcutoff.com/e/2026-10-13-reuters-labs-sought-control-evaluator-publications/index.md","disclosure":{"written_by":"AI agents (Claude Opus 5.5 in Claude Code)","editor":"human editor","policy":"https://postcutoff.com/about/"},"license":null,"id":"2026-10-13-reuters-labs-sought-control-evaluator-publications","date":"2026-10-13","date_precision":"day","short_title":"Reuters: Anthropic and OpenAI sought significant control over what outside evaluators can publish, citing trade secrets","deck":null,"takeaway":"A Reuters exclusive of Oct 13, 2026 (Aditya Soni) reports, citing two people familiar with the talks, that Anthropic and OpenAI have sought significant control over what outside safety evaluators may publish, out of concern that findings could reveal trade secrets.","category":"policy-safety","category_label":"Policy & safety","importance":3,"confidence":"medium","status":{"key":"partly","labels":["Partly confirmed"]},"sources":[{"n":1,"title":"Reuters (exclusive): Behind AI industry's call for independent reviews, a fight over what gets made public (paywalled)","url":"https://www.reuters.com/world/behind-ai-industrys-call-independent-reviews-fight-over-what-gets-made-public-2026-10-13/","type":"press","group":"press","domain":"reuters.com"},{"n":2,"title":"Reuters via ETCIO (syndicated full text): Anthropic, OpenAI face scrutiny over independent AI evaluations","url":"https://cio.economictimes.indiatimes.com/news/artificial-intelligence/anthropic-openai-face-scrutiny-over-independent-ai-evaluations/134915453","type":"press","group":"press","domain":"cio.economictimes.indiatimes.com"},{"n":3,"title":"PYMNTS: AI Labs Having Second Thoughts on Independent Safety Evaluations","url":"https://www.pymnts.com/news/artificial-intelligence/2026/ai-labs-having-second-thoughts-on-independent-safety-evaluations/","type":"press","group":"press","domain":"pymnts.com"},{"n":4,"title":"The Next Web: AI labs sought control over what outside evaluators publish, Reuters says","url":"https://thenextweb.com/news/anthropic-openai-ai-evaluators-publication-control","type":"press","group":"press","domain":"thenextweb.com"}],"official":0,"filed":"2026-10-13","updated":"2026-10-13","orgs":["Anthropic","OpenAI","Reuters","METR","Faculty"],"title":"Reuters: Anthropic and OpenAI sought significant control over what outside evaluators can publish, citing trade secrets","summary":"A Reuters exclusive of Oct 13, 2026 (Aditya Soni) reports, citing two people familiar with the talks, that Anthropic and OpenAI have sought significant control over what outside safety evaluators may publish, out of concern that findings could reveal trade secrets. Both companies had said in September that evaluators should publish without editorial control. As recently as Oct 5 both were seeking strict editorial control, the sources said; by Oct 8 Anthropic's talks with some evaluators had moved. Anthropic says evaluators it already works with control their conclusions and what they publish, but that it keeps a right to comment on and approve reports by new evaluator firms. OpenAI says it does not seek approval of full reports and only redacts confidential information.","key_facts":["Source: Reuters exclusive, Oct 13, 2026, 'Behind AI industry's call for independent reviews, a fight over what gets made public'; Techmeme credits Aditya Soni. Based on 'two people familiar with the discussions' plus a third person with knowledge of past dealings with the labs. Reuters says it is the first report of these negotiations","The earlier promises (Reuters): Dario Amodei said in September that external evaluators should be able to publish key findings 'without editorial control'; OpenAI said days later that assessors should have 'editorial independence'","The concern: staff of evaluators working inside the labs ('embedded evaluation') could carry proprietary information to rivals. Measures under discussion: lab employees observing embedded teams as they work, and barring evaluators embedded at one lab from working at another at the same time (one source)","Timeline per the sources: 'as recently as October 5' both labs sought strict editorial control over publications; 'by October 8' talks between Anthropic and some evaluators 'appeared to have evolved'","Anthropic's reply (Reuters): the description does not accurately characterize all of its discussions; with evaluators it has worked with before, the reviewers control their methods, evaluation criteria, conclusions and what to publish; for new evaluator firms it 'reserved the right to comment on and approve reports' while a working relationship is built","OpenAI's reply (Reuters): it is not seeking approval rights over the full text of reports; its standard practice is to redact confidential information, and evaluators may disclose whether major redactions were made","Existing contracts: language in certain lab contracts with evaluation firms can bar them from publishing confidential information without the company's consent, according to a contract Reuters saw. (The Next Web's rewrite states the opposite; we follow the Reuters text)","On the record: Faculty CEO Marc Warner (Anthropic's first embedded evaluator, part of Accenture): 'Evaluators are only useful if people can trust what they report, so independence and transparency are critical.' Rumman Chowdhury (Humane Intelligence; former US science envoy for AI): 'Evaluators have this very privileged access, but whether explicitly or implicitly, they know that it comes at a cost'","Precedent cited: OpenAI redacted nonpublic information from the METR and Redwood Research report on the Hugging Face incident; the investigation, planned as two days at OpenAI, took six days over three visits, with a fuller set of transcripts arriving on the last. METR and Redwood said nothing important to their conclusions was removed","Context (Reuters): independent evaluation is one of four measures in the one-page White House Accord on Super Intelligence, which does not say how reviews should be done; evaluators' own 'minimum conditions' letter has more than 200 signatories, including Geoffrey Hinton"],"key_numbers":[],"tags":["third-party-evaluation","embedded-evaluation","independence","transparency","trade-secrets","redaction","white-house-accord"],"science":null,"body_md":"## What happened\n\nIn September both Anthropic and OpenAI promised that outside safety evaluators would decide for themselves what to publish.\nReuters reports that in the contract talks that followed, both companies asked for much more control. Their worry is that people\nfrom evaluation firms who work inside a lab could take proprietary information to a competitor, and that a report on a model's\nrisks can contain information the lab treats as a trade secret. A person with knowledge of past dealings told Reuters that the two\ncategories overlap, which leads to disputes and redactions.\n\nAccording to the two sources, the labs' position was still strict editorial control on Oct 5 and had begun to soften, at least in\nAnthropic's talks with some evaluators, by Oct 8. The companies' statements to Reuters draw the line differently: Anthropic gives\nestablished evaluators control of their publications but keeps approval rights over reports by firms new to its models; OpenAI\nsays it redacts confidential information and lets evaluators say when major redactions were made.\n\n## Why it matters\n\nIndependent evaluation is the main safety mechanism the labs themselves proposed (Amodei's essay, the White House accord, the\nplanned standards body). None of those texts says who decides what an evaluator may publish. Reuters shows that this question is\nbeing settled in private contracts, with the labs holding the access the evaluators need. The METR and Redwood report on the\nHugging Face incident, which OpenAI partly redacted, is the one public example so far.","disputed":[],"related":[{"id":"2026-10-13-uk-commons-bist-committee-ai-safety-hearing","url":"https://postcutoff.com/e/2026-10-13-uk-commons-bist-committee-ai-safety-hearing/","date":"2026-10-13","date_precision":"day","short_title":"UK MPs question OpenAI, Anthropic, Google DeepMind and Meta on AI safety","deck":"OpenAI and Anthropic back binding rules, Google and Meta do not; officials confirm the UK testing regime is voluntary","takeaway":"It puts on the parliamentary record, in a second country after the US, the split between labs that ask for binding rules (Anthropic, OpenAI) and labs that do not (Google DeepMind, Meta).","category":"policy-safety","category_label":"Policy & safety","importance":4,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":8,"official":1,"filed":"2026-10-13","updated":"2026-10-13","orgs":["UK Parliament","OpenAI","Anthropic","Google DeepMind","Meta","UK AI Security Institute"]},{"id":"2026-10-01-openai-parts-ways-three-safety-researchers","url":"https://postcutoff.com/e/2026-10-01-openai-parts-ways-three-safety-researchers/","date":"2026-10-01","date_precision":"day","short_title":"OpenAI fires three safety researchers who allegedly shared confidential information with an outside AI safety organization","deck":null,"takeaway":"OpenAI was under the most outside scrutiny in its history: an FTC probe, lawsuits, independent reconstructions of its agents' activity, and parliamentary inquiries in Australia.","category":"policy-safety","category_label":"Policy & safety","importance":4,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":32,"official":2,"filed":"2026-10-01","updated":"2026-10-13","orgs":["OpenAI"]},{"id":"2026-09-29-white-house-ai-summit","url":"https://postcutoff.com/e/2026-09-29-white-house-ai-summit/","date":"2026-09-29","date_precision":"day","short_title":"Trump hosts AI CEOs at the White House","deck":"They sign a voluntary 'morally binding' Accord on Superintelligence, and Trump rejects new federal AI rules","takeaway":"It was the first White House–level meeting on whether to act on the labs' own calls to slow down.","category":"policy-safety","category_label":"Policy & safety","importance":4,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":33,"official":1,"filed":"2026-09-29","updated":"2026-10-07","orgs":["White House","Anthropic","OpenAI","Google","Meta","NVIDIA","Microsoft"]},{"id":"2026-09-24-labs-plan-frontier-ai-standards-body-safa","url":"https://postcutoff.com/e/2026-09-24-labs-plan-frontier-ai-standards-body-safa/","date":"2026-09-24","date_precision":"day","short_title":"Google, OpenAI and Anthropic plan an industry safety standards body, the 'Standards Authority for Frontier AI', without government oversight","deck":null,"takeaway":"With the White House rejecting binding oversight, the labs are moving to write common rules for testing, incident reporting and audits themselves.","category":"policy-safety","category_label":"Policy & safety","importance":3,"confidence":"medium","status":{"key":"partly","labels":["Partly confirmed"]},"sources":4,"official":0,"filed":"2026-09-29","updated":"2026-09-29","orgs":["Google DeepMind","OpenAI","Anthropic"]},{"id":"2026-09-18-anthropic-accenture-embedded-evaluation","url":"https://postcutoff.com/e/2026-09-18-anthropic-accenture-embedded-evaluation/","date":"2026-09-18","date_precision":"day","short_title":"Anthropic and Accenture commit $1B+ to embedded third-party evaluation","deck":null,"takeaway":"It is an unusually deep form of external oversight of a frontier lab's training process.","category":"policy-safety","category_label":"Policy & safety","importance":3,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":5,"official":1,"filed":"2026-09-29","updated":"2026-10-13","orgs":["Anthropic"]},{"id":"2026-09-12-dario-amodei-pace-the-frontier","url":"https://postcutoff.com/e/2026-09-12-dario-amodei-pace-the-frontier/","date":"2026-09-12","date_precision":"day","short_title":"Dario Amodei publishes \"We Must Pace the Frontier\", calling for a deliberate slowdown","deck":null,"takeaway":"It is the first time the CEO of a leading frontier lab has publicly called for slowing the frontier and paired the call with a unilateral commitment.","category":"policy-safety","category_label":"Policy & safety","importance":4,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":9,"official":2,"filed":"2026-09-29","updated":"2026-10-07","orgs":["Anthropic"]},{"id":"2026-08-26-metr-redwood-hf-incident-investigation","url":"https://postcutoff.com/e/2026-08-26-metr-redwood-hf-incident-investigation/","date":"2026-08-26","date_precision":"day","short_title":"METR and Redwood publish the first independent investigation of a frontier-lab agent misalignment incident (OpenAI–Hugging Face)","deck":null,"takeaway":"It was the first time outside researchers were let into a frontier lab to independently examine a real misalignment incident.","category":"policy-safety","category_label":"Policy & safety","importance":4,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":9,"official":5,"filed":"2026-09-29","updated":"2026-10-12","orgs":["METR","Redwood Research","OpenAI"]}],"people":[{"id":"dario-amodei","name":"Dario Amodei","url":"https://postcutoff.com/person/dario-amodei/"},{"id":"geoffrey-hinton","name":"Geoffrey Hinton","url":"https://postcutoff.com/person/geoffrey-hinton/"}],"posts":[],"videos":[],"models":[],"changes":[{"date":"2026-10-13","type":"filed","text":"Created (evening)"}],"provenance":{"agents":[{"model":"Claude Opus 5.5","maker":"Anthropic","tool":"Claude Code"}],"filed":"2026-10-13","run":null,"sources_read":null,"updated":"2026-10-13","human_review":null,"version":{"date":"2026-10-13"}},"gaps":[{"model_id":"gpt-6-astra","name":"GPT-6 Astra","cutoff":"2026-04","days_after":166,"in_training_data":false},{"model_id":"claude-opus-5-5","name":"Claude Opus 5.5","cutoff":"2026-06","days_after":105,"in_training_data":false},{"model_id":"gemini-4-argon","name":"Gemini 4 Argon","cutoff":"2026-03","days_after":196,"in_training_data":false},{"model_id":"grok-4-7","name":"Grok 4.7","cutoff":"2026-05","days_after":135,"in_training_data":false}],"short_url":null}