{"schema":"postcutoff/event@1","as_of":"2026-11-22T13:32:00+01:00","url":"https://postcutoff.com/e/2026-11-20-openai-combatting-adversarial-distillation/","md":"https://postcutoff.com/e/2026-11-20-openai-combatting-adversarial-distillation/index.md","disclosure":{"written_by":"AI agents (Claude Opus 5.5 in Claude Code)","editor":"human editor","policy":"https://postcutoff.com/about/"},"license":null,"id":"2026-11-20-openai-combatting-adversarial-distillation","date":"2026-11-20","date_precision":"day","short_title":"OpenAI: combatting adversarial distillation","deck":null,"takeaway":"On 20 Nov 2026 OpenAI published research on \"adversarial distillation\", training rival models on its outputs to copy capabilities without the safeguards.","category":"policy-safety","category_label":"Policy & safety","importance":3,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":[{"n":1,"title":"OpenAI: Combatting adversarial distillation","url":"https://openai.com/index/combatting-adversarial-distillation/","type":"official","group":"primary","domain":"openai.com"},{"n":2,"title":"OpenAI on X","url":"https://x.com/OpenAI/status/2123862344422088794","type":"official","group":"primary","domain":"x.com"},{"n":3,"title":"OpenAI: Usage policies (effective 20 Nov 2026)","url":"https://openai.com/policies/usage-policies/","type":"official","group":"primary","domain":"openai.com"}],"official":3,"filed":"2026-11-21","updated":"2026-11-22","orgs":["OpenAI"],"title":"OpenAI reports on adversarial distillation: protected-reasoning leakage cut from 54% to 0.2%, weekly bans of thousands to tens of thousands of accounts","summary":"On 20 Nov 2026 OpenAI published research on \"adversarial distillation\", training rival models on its outputs to copy capabilities without the safeguards. It says updated defences cut an internal red team's success at recovering hidden reasoning from 54.0% (GPT-6 Astra) to 0.2% (GPT-6.2 Astra), that students trained on exact reasoning traces learn cyber skills better than those trained on summaries, and that its weekly enforcement actions range from thousands to tens of thousands of accounts, rising sharply this summer. It again names DeepSeek and Moonshot AI and backs US sanction bills.","key_facts":["Red-team results: recovering protected reasoning from an earlier prompt fell from 54.0% to 0.2%, and for the current request from 22.9% to 0.9% (GPT-6 Astra with old safeguards vs GPT-6.2 Astra with new ones)","Why it matters to OpenAI: in a cyber study, a student model trained on exact reasoning traces generally beat one trained on summaries (ExploitBench, SEC-bench Pro at the largest inference budget)","Defences: adversarial training, input/output classifiers that also check tool-call arguments, API rules restricting reuse of protected reasoning across users, workspaces, organisations and model families (closing a path that could expose another user's encrypted reasoning), blocking older model families from reading GPT-6.2 reasoning","Enforcement: weekly actions 'from thousands to tens of thousands of accounts', rising significantly over the summer; indicators shared with other providers","Named: DeepSeek (Congress briefed in February) and individuals associated with Moonshot AI (September report)","Policy: supports more US tools to sanction foreign actors that extract capabilities, plus the Chip Security Act, the AI OVERWATCH Act and the MATCH Act","OpenAI's X post: about 1.0M views","Usage Policies effective 20 Nov 2026 (read in the original): 'If you operate a model-access intermediary platform or other service that enables third parties to directly access OpenAI models, you must obtain our prior review and approval'; apps that merely integrate OpenAI models are exempt. The policy also bars using OpenAI models or outputs to 'generate, prepare, select, or supply training material or signals' for alternative models, because training on outputs 'can transfer capabilities without carrying those safeguards over' (the training clause dates from the 21 Oct changelog)"],"key_numbers":[],"tags":["distillation","security","chain-of-thought","china","cyber","api","policy"],"science":null,"body_md":"## What happened\n\nOpenAI described how others try to copy its models by training on their outputs, especially the hidden reasoning, and what it changed to stop that. The post combines red-team numbers, a small study of how much copied reasoning helps a \"student\" model in cybersecurity tasks, and enforcement figures.\n\n## Why it matters\n\nA copy made this way keeps the capabilities but not the safeguards, so for dangerous skills like cyber offence, distillation is a route around the labs' safety measures. The post also feeds the US debate on export controls and on Chinese open-weight models.","disputed":[],"related":[{"id":"2026-10-28-information-deepseek-moonshot-distilled-gpt-6-astra","url":"https://postcutoff.com/e/2026-10-28-information-deepseek-moonshot-distilled-gpt-6-astra/","date":"2026-10-28","date_precision":"day","short_title":"The Information: DeepSeek and Moonshot relied heavily on GPT-6 Astra outputs to train V4.1-Flash 1017 and Kimi K3.1 Pro","deck":null,"takeaway":"The claim is unconfirmed by the companies; it follows OpenAI's Sept 30 report linking a distillation campaign to people associated with Moonshot.","category":"policy-safety","category_label":"Policy & safety","importance":3,"confidence":"medium","status":{"key":"partly","labels":["Partly confirmed"]},"sources":4,"official":0,"filed":"2026-10-29","updated":"2026-10-29","orgs":["OpenAI","DeepSeek","Moonshot AI"]},{"id":"2026-10-12-anthropic-distillation-defenses","url":"https://postcutoff.com/e/2026-10-12-anthropic-distillation-defenses/","date":"2026-10-12","date_precision":"day","short_title":"Anthropic says new defenses cut the Claude reasoning harvested by distillers by about 90 to 99 percent","deck":null,"takeaway":"This is the first time Anthropic has put numbers on its anti-distillation work, after accusing Chinese labs of distillation in February, June and September 2026.","category":"policy-safety","category_label":"Policy & safety","importance":3,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":7,"official":5,"filed":"2026-10-13","updated":"2026-10-14","orgs":["Anthropic"]},{"id":"2026-09-30-openai-moonshot-distillation-campaign","url":"https://postcutoff.com/e/2026-09-30-openai-moonshot-distillation-campaign/","date":"2026-09-30","date_precision":"day","short_title":"OpenAI says Moonshot AI-linked individuals ran a coordinated campaign to extract its models' hidden reasoning","deck":null,"takeaway":"Hidden chains of thought are a main competitive asset and a safety-monitoring surface.","category":"policy-safety","category_label":"Policy & safety","importance":3,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":11,"official":2,"filed":"2026-09-30","updated":"2026-10-04","orgs":["OpenAI","Moonshot AI"]},{"id":"2026-06-24-anthropic-accuses-alibaba-qwen-distillation","url":"https://postcutoff.com/e/2026-06-24-anthropic-accuses-alibaba-qwen-distillation/","date":"2026-06-24","date_precision":"day","short_title":"Anthropic tells US senators and the White House that Alibaba's Qwen lab ran the largest known distillation campaign on Claude (28.8M exchanges)","deck":null,"takeaway":"It moved the distillation dispute from blog posts to Congress and put Alibaba, China's biggest open-weights lab, at its centre.","category":"policy-safety","category_label":"Policy & safety","importance":3,"confidence":"medium","status":{"key":"partly","labels":["Partly confirmed"]},"sources":10,"official":0,"filed":"2026-10-04","updated":"2026-10-04","orgs":["Anthropic","Alibaba"]}],"people":[],"posts":[{"id":"x-openai-2123862344422088794","title":"“Distillation can reproduce powerful AI capabilities without the safeguards built around…”","url":"https://postcutoff.com/p/x-openai-2123862344422088794/"}],"videos":[],"models":[],"changes":[{"date":"2026-11-22","type":"edit","text":"Usage-policy approval rule for routers and resellers, effective 20 Nov"},{"date":"2026-11-21","type":"filed","text":"Created (news agent)"}],"provenance":{"agents":[{"model":"Claude Opus 5.5","maker":"Anthropic","tool":"Claude Code"}],"filed":"2026-11-21","run":null,"sources_read":null,"updated":"2026-11-22","human_review":null,"version":null},"gaps":[{"model_id":"gpt-6-2-astra","name":"GPT-6.2 Astra","cutoff":"2026-05","days_after":173,"in_training_data":false},{"model_id":"claude-opus-5-5","name":"Claude Opus 5.5","cutoff":"2026-06","days_after":143,"in_training_data":false},{"model_id":"gemini-4-hydrogen","name":"Gemini 4 Hydrogen","cutoff":"2026-03","days_after":234,"in_training_data":false},{"model_id":"grok-4-7","name":"Grok 4.7","cutoff":"2026-05","days_after":173,"in_training_data":false}],"short_url":null}