{"schema":"postcutoff/event@1","as_of":"2026-11-22T13:32:00+01:00","url":"https://postcutoff.com/e/2026-07-08-anthropic-ae-studio-modular-pretraining-gram/","md":"https://postcutoff.com/e/2026-07-08-anthropic-ae-studio-modular-pretraining-gram/index.md","disclosure":{"written_by":"AI agents (Claude Opus 5.5 in Claude Code)","editor":"human editor","policy":"https://postcutoff.com/about/"},"license":null,"id":"2026-07-08-anthropic-ae-studio-modular-pretraining-gram","date":"2026-07-08","date_precision":"day","short_title":"Modular pretraining lets dangerous capabilities be switched off per module","deck":null,"takeaway":"On July 8, 2026 researchers from AE Studio and Anthropic published \"Modular Pretraining Enables Access Control\".","category":"research","category_label":"Research","importance":2,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":[{"n":1,"title":"Anthropic Alignment Science blog: Modular Pretraining Enables Access Control","url":"https://alignment.anthropic.com/2026/modular-pretraining/","type":"paper","group":"primary","domain":"alignment.anthropic.com"}],"official":1,"filed":"2026-10-01","updated":"2026-10-01","orgs":["Anthropic","AE Studio"],"title":"Modular pretraining (GRAM) lets dangerous capabilities be switched off per module (AE Studio and Anthropic)","summary":"On July 8, 2026 researchers from AE Studio and Anthropic published \"Modular Pretraining Enables Access Control\". It introduces Gradient Routed Auxiliary Modules (GRAM), which route dual-use knowledge such as virology, cybersecurity and nuclear physics into separate modules during pretraining. The modules can be switched on or off, so one training run matches several data-filtered models.","key_facts":["800M-parameter model with four dual-use domains: GRAM and LoRA matched data filtering at capability removal and beat it on retained domains","Capability removal improved with scale across 50M–5B parameters","Four modules give 16 configurations from one training run, vs one run per configuration for data filtering","With only 50% of data labelled, GRAM isolated capabilities better than filtering or LoRA","Authors include Cem Anil and Alex Cloud (Anthropic) and Judd Rosenblatt (AE Studio)"],"key_numbers":[],"tags":["alignment","pretraining","unlearning","access-control","gradient-routing","biosecurity"],"science":null,"body_md":"## What happened\n\nAn extension of gradient routing. Dangerous knowledge is placed in removable modules during pretraining instead of being filtered out of the data.\n\n## Why it matters\n\nIt points to tiered access, where vetted users get a model with, say, the virology module and the public does not, without\ntraining separate models. This bears on how labs might ship open or differentiated weights safely.","disputed":[],"related":[],"people":[],"posts":[],"videos":[],"models":[],"changes":[{"date":"2026-10-01","type":"filed","text":"Created"}],"provenance":{"agents":[{"model":"Claude Opus 5.5","maker":"Anthropic","tool":"Claude Code"}],"filed":"2026-10-01","run":null,"sources_read":null,"updated":"2026-10-01","human_review":null,"version":{"date":"2026-10-04"}},"gaps":[{"model_id":"gpt-6-2-astra","name":"GPT-6.2 Astra","cutoff":"2026-05","days_after":38,"in_training_data":false},{"model_id":"claude-opus-5-5","name":"Claude Opus 5.5","cutoff":"2026-06","days_after":8,"in_training_data":false},{"model_id":"gemini-4-hydrogen","name":"Gemini 4 Hydrogen","cutoff":"2026-03","days_after":99,"in_training_data":false},{"model_id":"grok-4-7","name":"Grok 4.7","cutoff":"2026-05","days_after":38,"in_training_data":false}],"short_url":null}