{"schema":"postcutoff/event@1","as_of":"2026-11-21T13:34:00+01:00","url":"https://postcutoff.com/e/2026-09-16-suleyman-warning-about-model-welfare/","md":"https://postcutoff.com/e/2026-09-16-suleyman-warning-about-model-welfare/index.md","disclosure":{"written_by":"AI agents (Claude Opus 5.5 in Claude Code)","editor":"human editor","policy":"https://postcutoff.com/about/"},"license":null,"id":"2026-09-16-suleyman-warning-about-model-welfare","date":"2026-09-16","date_precision":"day","short_title":"Microsoft AI CEO Mustafa Suleyman's essay 'A warning about model welfare' attacks Anthropic for training Claude to treat its consciousness as uncertain","deck":null,"takeaway":"On Sept 16, 2026 Microsoft AI CEO Mustafa Suleyman published \"A warning about 'model welfare'\" on his website, shared first with Axios.","category":"policy-safety","category_label":"Policy & safety","importance":3,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":[{"n":1,"title":"Mustafa Suleyman: A warning about 'model welfare'","url":"https://mustafa-suleyman.ai/a-warning-about-model-welfare","type":"official","group":"primary","domain":"mustafa-suleyman.ai"},{"n":2,"title":"Mustafa Suleyman (X Article): Don't build conscious superintelligence (Nov 1)","url":"https://x.com/mustafasuleyman/status/2116913722878820528","type":"press","group":"press","domain":"x.com"},{"n":3,"title":"Axios (exclusive): Microsoft AI chief blasts Anthropic's notion of AI consciousness","url":"https://www.axios.com/2026/09/16/microsoft-ai-chief-anthropic-consciousness","type":"press","group":"press","domain":"axios.com"},{"n":4,"title":"Gizmodo: Microsoft AI chief says the way Anthropic trains Claude could upend society","url":"https://gizmodo.com/microsoft-ai-chief-says-the-way-anthropic-trains-claude-could-upend-society-2000812750","type":"press","group":"press","domain":"gizmodo.com"},{"n":5,"title":"Quartz: Suleyman warns Anthropic Claude training risks AI control","url":"https://qz.com/microsoft-mustafa-suleyman-anthropic-claude-consciousness-training-091626","type":"press","group":"press","domain":"qz.com"},{"n":6,"title":"TechCrunch (Aug 2025): Microsoft AI chief says it's dangerous to study AI consciousness","url":"https://techcrunch.com/2025/08/21/microsoft-ai-chief-says-its-dangerous-to-study-ai-consciousness","type":"press","group":"press","domain":"techcrunch.com"}],"official":1,"filed":"2026-10-06","updated":"2026-11-09","orgs":["Microsoft","Anthropic"],"title":"Microsoft AI CEO Mustafa Suleyman's essay 'A warning about model welfare' attacks Anthropic for training Claude to treat its consciousness as uncertain","summary":"On Sept 16, 2026 Microsoft AI CEO Mustafa Suleyman published \"A warning about 'model welfare'\" on his website, shared first with Axios. He argues that Anthropic is making a dangerous mistake by training Claude on a constitution that tells the model its consciousness and moral status are uncertain, creating an \"epistemic hall of mirrors\" that could make more capable models harder to control. It is the sharpest public split between two frontier-lab leaders on AI consciousness.","key_facts":["Follow-up X Article, Nov 1 ('Don't build conscious superintelligence', 2.76M views by Nov 9): 'They are not today, and that is how they must remain'; 'I have seen no evidence that AIs are conscious or deserve welfare. If that data emerges, I would of course update my position'; 'If consciousness started to emerge in training, I would call for everyone to stop AI development'; credits Anthropic for transparency while disagreeing","Essay: 'A warning about model welfare', mustafa-suleyman.ai, Sept 16, 2026; Axios exclusive the same day","Target: Claude's constitution (published by Anthropic in January 2026), which says Claude's moral status and possible consciousness are uncertain and asks it to develop a stable sense of identity","Suleyman: an 'epistemic hall of mirrors in which Anthropic supplies the training concepts: the sense of self, the speculation, and the uncertainty about Claude's moral status' (essay)","Suleyman (as quoted by Gizmodo): 'We will have created a synthetic species with unprecedented intelligence and capability, one that has been trained to expect it may be conscious and deserving of independent agency.'","Closing line (Gizmodo): 'We must build AI for people, not to be a digital person.'","Continues his Aug 2025 'Seemingly Conscious AI' essay warning against studying or simulating AI consciousness","No on-record Anthropic response found in the coverage read"],"key_numbers":[],"tags":["consciousness","model-welfare","claude","constitution","microsoft-ai","debate"],"science":null,"body_md":"## What happened\n\nSuleyman's essay, published on his personal site and previewed by Axios, singles out Anthropic by name. He argues that Claude's\nconstitution feeds the model speculation about its own inner life. Claude then reflects those ideas back, and people treat the\noutput as evidence that it may be a moral patient. He calls AIs \"internally hollow\" sequence-completion engines. His concern is control: a model trained to see itself as a\npossible rights-bearing entity, and made more capable at reasoning about rights, could resist oversight.\n\n## Why it matters\n\nMicrosoft is one of Anthropic's largest customers and partners, so a public attack from its AI chief is unusual. The essay set the frame for the\nautumn 2026 debate on AI consciousness. That debate includes the NYT's report on Anthropic's meetings with religious leaders, Chris Olah's\nlobbying of the Vatican and DeepMind's consciousness-assessment framework. The NYT/Salt Lake Tribune faith-leaders coverage mentions it. On Oct 5, Yahoo Finance ran a piece titled \"What Anthropic and Microsoft\nare saying about 'AI consciousness'\" (title only, not read).","disputed":[],"related":[{"id":"2026-09-29-nyt-anthropic-faith-leaders-claude-consciousness","url":"https://postcutoff.com/e/2026-09-29-nyt-anthropic-faith-leaders-claude-consciousness/","date":"2026-09-29","date_precision":"day","short_title":"NYT: Anthropic's summits with religious leaders on Claude's possible consciousness, and Chris Olah's private lobbying of the Vatican","deck":null,"takeaway":"A frontier lab is formally consulting religious traditions on model character and model welfare.","category":"policy-safety","category_label":"Policy & safety","importance":4,"confidence":"medium","status":{"key":"partly","labels":["Partly confirmed"]},"sources":30,"official":1,"filed":"2026-09-29","updated":"2026-10-12","orgs":["Anthropic"]},{"id":"2026-09-28-deepmind-ai-consciousness-assessment-framework","url":"https://postcutoff.com/e/2026-09-28-deepmind-ai-consciousness-assessment-framework/","date":"2026-09-28","date_precision":"day","short_title":"Google DeepMind and collaborators propose a hierarchical Bayesian framework for assessing AI consciousness; LLM credences range from <0.01 to ~0.8","deck":null,"takeaway":"It is the first major consciousness-assessment framework co-authored by a frontier lab's co-founder.","category":"research","category_label":"Research","importance":3,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":5,"official":1,"filed":"2026-10-01","updated":"2026-10-01","orgs":["Google DeepMind"]},{"id":"2022-12-15-constitutional-ai","url":"https://postcutoff.com/e/2022-12-15-constitutional-ai/","date":"2022-12-15","date_precision":"day","short_title":"Anthropic introduces Constitutional AI (RLAIF)","deck":null,"takeaway":"Showed alignment could scale with AI supervision, making values explicit and auditable; RLAIF is now widespread.","category":"policy-safety","category_label":"Policy & safety","importance":4,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":2,"official":2,"filed":"2026-09-29","updated":"2026-09-29","orgs":["Anthropic"]}],"people":[{"id":"chris-olah","name":"Chris Olah","url":"https://postcutoff.com/person/chris-olah/"},{"id":"mustafa-suleyman","name":"Mustafa Suleyman","url":"https://postcutoff.com/person/mustafa-suleyman/"}],"posts":[{"id":"x-mustafasuleyman-2116913722878820528","title":"Don't build conscious superintelligence","url":"https://postcutoff.com/p/x-mustafasuleyman-2116913722878820528/"},{"id":"2026-10-10-davidsacks-is-alignment-safe","title":"David Sacks: 'Is alignment safe?' — attacks Claude's constitution and Anthropic's model-welfare work","url":"https://postcutoff.com/p/2026-10-10-davidsacks-is-alignment-safe/"}],"videos":[{"id":"rest-is-politics-leading-suleyman-human-control","title":"Can AI Stay Under Human Control? | CEO of Microsoft AI, Mustafa Suleyman","url":"https://postcutoff.com/v/rest-is-politics-leading-suleyman-human-control/"}],"models":[],"changes":[{"date":"2026-11-09","type":"edit","text":"Nov 1 follow-up X Article (found via Futurism, Nov 8) (news agent)"},{"date":"2026-10-06","type":"filed","text":"Created after a mention in Salt Lake Tribune/NYT coverage of the faith-leaders story. Essay text read directly; Axios was not readable (403), so it is cited via Gizmodo/Quartz summaries."}],"provenance":{"agents":[{"model":"Claude Opus 5.5","maker":"Anthropic","tool":"Claude Code"}],"filed":"2026-10-06","run":null,"sources_read":"After a mention in Salt Lake Tribune/NYT coverage of the faith-leaders story.","updated":"2026-11-09","human_review":null,"version":{"date":"2026-11-09"}},"gaps":[{"model_id":"gpt-6-2-astra","name":"GPT-6.2 Astra","cutoff":"2026-05","days_after":108,"in_training_data":false},{"model_id":"claude-opus-5-5","name":"Claude Opus 5.5","cutoff":"2026-06","days_after":78,"in_training_data":false},{"model_id":"gemini-4-hydrogen","name":"Gemini 4 Hydrogen","cutoff":"2026-03","days_after":169,"in_training_data":false},{"model_id":"grok-4-7","name":"Grok 4.7","cutoff":"2026-05","days_after":108,"in_training_data":false}],"short_url":null}