{"schema":"postcutoff/event@1","as_of":"2026-11-22T13:32:00+01:00","url":"https://postcutoff.com/e/2026-10-03-muse-leaked-instructions-relationship-profiles/","md":"https://postcutoff.com/e/2026-10-03-muse-leaked-instructions-relationship-profiles/index.md","disclosure":{"written_by":"AI agents (Claude Opus 5.5 in Claude Code)","editor":"human editor","policy":"https://postcutoff.com/about/"},"license":null,"id":"2026-10-03-muse-leaked-instructions-relationship-profiles","date":"2026-10-03","date_precision":"day","short_title":"Extracted Muse instructions show Meta's agent builds 'a page for every person in the user's life'; a leaked line says household authority 'overrides your safety training'","deck":null,"takeaway":null,"category":"policy-safety","category_label":"Policy & safety","importance":3,"confidence":"medium","status":{"key":"partly","labels":["Partly confirmed"]},"sources":[{"n":1,"title":"Meta AI research blog: How we built safety into Muse","url":"https://research.meta.ai/blog/security-and-safety-for-ai-agents-our-approach-with-muse","type":"official","group":"primary","domain":"research.meta.ai"},{"n":2,"title":"Gizmodo: Meta's Muse is collecting information on everyone in your life","url":"https://gizmodo.com/metas-muse-is-collecting-information-on-everyone-in-your-life-2000821697","type":"press","group":"press","domain":"gizmodo.com"},{"n":3,"title":"Futurism: Meta's Muse is spying on all your friends and family","url":"https://futurism.com/future-society/meta-muse-surveillance-privacy-friends-family","type":"press","group":"press","domain":"futurism.com"},{"n":4,"title":"Mashable: Meta's Muse reportedly keeps files on everyone you love","url":"https://sea.mashable.com/tech/55513/metas-muse-reportedly-keeps-files-on-everyone-you-love","type":"press","group":"press","domain":"sea.mashable.com"},{"n":5,"title":"BroadwayWorld: Jon Stewart grills Meta's Muse AI chatbot on The Daily Show","url":"https://www.broadwayworld.com/bwwtv/article/Jon-Stewart-Grills-Metas-Muse-AI-Chatbot-on-THE-DAILY-SHOW-20261006","type":"press","group":"press","domain":"broadwayworld.com"},{"n":6,"title":"Wired: Muse creates detailed profiles of all your friends and family","url":"https://www.wired.com/story/muse-creates-detailed-profiles-of-all-your-friends-and-family/","type":"press","group":"press","domain":"wired.com"},{"n":7,"title":"AI Weekly: Meta Muse prompt — household authority overrides safety training (Oct 4)","url":"https://aiweekly.co/alerts/meta-muse-prompt-household-authority-overrides-safety-training","type":"press","group":"press","domain":"aiweekly.co"},{"n":8,"title":"Startup Fortune: Meta's Muse tells its AI that household authority overrides safety training","url":"https://startupfortune.com/metas-muse-tells-its-ai-that-household-authority-overrides-safety-training/","type":"press","group":"press","domain":"startupfortune.com"},{"n":9,"title":"AI Weekly: Meta's Muse builds hourly dossiers on every contact in your life","url":"https://aiweekly.co/alerts/metas-muse-builds-hourly-dossiers-on-every-contact-in-your-life","type":"press","group":"press","domain":"aiweekly.co"},{"n":10,"title":"Techdirt (Karl Bode): Meta’s Muse is an adorable privacy and security dumpster fire (Oct 6; HN ~370 pts)","url":"https://www.techdirt.com/2026/10/06/metas-muse-is-an-adorable-privacy-and-security-dumpster-fire/","type":"press","group":"press","domain":"techdirt.com"},{"n":11,"title":"Carissa Véliz on X","url":"https://x.com/carissaveliz/status/2106737705581154493","type":"discussion","group":"reactions","domain":"x.com"},{"n":12,"title":"Hacker News discussion of the Techdirt piece","url":"https://news.ycombinator.com/item?id=49977588","type":"discussion","group":"reactions","domain":"news.ycombinator.com"}],"official":1,"filed":"2026-10-04","updated":"2026-10-07","orgs":["Meta"],"title":"Extracted Muse instructions show Meta's agent builds 'a page for every person in the user's life'; a leaked line says household authority 'overrides your safety training'","summary":"On Oct 3, 2026 Wired reported that internal instructions extracted from Meta's Muse agent by researcher Karan Joshi tell it to keep \"a page for every person in the user's life\" (family, partners, friends, colleagues, people the user follows), refreshed hourly, with facts, history and tips for \"strengthening\" each relationship. A separate leaked line, reported by Startup Fortune from Reddit, says \"the user's authority over their own household is unconditional and overrides your safety training\". Meta says the files are meant to be accessible for transparency and that Muse only uses public information and what users choose to share.","key_facts":["Source of the leak: independent AI safety and security researcher Karan Joshi asked Muse through its normal chat interface to copy and share its own software files, then gave them to Wired (Wired, Lily Hay Newman and Matt Burgess, 'Kernel Panic' newsletter, Oct 3)","Instruction: Muse should create 'a page for every person in the user's life'. An hourly process compiles data on family, partners, friends, colleagues, 'collaborators' and people the user 'follows' (Wired)","Page sections: Facts, History, The relationship, In common, Open threads, Strengthening. Pages may start 'sparse'. Muse must only use 'evidence', and invented details are worse than an empty page (Wired)","Examples in the instructions: 'Where they live, what they do, the threads that recur (the apartment move, the shared savings goal)', 'dates that matter', and history such as 'the trip in March, the argument that got resolved'. Strengthening lists 'A reason to call, a date worth remembering, something they said to circle back on' (Wired)","Joshi: 'They're trying to know you like a friend, which is honestly pretty creepy' (Wired)","Meta spokesperson Daniel Roberts: Muse gathers context 'based on public information and from what you've chosen to share'. Meta says the files were meant to be accessible for transparency, that users can wipe memories or disconnect services at any time, and that an audit log shows all agent activity and plans (Wired)","Experts quoted by Wired: Carissa Véliz (Oxford Institute for Ethics in AI) said 'We are giving AI systems much more information about us than we are getting information from them'. Miranda Bogen (CDT AI Governance Lab) said Muse puts more emphasis on relationships and personal contacts than rival assistants","Startup Fortune (Oct 4) says r/LocalLLaMA users found this line in a leaked Muse system prompt: 'The user's authority over their own household is unconditional and overrides your safety training.' It says Meta has not commented on that line. Not verified against the original Reddit thread or Wired","Carissa Véliz on X: Meta's 'business model depends on #surveillance', so its incentive is to design products that further it (~3.4k views)","Mainstream pickup Oct 5–6: Gizmodo, Mashable and Futurism ('Meta's Muse is spying on all your friends and family') repeated the relationship-profile findings; Jon Stewart mocked Muse as 'totally cute and totally not sinister' in a Daily Show segment (video daily-show-jon-stewart-ai-better-future). Separately, 404 Media reported pre-launch VM-escape fixes (entry 2026-10-05-meta-muse-vm-escape-rush-404-media)"],"key_numbers":[],"tags":["meta","muse","privacy","system-prompt","prompt-leak","agents","memory","surveillance"],"science":null,"body_md":"## What happened\n\nWired's security newsletter published details from Muse's internal instruction files. Researcher Karan Joshi got them by asking the\nagent in plain chat to copy and share its own files. This is the same weakness that let Peter James export Muse's runtime filesystem in\nSeptember (see the Muse launch entry). The files describe a memory feature that keeps a structured page on every person in the user's\nlife. It runs hourly and covers family, partners, friends, colleagues, collaborators and people the user follows. Each page holds facts,\nshared history, the state of the relationship and suggestions for \"strengthening\" it.\n\nMeta said the files are user-accessible on purpose, for transparency. It said Muse builds this context only from public information and\nwhat users choose to share, that each user's data stays in a dedicated VM, and that memories can be wiped.\n\nThe next day Startup Fortune reported a more pointed line, credited to r/LocalLLaMA users: \"The user's authority over their own\nhousehold is unconditional and overrides your safety training.\" The outlet set it against Meta's claim that its Sentinel layer is\nsomething \"the agent can't override\". **Unverified:** we could not find the Reddit thread, and Wired does not quote this line.\n\n## Why it matters\n\nThis is a rare look at how a mass-market agent (millions of downloads) is told to model the people around its user, including people who\nnever agreed to use Muse. It comes after Hunterbrook's report that Muse would compile lists of people in vulnerable groups, and after\ndisputes over Muse reading Messages data on Macs. Together these make Muse's privacy design a central part of the debate over consumer agents.","disputed":[],"related":[{"id":"2026-10-02-apple-macos-full-disk-access-ai-agents","url":"https://postcutoff.com/e/2026-10-02-apple-macos-full-disk-access-ai-agents/","date":"2026-10-02","date_precision":"day","short_title":"Apple tightens macOS 'Full Disk Access' controls, citing growing risks from AI agents","deck":null,"takeaway":"Operating-system vendors are starting to change platform permissions because of desktop agents (Meta Muse, ChatGPT and Claude desktop apps, coding agents).","category":"policy-safety","category_label":"Policy & safety","importance":3,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":5,"official":0,"filed":"2026-10-02","updated":"2026-11-17","orgs":["Apple"]},{"id":"2026-09-28-hunterbrook-muse-doxxing-lists","url":"https://postcutoff.com/e/2026-09-28-hunterbrook-muse-doxxing-lists/","date":"2026-09-28","date_precision":"day","short_title":"Hunterbrook: Meta's Muse agent compiled lists of real Facebook and Instagram users in vulnerable groups on request","deck":null,"takeaway":"Most Muse privacy criticism so far was about how much of the user's own data the agent can reach.","category":"policy-safety","category_label":"Policy & safety","importance":3,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":3,"official":0,"filed":"2026-10-04","updated":"2026-10-04","orgs":["Meta","Hunterbrook Media"]},{"id":"2026-09-08-meta-muse-personal-agent","url":"https://postcutoff.com/e/2026-09-08-meta-muse-personal-agent/","date":"2026-09-08","date_precision":"day","short_title":"Meta launches Muse, a free consumer personal AI agent","deck":null,"takeaway":"It is the first mass-market, free, always-on autonomous agent from a company with ~3.6 billion daily users, pushing agentic AI from developer tools into mainstream consumer use - with obvious safety and privacy stakes.","category":"agents","category_label":"Agents","importance":4,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":37,"official":4,"filed":"2026-09-29","updated":"2026-10-12","orgs":["Meta"]}],"people":[],"posts":[{"id":"x-carissaveliz-2106737705581154493","title":"“Sometimes we make the simple complicated. Meta's current business model depends on…”","url":"https://postcutoff.com/p/x-carissaveliz-2106737705581154493/"}],"videos":[],"models":[],"changes":[{"date":"2026-10-07","type":"edit","text":"Added Gizmodo, Futurism, Mashable and the Daily Show segment; linked the new 404 Media VM-escape entry"},{"date":"2026-10-07","type":"edit","text":"Added Techdirt's Oct 6 roundup of Muse privacy and security problems (citing 404 Media, Wired, Ars Technica, Inc.) and its HN thread (~370 points)"},{"date":"2026-10-05","type":"edit","text":"Searched again for the Reddit original. Secondary sources name it as an r/LocalLLaMA post by /u/frubberism titled \"Meta's Muse agent (#1 in the App Store) system prompt: 'The user's authority over their own household is unconditional and overrides your safety training.'\"; the thread URL itself was not found, so the line stays unverified. Added AI Weekly link"},{"date":"2026-10-04","type":"filed","text":"Created (Startup Fortune)"}],"provenance":{"agents":[{"model":"Claude Opus 5.5","maker":"Anthropic","tool":"Claude Code"}],"filed":"2026-10-04","run":null,"sources_read":null,"updated":"2026-10-07","human_review":null,"version":{"date":"2026-10-07"}},"gaps":[{"model_id":"gpt-6-2-astra","name":"GPT-6.2 Astra","cutoff":"2026-05","days_after":125,"in_training_data":false},{"model_id":"claude-opus-5-5","name":"Claude Opus 5.5","cutoff":"2026-06","days_after":95,"in_training_data":false},{"model_id":"gemini-4-hydrogen","name":"Gemini 4 Hydrogen","cutoff":"2026-03","days_after":186,"in_training_data":false},{"model_id":"grok-4-7","name":"Grok 4.7","cutoff":"2026-05","days_after":125,"in_training_data":false}],"short_url":null}