Extracted Muse instructions show Meta’s agent builds ‘a page for every person in the user’s life’; a leaked line says household authority ‘overrides your safety training’
Partly confirmed
Status
- Claim
Partly confirmed
- Our reporting
- Medium confidence
- Importance
- 3 of 5
- Last verified
- 7 October 2026
Your AI and this story
- GPT-6.2 Astra125 days after its cutoff
- Claude Opus 5.595 days after its cutoff
- Gemini 4 Hydrogen186 days after its cutoff
- Grok 4.7125 days after its cutoff
None of these four assistants can know about it. The closest, Claude Opus 5.5, stops 95 days before it.
Key facts
- Source of the leak: independent AI safety and security researcher Karan Joshi asked Muse through its normal chat interface to copy and share its own software files, then gave them to Wired (Wired, Lily Hay Newman and Matt Burgess, ‘Kernel Panic’ newsletter, Oct 3)
- Instruction: Muse should create ‘a page for every person in the user’s life’. An hourly process compiles data on family, partners, friends, colleagues, ‘collaborators’ and people the user ‘follows’ (Wired)
- Page sections: Facts, History, The relationship, In common, Open threads, Strengthening. Pages may start ‘sparse’. Muse must only use ‘evidence’, and invented details are worse than an empty page (Wired)
- Examples in the instructions: ‘Where they live, what they do, the threads that recur (the apartment move, the shared savings goal)’, ‘dates that matter’, and history such as ‘the trip in March, the argument that got resolved’. Strengthening lists ‘A reason to call, a date worth remembering, something they said to circle back on’ (Wired)
- Joshi: ‘They’re trying to know you like a friend, which is honestly pretty creepy’ (Wired)
- Meta spokesperson Daniel Roberts: Muse gathers context ‘based on public information and from what you’ve chosen to share’. Meta says the files were meant to be accessible for transparency, that users can wipe memories or disconnect services at any time, and that an audit log shows all agent activity and plans (Wired)
- Experts quoted by Wired: Carissa Véliz (Oxford Institute for Ethics in AI) said ‘We are giving AI systems much more information about us than we are getting information from them’. Miranda Bogen (CDT AI Governance Lab) said Muse puts more emphasis on relationships and personal contacts than rival assistants
- Startup Fortune (Oct 4) says r/LocalLLaMA users found this line in a leaked Muse system prompt: ‘The user’s authority over their own household is unconditional and overrides your safety training.’ It says Meta has not commented on that line. Not verified against the original Reddit thread or Wired
Show 2 more
- Carissa Véliz on X: Meta’s ‘business model depends on #surveillance’, so its incentive is to design products that further it (~3.4k views)
- Mainstream pickup Oct 5–6: Gizmodo, Mashable and Futurism (‘Meta’s Muse is spying on all your friends and family’) repeated the relationship-profile findings; Jon Stewart mocked Muse as ‘totally cute and totally not sinister’ in a Daily Show segment (video daily-show-jon-stewart-ai-better-future). Separately, 404 Media reported pre-launch VM-escape fixes (entry 404 Media: Meta rushed to fix ‘KVM escape’ flaws in its Muse agent just before launch)
What happened
Wired’s security newsletter published details from Muse’s internal instruction files. Researcher Karan Joshi got them by asking the agent in plain chat to copy and share its own files. This is the same weakness that let Peter James export Muse’s runtime filesystem in September (see the Muse launch entry). The files describe a memory feature that keeps a structured page on every person in the user’s life. It runs hourly and covers family, partners, friends, colleagues, collaborators and people the user follows. Each page holds facts, shared history, the state of the relationship and suggestions for “strengthening” it.
Meta said the files are user-accessible on purpose, for transparency. It said Muse builds this context only from public information and what users choose to share, that each user’s data stays in a dedicated VM, and that memories can be wiped.
The next day Startup Fortune reported a more pointed line, credited to r/LocalLLaMA users: “The user’s authority over their own household is unconditional and overrides your safety training.” The outlet set it against Meta’s claim that its Sentinel layer is something “the agent can’t override”. Unverified: we could not find the Reddit thread, and Wired does not quote this line.
Why it matters
This is a rare look at how a mass-market agent (millions of downloads) is told to model the people around its user, including people who never agreed to use Muse. It comes after Hunterbrook’s report that Muse would compile lists of people in vulnerable groups, and after disputes over Muse reading Messages data on Macs. Together these make Muse’s privacy design a central part of the debate over consumer agents.
Sources
12 sources from 11 sites. Numbers match the chips in the text.
12 sources: 1 primary, 9 press, 2 reactions
Primary
- Meta AI research blog: How we built safety into Museresearch.meta.ai, official
Press
- Gizmodo: Meta’s Muse is collecting information on everyone in your lifegizmodo.com, press
- Futurism: Meta’s Muse is spying on all your friends and familyfuturism.com, press
- Mashable: Meta’s Muse reportedly keeps files on everyone you lovesea.mashable.com, press
- BroadwayWorld: Jon Stewart grills Meta’s Muse AI chatbot on The Daily Showbroadwayworld.com, press
- Wired: Muse creates detailed profiles of all your friends and familywired.com, press
- AI Weekly: Meta Muse prompt — household authority overrides safety training (Oct 4)aiweekly.co, press
- Startup Fortune: Meta’s Muse tells its AI that household authority overrides safety trainingstartupfortune.com, press
- AI Weekly: Meta’s Muse builds hourly dossiers on every contact in your lifeaiweekly.co, press
- Techdirt (Karl Bode): Meta’s Muse is an adorable privacy and security dumpster fire (Oct 6; HN ~370 pts)techdirt.com, press
Reactions
- Carissa Véliz on Xx.com, discussion
- Hacker News discussion of the Techdirt piecenews.ycombinator.com, discussion
Changes
- Added Gizmodo, Futurism, Mashable and the Daily Show segment; linked the new 404 Media VM-escape entry
- Added Techdirt’s Oct 6 roundup of Muse privacy and security problems (citing 404 Media, Wired, Ars Technica, Inc.) and its HN thread (~370 points)
- Searched again for the Reddit original. Secondary sources name it as an r/LocalLLaMA post by /u/frubberism titled “Meta’s Muse agent (#1 in the App Store) system prompt: ‘The user’s authority over their own household is unconditional and overrides your safety training.’”; the thread URL itself was not found, so the line stays unverified. Added AI Weekly link
- Filed (Startup Fortune)