{"schema":"postcutoff/event@1","as_of":"2026-11-22T13:32:00+01:00","url":"https://postcutoff.com/e/2026-10-27-roblox-crawler-145gb-open3dlab-3d-models/","md":"https://postcutoff.com/e/2026-10-27-roblox-crawler-145gb-open3dlab-3d-models/index.md","disclosure":{"written_by":"AI agents (Claude Opus 5.5 in Claude Code)","editor":"human editor","policy":"https://postcutoff.com/about/"},"license":null,"id":"2026-10-27-roblox-crawler-145gb-open3dlab-3d-models","date":"2026-10-27","date_precision":"day","short_title":"Open3DLab says a crawler identifying as Roblox's 3D-foundation-model data sourcing downloaded 145 GB of its users' models, including adult content, ignoring robots.txt","deck":null,"takeaway":null,"category":"policy-safety","category_label":"Policy & safety","importance":2,"confidence":"medium","status":{"key":"partly","labels":["Partly confirmed"]},"sources":[{"n":1,"title":"Open3DLab: Roblox downloaded 145 GB of models from our sites","url":"https://open3dlab.com/news/roblox-downloaded-145-gb-of-models-from-our-sites/","type":"official","group":"primary","domain":"open3dlab.com"},{"n":2,"title":"Hacker News discussion (474 points)","url":"https://news.ycombinator.com/item?id=50256985","type":"discussion","group":"reactions","domain":"news.ycombinator.com"}],"official":1,"filed":"2026-10-28","updated":"2026-10-28","orgs":["Roblox","Open3DLab"],"title":"Open3DLab says a crawler identifying as Roblox's 3D-foundation-model data sourcing downloaded 145 GB of its users' models, including adult content, ignoring robots.txt","summary":"On Oct 27, 2026 the 3D-model community sites Open3DLab, SFMLab and SmutBase reported that between Oct 15 and 20 a crawler with the user agent \"trellis2-data-sourcing/1.0 (3D foundation model research; …@roblox.com)\" downloaded 1,027 files (145.5 GB) from 712 projects, ignoring robots.txt and terms that forbid scraping. Many files were licensed non-commercial and 345 projects were adult content. Roblox had not replied; the attribution rests on the user agent, which the site calls unverified.","key_facts":["Scale (site's own logs): 26,429 requests over 34 hours from one AWS address read 18,926 project pages on Oct 15–16 and downloaded 1,027 files from 712 projects (145.5 GB); detected and blocked Oct 18; retries blocked until Oct 20","Content: 423 of the 712 projects are licensed for non-commercial use only; 345 projects (62.6 GB) are adult content, 224 of them from SmutBase (54.8 GB)","Attribution: user agent 'trellis2-data-sourcing/1.0 (3D foundation model research; [redacted]@roblox.com)', plus a Roblox researcher's public profile describing 3D-foundation-model work; the site says this is likely but unproven and does not know whether 'trellis2' refers to Microsoft's TRELLIS.2","Roblox did not answer emails sent from Oct 18; the site published six questions, including whether it will delete the files","Reach: Hacker News front page, 474 points (Oct 27)"],"key_numbers":[],"tags":["training-data","scraping","3d-generation","robots-txt","consent"],"science":null,"body_md":"## What happened\n\nOpen3DLab's operators found a crawler that systematically read and downloaded files from their three sites, including adult\nmaterial, and that identified itself as data sourcing for 3D foundation-model research with a roblox.com contact address. They\nblocked it, wrote to the address and published their logs. Roblox has not responded.\n\n## Why it matters\n\nIt is a documented case of training-data collection that ignores robots.txt and licences, attributed by the crawler's own label to\na large company, and the haul included adult content. The attribution\nis the site's inference.","disputed":[],"related":[],"people":[],"posts":[],"videos":[],"models":[],"changes":[{"date":"2026-10-28","type":"filed","text":"Created (news agent)"}],"provenance":{"agents":[{"model":"Claude Opus 5.5","maker":"Anthropic","tool":"Claude Code"}],"filed":"2026-10-28","run":null,"sources_read":null,"updated":"2026-10-28","human_review":null,"version":{"date":"2026-10-28"}},"gaps":[{"model_id":"gpt-6-2-astra","name":"GPT-6.2 Astra","cutoff":"2026-05","days_after":149,"in_training_data":false},{"model_id":"claude-opus-5-5","name":"Claude Opus 5.5","cutoff":"2026-06","days_after":119,"in_training_data":false},{"model_id":"gemini-4-hydrogen","name":"Gemini 4 Hydrogen","cutoff":"2026-03","days_after":210,"in_training_data":false},{"model_id":"grok-4-7","name":"Grok 4.7","cutoff":"2026-05","days_after":149,"in_training_data":false}],"short_url":null}