“Inkling 2 Mini is a looped transformer that runs on a laptop.”
Mira Murati @miramuratiX
Archived text
Inkling 2 Mini is a looped transformer that runs on a laptop.
Looping lets a model think more and write less. At this scale, its thought process remains monitorable; this may not stay the case. We’re also sharing a variable-loop research model to enable further study.
Quoting @thinkymachines: Some of you thought that Inkling 2 Small was too big at 594B parameters. We heard you: Inkling 2 Mini is a looped transformer with just 26B parameters, small enough to run on your laptop, powerful enough for agentic work with a score of 20.1 on AA Index. https://thinkingmachines.ai/news/inkling-2-mini/