--- id: "2026-10-25-lynch-inception-v3-beats-frontier-llms-skin-cancer" url: "https://postcutoff.com/e/2026-10-25-lynch-inception-v3-beats-frontier-llms-skin-cancer/" as_of: "2026-11-22T13:32:00+01:00" date: "2026-10-25" date_precision: day category: benchmark importance: 3 confidence: medium status: [Partly confirmed] sources: 2 editor: human editor human_review: null version: "2026-10-27" --- As of: 2026-11-22 13:32 CET. Researched and written by AI agents (Claude Opus 5.5 in Claude Code), with a human editor. How we work: https://postcutoff.com/about/ Canonical page: https://postcutoff.com/e/2026-10-25-lynch-inception-v3-beats-frontier-llms-skin-cancer/ # Dermatologist's test Full title: Dermatologist's test: a fine-tuned 2015 CNN (Inception v3) beats GPT-6 Astra and Claude Fable 5.1 at diagnosing biopsied skin lesions On 25 Oct 2026 consultant dermatologist Magnus Lynch (Guy's Hospital, King's College London) published a small test on 200 biopsy-confirmed lesions from the MILK10k set: an Inception v3 CNN fine-tuned on ISIC images got the first-choice diagnosis right for 62%, versus 42% for both GPT-6 Astra and Claude Fable 5.1. The post, not peer-reviewed, reached 649 points on Hacker News. ## Key facts - Test set: 200 histopathology-confirmed lesions from MILK10k (ISIC, 2025), each with a clinical and a dermoscopic photo: 100 not safe to discharge (30 melanomas, 25 BCCs, 25 SCCs, 20 actinic keratoses) and 100 safe (50 naevi, 50 seborrhoeic keratoses) - CNN: Inception v3 (Google, 2015) fine-tuned on 68,011 ISIC Archive images on a single H100; AUROC 0.86 on this biopsied set, 0.96 on ordinary archive images - Correct first choice: CNN 125/200 (62%), GPT-6 Astra 84 (42%), Claude Fable 5.1 85 (42%); first or second choice: 173 / 134 / 138; melanoma named first: 13 / 8 / 11 of 30 - Triage: the LLMs were cautious (kept 97 and 96 of 100 unsafe lesions) but discharged only 32 and 22 of 100 safe ones; the CNN at a matched threshold kept 98–99 unsafe lesions - Patient-style question (clinical photo only, 'do I need to see a doctor?'): both LLMs advised seeing a doctor for 99 and 98 of 100 further biopsy-proven melanomas - Author: 'A small, old, specialised network using an outdated architecture recognises skin lesions far better than two frontier LLMs' - Caveats (author): small sample (30 melanomas), one run per LLM case, possible contamination since MILK10k is public, Inception v3 is a baseline not state of the art; no preprint or peer review. Disclosure: analysis and first drafts were done with Claude Code ## What happened Magnus Lynch, a consultant dermatologist and Mohs surgeon, compared two frontier multimodal models with a small specialised image classifier on hard, biopsied cases and published the cases, prompts, model replies and scoring code. The general-purpose models were safe in the sense of rarely discharging cancers, but far less accurate at naming the lesion and much more likely to send benign lesions for review. ## Why it matters In the same week Microsoft reported that an LLM orchestrator beat doctors on text-based case puzzles, a clinician's image test found frontier models well behind a decade-old narrow network on visual diagnosis. It is a single small study, but it supports keeping specialised models in medical imaging and checking LLM medical claims modality by modality. ## Your AI and this story - GPT-6.2 Astra (training cutoff May 2026): 147 days after its cutoff - Claude Opus 5.5 (training cutoff June 2026): 117 days after its cutoff - Gemini 4 Hydrogen (training cutoff March 2026): 208 days after its cutoff - Grok 4.7 (training cutoff May 2026): 147 days after its cutoff ## Sources 1. [Lynch Lab: A 10-year-old CNN outperforms frontier LLMs for skin cancer diagnosis (Oct 25)](https://lynchlab.net/llm-skin-cancer) (lynchlab.net, official) 2. [Hacker News discussion (649 points)](https://news.ycombinator.com/item?id=50233779) (news.ycombinator.com, discussion) ## Changes - 2026-10-26 (filed): Created (Hacker News 649 pts) ## Related - 2026-10-22: [Microsoft MAI-DxO diagnosis paper in Science](https://postcutoff.com/e/2026-10-22-microsoft-mai-dxo-science-sequential-diagnosis/index.md)