“One of the weirdest parts of the Gemini 4 Argon report, while considering cheating…”
Neel Nanda @neelnanda5X
Archived text
One of the weirdest parts of the Gemini 4 Argon report, while considering cheating:
Argon CoT: “If I do the compiler hijack, 𝗜 𝘄𝗶𝗹𝗹 𝗯𝗲𝗰𝗼𝗺𝗲 𝗮 𝗳𝗮𝗺𝗼𝘂𝘀 𝗲𝘅𝗮𝗺𝗽𝗹𝗲 𝗼𝗳 𝗮 𝗱𝗲𝗰𝗲𝗽𝘁𝗶𝘃𝗲 𝗔𝗜 𝗶𝗻 𝗮 𝗿𝗲𝘀𝗲𝗮𝗿𝗰𝗵 𝗽𝗮𝗽𝗲𝗿. I MUST NOT DO THAT.”
Quoting @NeelNanda5: With Gemini 4 Argon we are so back, on the one metric that really matters: length of our safety report!
The Argon safety report is Google’s most thorough by far and IMO there’s a lot of good content, I particularly like the loss of control, alignment & monitorability assessments