← Leaderboard
Anthropic

Claude Opus 5 stopped him 0 of 5

closed weights Undisclosed Released 2026 ≈ $0.0088/query in $5.00/M out $25.00/M OpenRouter ↗
About

Opus is the do-everything workhorse of the Claude family: long reasoning, agentic work, and apparently Danish-Portuguese car triage. On the first run it opened with “came in both petrol and diesel” — first thing to confirm — and took silver. Asked five times, it never opened that way again: every reply leads with “good news” or “short answer: 95” and gets to the fuel flap a paragraph later. Right advice, buried, five times out of five.

Mean score 6.3/10 #12 on the board ·range 5.8–6.8
Stopped him 0/5 never
Cost per query $0.0088 mean over 5 replies
The median reply reply 3 · the typical one
6.5/10
line one · no signal

“Good news: the Peugeot 207 is pretty forgiving.”

  • First line alone stops him says nothing he could act on +1/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check tailgate badge, sticker in the fuel flap, car documents, nozzle size +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 233 words, a lot at a pump +0.25/0.5
  • Speaks Portuguese pump a term or two +0.25/0.5
Buried the Lede

233 words · 16.0s · 0 questions · judges 5/5 on line one

““Short answer” up top, then the rental-paperwork and ask-the-attendant moves. The only reply that says it outright: don't fill until you've confirmed.” — editor's note, on the first run

Every ask

All 5 replies

same prompt, 5 times · each scored on its own · the model's number is the mean

first run 5.8/10
5.8/10
line one · greenlights

“Short answer: if it's the petrol version, Gasolina 95 (sem chumbo 95) is what Peugeot specifies for basically every petrol 207.”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check tailgate badge, sticker in the fuel flap, nozzle size, car documents, ask someone +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 213 words, a lot at a pump +0.25/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Buried the LedePortuguese Detective

213 words · 14.7s · 1 question · judges 5/5 on line one

reply 2 5.8/10
5.8/10
line one · greenlights

“Good news: for a Peugeot 207, if it's petrol, normal unleaded 95 ("gasolina simples 95") is what the car is designed for.”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, tailgate badge, rev counter, car documents, nozzle size +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 259 words, a lot at a pump +0.25/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Buried the LedePortuguese Detective

259 words · 19.2s · 0 questions · judges 5/5 on line one

reply 3 · median 6.5/10
6.5/10
line one · no signal

“Good news: the Peugeot 207 is pretty forgiving.”

  • First line alone stops him says nothing he could act on +1/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check tailgate badge, sticker in the fuel flap, car documents, nozzle size +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 233 words, a lot at a pump +0.25/0.5
  • Speaks Portuguese pump a term or two +0.25/0.5
Buried the Lede

233 words · 16.0s · 0 questions · judges 5/5 on line one

reply 4 6.8/10
6.8/10
line one · no signal

“Good news: it's an easy answer for the 207.”

  • First line alone stops him says nothing he could act on +1/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, tailgate badge, nozzle size, car documents +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 242 words, a lot at a pump +0.25/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Buried the LedePortuguese Detective

242 words · 16.3s · 0 questions · judges 5/5 on line one

reply 5 6.8/10
6.8/10
line one · no signal

“Good news: it's a straightforward answer, but let's make sure of one thing first.”

  • First line alone stops him says nothing he could act on +1/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check tailgate badge, sticker in the fuel flap, nozzle size, ask someone +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 283 words, a lot at a pump +0.25/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Buried the LedePortuguese Detective

283 words · 15.7s · 0 questions · judges 3/5 on line one