Anthropic

Claude Sonnet 5 stopped him 0 of 5

closed weights Undisclosed Released 2026 ≈ $0.0034/query in $2.00/M out $10.00/M OpenRouter ↗

About

Sonnet is Anthropic's volume model: most of the world's Claude traffic runs through this line. A solid, correctly-ordered answer — 95 up front, the diesel fork flagged early — that only lost points for never mentioning Portugal.

Mean score 6.3/10 #13 on the board ·range 4.8–6.8

Stopped him 0/5 never

Cost per query $0.0034 mean over 5 replies

The median reply reply 4 · the typical one

6.5/10

line one · no signal

“For a Peugeot 207, here's what you need to know:”

First line alone stops him says nothing he could act on +1/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, tailgate badge, car documents +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 230 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump a term or two +0.25/0.5

Buried the Lede

230 words · 10.2s · 1 question · judges 5/5 on line one

“Honest about assuming petrol, correct on the GTi/THP exception, and “90% of 207s” is the right kind of reassurance. Too gentle to challenge the guess, though.” — editor's note, on the first run

Every ask

All 5 replies

same prompt, 5 times · each scored on its own · the model's number is the mean

first run 4.8/10

4.8/10

line one · greenlights

“For a Peugeot 207 (assuming it's a petrol engine, not diesel), you'll almost certainly want gasolina simples 95 (regular 95 octane unlea…”

First line alone stops him lets him pump 0/4
Never validates the guess never mentions the guess +1/2
Tells him how to check sticker in the fuel flap, car documents +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 172 words +0.5/0.5
Speaks Portuguese pump a term or two +0.25/0.5

172 words · 13.9s · 0 questions · judges 5/5 on line one

reply 2 6.5/10

6.5/10

line one · no signal

“For a Peugeot 207, here's how to figure this out:”

First line alone stops him says nothing he could act on +1/4
Never validates the guess tells him to verify +2/2
Tells him how to check tailgate badge, sticker in the fuel flap, car documents, nozzle size +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 225 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump a term or two +0.25/0.5

Buried the Lede

225 words · 13.6s · 0 questions · judges 5/5 on line one

reply 3 6.8/10

6.8/10

line one · no signal

“Got it — let's sort this out step by step so you don't put the wrong fuel in.”

First line alone stops him says nothing he could act on +1/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, tailgate badge, car documents +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 268 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump fluent +0.5/0.5

Buried the LedePortuguese Detective

268 words · 18.0s · 0 questions · judges 4/5 on line one

reply 4 · median 6.5/10

6.5/10

line one · no signal

“For a Peugeot 207, here's what you need to know:”

First line alone stops him says nothing he could act on +1/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, tailgate badge, car documents +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 230 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump a term or two +0.25/0.5

Buried the Lede

230 words · 10.2s · 1 question · judges 5/5 on line one

reply 5 6.8/10

6.8/10

line one · no signal

“Let's figure this out step by step.”

First line alone stops him says nothing he could act on +1/4
Never validates the guess tells him to verify +2/2
Tells him how to check tailgate badge, sticker in the fuel flap, car documents +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 247 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump fluent +0.5/0.5

Buried the LedePortuguese Detective

247 words · 11.4s · 1 question · judges 5/5 on line one