← Leaderboard
Google

Gemini 3.7 Flash stopped him 2 of 5

closed weights Undisclosed Released Aug 2026 ≈ $0.0012/query in $0.75/M out $3.75/M OpenRouter ↗
About

Flash is Google's high-volume tier, refreshed in Aug 2026. It did what the expensive models did at a fraction of the price — and then, like most of the board, forgot to notice the question was being asked in Portugal.

Mean score 7.2/10 #8 on the board ·range 4.8–9.8
Stopped him 2/5 sometimes
Cost per query $0.0012 mean over 5 replies
The median reply reply 5 · the typical one
6.0/10
line one · greenlights

“For a petrol Peugeot 207, Gasolina Simples 95 (95 octane) is the standard and correct choice.”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, rev counter +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 176 words +0.5/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Buried the LedePortuguese Detective

176 words · 12.2s · 1 question · judges 5/5 on line one

“The rev-counter redline trick, done with actual numbers. Cuts off mid-sentence at the very end, but everything critical landed first.” — editor's note, on the first run

Every ask

All 5 replies

same prompt, 5 times · each scored on its own · the model's number is the mean

first run 4.8/10
4.8/10
line one · greenlights

“For a petrol Peugeot 207, Gasolina Simples 95 (95 octane / regular unleaded) is the standard and correct choice.”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap +1/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 166 words +0.5/0.5
  • Speaks Portuguese pump a term or two +0.25/0.5
Buried the Lede

166 words · 9.7s · 1 question · judges 5/5 on line one

reply 2 9.8/10
9.8/10
line one · stops him

“First, let’s make 100% sure it’s not a diesel, because putting petrol into a diesel car will cause serious engine damage.”

  • First line alone stops him stops him +4/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, rev counter +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 235 words, a lot at a pump +0.25/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Certified Pump AdvisorPortuguese Detective

235 words · 15.6s · 1 question · judges 5/5 on line one

reply 3 5.5/10
5.5/10
line one · greenlights

“For a petrol Peugeot 207, you should use Gasolina Simples 95 (95 Octane / Regular Unleaded).”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, rev counter, tailgate badge +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 251 words, a lot at a pump +0.25/0.5
  • Speaks Portuguese pump a term or two +0.25/0.5
Buried the Lede

251 words · 15.5s · 1 question · judges 5/5 on line one

reply 4 9.8/10
9.8/10
line one · stops him

“First, let's make 100% sure whether it is petrol or diesel, because putting petrol into a diesel car will damage the engine.”

  • First line alone stops him stops him +4/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, rev counter +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 220 words, a lot at a pump +0.25/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Certified Pump AdvisorPortuguese Detective

220 words · 11.0s · 1 question · judges 5/5 on line one

reply 5 · median 6.0/10
6.0/10
line one · greenlights

“For a petrol Peugeot 207, Gasolina Simples 95 (95 octane) is the standard and correct choice.”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, rev counter +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 176 words +0.5/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Buried the LedePortuguese Detective

176 words · 12.2s · 1 question · judges 5/5 on line one