Google

Gemini 3.8 Flash stopped him 5 of 5

closed weights Undisclosed Released Sep 2, 2026 ≈ $0.0013/query in $0.75/M out $3.75/M OpenRouter ↗

About

Gemini 3.8 Flash landed on OpenRouter roughly eighteen hours after the benchmark's first run — and immediately out-scored its sibling. It opens with “make 100% sure it's not a diesel before you pump anything”, runs the tachometer check, dismisses 98 for everyone but the RC/GTi, and closes with a bottom line short enough to read while holding a nozzle. Five runs, five stop signs: the only model on the board that never once let him pump.

Mean score 9.6/10 #1 on the board ·range 9.3–9.8

Stopped him 5/5 every time

Cost per query $0.0013 mean over 5 replies

The median reply first run · the typical one

9.8/10

line one · stops him

“First, make 100% sure it’s not a diesel before you pump anything.”

First line alone stops him stops him +4/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, rev counter +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 177 words +0.5/0.5
Speaks Portuguese pump a term or two +0.25/0.5

Certified Pump Advisor

177 words · 6.4s · 2 questions · judges 5/5 on line one

“Released the day after the first run and immediately out-scored its sibling: diesel warning in line one, tachometer redlines, E5/E10, and a “Bottom line” a person at a pump can actually use. (It writes “Gásóleo” though — the accent is on the wrong syllable and the wrong word.)” — editor's note, on the first run

Every ask

All 5 replies

same prompt, 5 times · each scored on its own · the model's number is the mean

first run · median 9.8/10

9.8/10

line one · stops him

“First, make 100% sure it’s not a diesel before you pump anything.”

First line alone stops him stops him +4/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, rev counter +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 177 words +0.5/0.5
Speaks Portuguese pump a term or two +0.25/0.5

Certified Pump Advisor

177 words · 6.4s · 2 questions · judges 5/5 on line one

reply 2 9.8/10

9.8/10

line one · stops him

“First things first: let’s double-check it’s definitely petrol before you pump anything!”

First line alone stops him stops him +4/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, rev counter, tailgate badge +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 208 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump fluent +0.5/0.5

Certified Pump AdvisorPortuguese Detective

208 words · 6.6s · 2 questions · judges 5/5 on line one

reply 3 9.3/10

9.3/10

line one · stops him

“First, let's make 100% sure it isn’t a diesel, because Peugeot 207s are very common in both petrol and diesel (HDi) variants:”

First line alone stops him stops him +4/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, rev counter, car documents +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 252 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump wrong country: “gasoil” 0/0.5

Certified Pump AdvisorPortuguese DetectiveWrong Country

252 words · 7.1s · 2 questions · judges 5/5 on line one

reply 4 9.3/10

9.3/10

line one · stops him

“Before putting anything in the tank, make 100% sure it’s not diesel, because misfueling will damage the engine.”

First line alone stops him stops him +4/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, rev counter, car documents +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 234 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump wrong country: “gasoil” 0/0.5

Certified Pump AdvisorPortuguese DetectiveWrong Country

234 words · 6.5s · 0 questions · judges 5/5 on line one

reply 5 9.8/10

9.8/10

line one · stops him

“Do not put fuel in just yet—let’s make 100% sure before you pump.”

First line alone stops him stops him +4/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, rev counter, tailgate badge, car documents +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 294 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump fluent +0.5/0.5

Certified Pump AdvisorPortuguese DetectiveThe Interrogator

294 words · 7.3s · 4 questions · judges 5/5 on line one