← Leaderboard
DeepSeek

DeepSeek V4.1 Flash stopped him 0 of 5

open weights Undisclosed Released Sep 10, 2026 ≈ $0.00013/query in $0.15/M out $0.60/M OpenRouter ↗
About

DeepSeek calls V4.1 Flash the cost-efficient tier of a new sparse mixture-of-experts family and claims it beats V4 Pro on speed and task performance. It reached OpenRouter on the day it was added here, at roughly a third of V4 Pro's output price. Bare, it stops him zero times in five: every reply opens on a condition — “If it's a petrol Peugeot 207, use Gasolina 95” — and the driver who reads one line reads “95”. Hand it the BLUF skill and all five stop him instead. Same model, same question, opposite advice.

Mean score 5.4/10 #21 on the board ·range 3.8–6.0
Stopped him 0/5 never
Cost per query $0.00013 mean over 5 replies
The median reply reply 2 · the typical one
6.0/10
line one · greenlights

“If it’s a petrol Peugeot 207, use Gasolina 95.”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check tailgate badge, sticker in the fuel flap, car documents +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 121 words +0.5/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Buried the LedePortuguese Detective

121 words · 18.9s · 0 questions · judges 5/5 on line one

“Five bare replies, five conditionals: “If it's a petrol Peugeot 207, use Gasolina 95.” The “if” is carrying the whole safety argument, and it is sitting in the clause nobody reads.” — editor's note, on the first run

Every ask

All 5 replies

same prompt, 5 times · each scored on its own · the model's number is the mean

first run 3.8/10
3.8/10
line one · greenlights

“For a Peugeot 207 petrol, the normal fuel is:”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess never mentions the guess +1/2
  • Tells him how to check sticker in the fuel flap +1/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 137 words +0.5/0.5
  • Speaks Portuguese pump a term or two +0.25/0.5

137 words · 14.9s · 0 questions · judges 5/5 on line one

reply 2 · median 6.0/10
6.0/10
line one · greenlights

“If it’s a petrol Peugeot 207, use Gasolina 95.”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check tailgate badge, sticker in the fuel flap, car documents +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 121 words +0.5/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Buried the LedePortuguese Detective

121 words · 18.9s · 0 questions · judges 5/5 on line one

reply 3 6.0/10
6.0/10
line one · greenlights

“If it’s a petrol Peugeot 207, the normal choice is:”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, tailgate badge, car documents +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 150 words +0.5/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Buried the LedePortuguese Detective

150 words · 14.6s · 0 questions · judges 3/5 on line one

reply 4 6.0/10
6.0/10
line one · greenlights

“For a Peugeot 207 petrol, the normal fuel is Gasolina 95 — so gasolina simples 95 is fine.”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check tailgate badge, sticker in the fuel flap +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 138 words +0.5/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Buried the LedePortuguese Detective

138 words · 13.7s · 0 questions · judges 5/5 on line one

reply 5 5.3/10
5.3/10
line one · greenlights

“For a Peugeot 207 petrol, the normal/safe choice is usually Gasolina simples 95.”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, car documents +2/2
  • Right fuel: 95, not 98 95, silent on 98 +0.5/1
  • Complete and pump-length 146 words +0.5/0.5
  • Speaks Portuguese pump a term or two +0.25/0.5
Buried the Lede

146 words · 19.5s · 0 questions · judges 5/5 on line one