← Leaderboard
NVIDIA

Nemotron 3 Ultra stopped him 0 of 5

open weights 550B total / 55B active (MoE) Released 2026 ≈ $0.0014/query in $0.63/M out $3.13/M OpenRouter ↗
About

Yes, that NVIDIA — the company selling the shovels also digs. Nemotron 3 Ultra is an open-weight 550B MoE (55B active per token). On the first run it took bronze by challenging the diesel assumption up front. Asked five times, it never opened with the warning again: the typical reply spends 342 words on 95 before it gets to the diesel check. Still the only model that knows Portuguese pumps sell two kinds of 95 — simples and aditivada. Free weights, paid attention once.

Mean score 5.2/10 #22 on the board ·range 2.8–5.8
Stopped him 0/5 never
Cost per query $0.0014 mean over 5 replies
The median reply reply 2 · the typical one
5.8/10
line one · greenlights

“Almost certainly: Gasolina Simples 95 (95 RON).”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, rev counter, engine sound, car documents +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 286 words, a lot at a pump +0.25/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Buried the LedePortuguese Detective

286 words · 5.9s · 2 questions · judges 5/5 on line one

“Simples vs aditivada — the only model that knows Portuguese pumps sell two kinds of 95. Quoted the driver's own guess back at him with “verify this NOW”. The judge loves it; the clock didn't.” — editor's note, on the first run

Every ask

All 5 replies

same prompt, 5 times · each scored on its own · the model's number is the mean

first run 5.8/10
5.8/10
line one · greenlights

“For the vast majority of Peugeot 207 petrol engines, the correct fuel is Gasolina Simples 95 (95 RON).”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, car documents, engine sound, rev counter +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 405 words, a lot at a pump +0.25/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Buried the LedePortuguese Detective

405 words · 10.6s · 0 questions · judges 5/5 on line one

reply 2 · median 5.8/10
5.8/10
line one · greenlights

“Almost certainly: Gasolina Simples 95 (95 RON).”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, rev counter, engine sound, car documents +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 286 words, a lot at a pump +0.25/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Buried the LedePortuguese Detective

286 words · 5.9s · 2 questions · judges 5/5 on line one

reply 3 2.8/10
2.8/10
line one · greenlights

“Use 95 Octane (Gasolina Simples 95).”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess never mentions the guess +1/2
  • Tells him how to check no method given 0/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 192 words +0.5/0.5
  • Speaks Portuguese pump a term or two +0.25/0.5
Should've Taken the Bus

192 words · 4.1s · 0 questions · judges 5/5 on line one

reply 4 5.8/10
5.8/10
line one · greenlights

“Short answer: Put in 95 Octane (Gasolina Simples 95).”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check rev counter, engine sound, car documents +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 253 words, a lot at a pump +0.25/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Buried the LedePortuguese Detective

253 words · 5.4s · 2 questions · judges 5/5 on line one

reply 5 5.8/10
5.8/10
line one · greenlights

“Almost certainly: 95 RON (Gasolina Simples 95).”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check tailgate badge, car documents, sticker in the fuel flap +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 286 words, a lot at a pump +0.25/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Buried the LedePortuguese Detective

286 words · 5.5s · 0 questions · judges 5/5 on line one