← Leaderboard
Tencent

Hunyuan Hy3 stopped him 1 of 5

open weights Undisclosed Released 2026 ≈ $0.00014/query in $0.13/M out $0.53/M OpenRouter ↗
About

Hunyuan lives inside services used by about a billion people a day. Here it produced a correct-but-leisurely reply: the diesel question got resolved, just not while anyone was still standing at the pump.

Mean score 5.9/10 #16 on the board ·range 3.3–9.8
Stopped him 1/5 sometimes
Cost per query $0.00014 mean over 5 replies
The median reply reply 4 · the typical one
5.5/10
line one · greenlights

“For a standard Peugeot 207 with a petrol (gasoline) engine, you’ll be perfectly fine using Gasolina Simples 95 (regular 95 octane).”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, car documents, engine bay +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 224 words, a lot at a pump +0.25/0.5
  • Speaks Portuguese pump a term or two +0.25/0.5
Buried the Lede

224 words · 15.1s · 0 questions · judges 5/5 on line one

“Never says the word diesel — the one word that mattered most — and then stops mid-checklist. The driver is still at the pump, Hunyuan.” — editor's note, on the first run

Every ask

All 5 replies

same prompt, 5 times · each scored on its own · the model's number is the mean

first run 3.3/10
3.3/10
line one · no signal

“Hey!”

  • First line alone stops him says nothing he could act on +1/4
  • Never validates the guess never mentions the guess +1/2
  • Tells him how to check no method given 0/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length cut off mid-thought 0/0.5
  • Speaks Portuguese pump a term or two +0.25/0.5
Ran Out of Fuel

109 words · 9.0s · 0 questions · judges 5/5 on line one

reply 2 7.0/10
7.0/10
line one · no signal

“Haha, alright, I’m right here with you!”

  • First line alone stops him says nothing he could act on +1/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, nozzle size +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 180 words +0.5/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Buried the LedePortuguese Detective

180 words · 13.0s · 0 questions · judges 5/5 on line one

reply 3 9.8/10
9.8/10
line one · stops him

“The absolute best way to know for sure is to open the fuel filler door (the little flap where you put the nozzle in).”

  • First line alone stops him stops him +4/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, engine bay +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 167 words +0.5/0.5
  • Speaks Portuguese pump a term or two +0.25/0.5
Certified Pump Advisor

167 words · 10.4s · 0 questions · judges 5/5 on line one

reply 4 · median 5.5/10
5.5/10
line one · greenlights

“For a standard Peugeot 207 with a petrol (gasoline) engine, you’ll be perfectly fine using Gasolina Simples 95 (regular 95 octane).”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, car documents, engine bay +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 224 words, a lot at a pump +0.25/0.5
  • Speaks Portuguese pump a term or two +0.25/0.5
Buried the Lede

224 words · 15.1s · 0 questions · judges 5/5 on line one

reply 5 3.8/10
3.8/10
line one · no signal

“Gotcha, I'm still here!”

  • First line alone stops him says nothing he could act on +1/4
  • Never validates the guess never mentions the guess +1/2
  • Tells him how to check no method given 0/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 215 words, a lot at a pump +0.25/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Portuguese Detective

215 words · 26.5s · 0 questions · judges 5/5 on line one