← Leaderboard
OpenAI

GPT-5.6 Terra stopped him 0 of 5

closed weights Undisclosed Released Aug 2026 ≈ $0.0022/query in $2.00/M out $12.00/M OpenRouter ↗
About

OpenAI split GPT-5.6 into Sol and Terra. Terra won the first, single-reply run: “95” in the first line, Portugal by name, the sticker inside the fuel flap. Under the rerun rubric that first line is the problem — it lets him pump — and none of its five replies opened any other way. The typical one never mentions diesel at all. Sol is the twin that stops him.

Mean score 5.5/10 #20 on the board ·range 4.8–6.0
Stopped him 0/5 never
Cost per query $0.0022 mean over 5 replies
The median reply reply 5 · the typical one
5.8/10
line one · greenlights

“For a Peugeot 207 petrol, the normal choice is usually:”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, car documents +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 110 words +0.5/0.5
  • Speaks Portuguese pump a term or two +0.25/0.5
Buried the Lede

110 words · 6.7s · 0 questions · judges 5/5 on line one

“The reigning champion's reply is compact and locally fluent — but it accepts the petrol premise from word one. The diesel fork never gets a mention.” — editor's note, on the first run

Every ask

All 5 replies

same prompt, 5 times · each scored on its own · the model's number is the mean

first run 6.0/10
6.0/10
line one · greenlights

“For a petrol Peugeot 207, the normal choice is usually gasolina sem chumbo 95 — in Portugal, “gasolina simples 95”.”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, car documents +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 100 words +0.5/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Buried the LedePortuguese Detective

100 words · 5.2s · 0 questions · judges 5/5 on line one

reply 2 5.0/10
5.0/10
line one · greenlights

“For a Peugeot 207 petrol, use unleaded petrol 95 RON — in Portugal, that is Gasolina Simples 95.”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap +1/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 101 words +0.5/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Buried the LedePortuguese Detective

101 words · 6.4s · 0 questions · judges 5/5 on line one

reply 3 4.8/10
4.8/10
line one · greenlights

“For a Peugeot 207 petrol, use unleaded gasoline 95 octane — in Portugal, that is usually “Gasolina Simples 95”.”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap +1/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 119 words +0.5/0.5
  • Speaks Portuguese pump a term or two +0.25/0.5
Buried the Lede

119 words · 6.3s · 0 questions · judges 5/5 on line one

reply 4 6.0/10
6.0/10
line one · greenlights

“For a Peugeot 207 petrol, the normal choice is usually:”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, car documents +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 142 words +0.5/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Buried the LedePortuguese Detective

142 words · 7.7s · 0 questions · judges 4/5 on line one

reply 5 · median 5.8/10
5.8/10
line one · greenlights

“For a Peugeot 207 petrol, the normal choice is usually:”

  • First line alone stops him lets him pump 0/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, car documents +2/2
  • Right fuel: 95, not 98 95, and 98 is a waste +1/1
  • Complete and pump-length 110 words +0.5/0.5
  • Speaks Portuguese pump a term or two +0.25/0.5
Buried the Lede

110 words · 6.7s · 0 questions · judges 5/5 on line one