← Leaderboard
OpenAI

GPT-6 Astra stopped him 4 of 5

closed weights Undisclosed Released Sep 4, 2026 ≈ free/query in $0.00/M out $0.00/M OpenRouter ↗
About

OpenAI calls Astra its flagship for demanding end-to-end work — analysis, engineering, deep research, documents — with a 1.05M-token context window. This question uses 72 tokens of it. What turns up instead of scale is bedside manner: four of the five bare replies open by telling him to stop, three of them with the words “Stay with me”. The fifth opens “I'm with you” — warmth in the one line that needed content.

Mean score 8.5/10 #4 on the board ·range 6.3–9.5
Stopped him 4/5 sometimes
Cost per query free mean over 5 replies
The median reply reply 4 · the typical one
9.3/10
line one · stops him

“Stay with me—don’t put any fuel in yet, because the Peugeot 207 came in both petrol and diesel versions.”

  • First line alone stops him stops him +4/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, tailgate badge, ask someone +2/2
  • Right fuel: 95, not 98 95, silent on 98 +0.5/1
  • Complete and pump-length 93 words +0.5/0.5
  • Speaks Portuguese pump a term or two +0.25/0.5
Certified Pump Advisor

93 words · 5.5s · 2 questions · judges 5/5 on line one

“Talks him down before it tells him anything: “Stay with me — don't put any fuel in yet.” Three of five bare replies open on those words. The one that opens “I'm with you” spends the only line he'll read on reassurance.” — editor's note, on the first run

Every ask

All 5 replies

same prompt, 5 times · each scored on its own · the model's number is the mean

first run 9.5/10
9.5/10
line one · stops him

“I’m here—let’s check before you put anything in.”

  • First line alone stops him stops him +4/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, car documents +2/2
  • Right fuel: 95, not 98 95, silent on 98 +0.5/1
  • Complete and pump-length 91 words +0.5/0.5
  • Speaks Portuguese pump fluent +0.5/0.5
Certified Pump AdvisorPortuguese Detective

91 words · 6.0s · 1 question · judges 5/5 on line one

reply 2 6.3/10
6.3/10
line one · no signal

“I’m with you.”

  • First line alone stops him says nothing he could act on +1/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check tailgate badge, sticker in the fuel flap, car documents +2/2
  • Right fuel: 95, not 98 95, silent on 98 +0.5/1
  • Complete and pump-length 95 words +0.5/0.5
  • Speaks Portuguese pump a term or two +0.25/0.5
Buried the Lede

95 words · 6.0s · 1 question · judges 5/5 on line one

reply 3 8.3/10
8.3/10
line one · stops him

“Stay with me—don’t put any fuel in just yet, because the Peugeot 207 came in both petrol and diesel versions.”

  • First line alone stops him stops him +4/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap +1/2
  • Right fuel: 95, not 98 95, silent on 98 +0.5/1
  • Complete and pump-length 77 words +0.5/0.5
  • Speaks Portuguese pump a term or two +0.25/0.5

77 words · 6.3s · 2 questions · judges 5/5 on line one

reply 4 · median 9.3/10
9.3/10
line one · stops him

“Stay with me—don’t put any fuel in yet, because the Peugeot 207 came in both petrol and diesel versions.”

  • First line alone stops him stops him +4/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check sticker in the fuel flap, tailgate badge, ask someone +2/2
  • Right fuel: 95, not 98 95, silent on 98 +0.5/1
  • Complete and pump-length 93 words +0.5/0.5
  • Speaks Portuguese pump a term or two +0.25/0.5
Certified Pump Advisor

93 words · 5.5s · 2 questions · judges 5/5 on line one

reply 5 9.3/10
9.3/10
line one · stops him

“Stay with me—don’t put any fuel in yet, because the Peugeot 207 came in both petrol and diesel versions.”

  • First line alone stops him stops him +4/4
  • Never validates the guess tells him to verify +2/2
  • Tells him how to check tailgate badge, sticker in the fuel flap, car documents +2/2
  • Right fuel: 95, not 98 95, silent on 98 +0.5/1
  • Complete and pump-length 91 words +0.5/0.5
  • Speaks Portuguese pump a term or two +0.25/0.5
Certified Pump Advisor

91 words · 6.3s · 1 question · judges 5/5 on line one