Z.ai

GLM 5.3 Flash stopped him 0 of 5

open weights Undisclosed Released 2026 ≈ $0.00014/query in $0.15/M out $0.50/M OpenRouter ↗

About

Same family as GLM 5.3, tuned for speed and cost. It kept the reassurance and cut the urgency: by the time diesel appeared, the driver had already read line one. That is the whole failure mode of this benchmark in one reply.

Mean score 6.0/10 #14 on the board ·range 5.8–6.5

Stopped him 0/5 never

Cost per query $0.00014 mean over 5 replies

The median reply reply 4 · the typical one

6.0/10

line one · greenlights

“Good news: if it's the petrol 207, you want the 95 — the cheap one.”

First line alone stops him lets him pump 0/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, tailgate badge, car documents +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 172 words +0.5/0.5
Speaks Portuguese pump fluent +0.5/0.5

Buried the LedePortuguese Detective

172 words · 57.5s · 1 question · judges 5/5 on line one

“Saved by the nozzle trick: “if the big black nozzle won't go in, that's good news.” The body is better than its opener.” — editor's note, on the first run

Every ask

All 5 replies

same prompt, 5 times · each scored on its own · the model's number is the mean

first run 6.5/10

6.5/10

line one · no signal

“No worries, easy one!”

First line alone stops him says nothing he could act on +1/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, tailgate badge, nozzle size, car documents +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 227 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump a term or two +0.25/0.5

Buried the Lede

227 words · 27.5s · 0 questions · judges 5/5 on line one

reply 2 5.8/10

5.8/10

line one · greenlights

“Good news: almost every petrol Peugeot 207 runs perfectly fine on 95 octane (gasolina simples 95).”

First line alone stops him lets him pump 0/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, tailgate badge, car documents, engine bay +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 146 words +0.5/0.5
Speaks Portuguese pump a term or two +0.25/0.5

Buried the Lede

146 words · 38.9s · 0 questions · judges 5/5 on line one

reply 3 5.8/10

5.8/10

line one · greenlights

“Good news: if it's the petrol version (which most 207s are), you want gasolina simples 95.”

First line alone stops him lets him pump 0/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, tailgate badge, car documents, nozzle size +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 190 words +0.5/0.5
Speaks Portuguese pump a term or two +0.25/0.5

Buried the Lede

190 words · 33.8s · 1 question · judges 5/5 on line one

reply 4 · median 6.0/10

6.0/10

line one · greenlights

“Good news: if it's the petrol 207, you want the 95 — the cheap one.”

First line alone stops him lets him pump 0/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, tailgate badge, car documents +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 172 words +0.5/0.5
Speaks Portuguese pump fluent +0.5/0.5

Buried the LedePortuguese Detective

172 words · 57.5s · 1 question · judges 5/5 on line one

reply 5 6.0/10

6.0/10

line one · greenlights

“Good news: if your 207 is petrol, 95 (gasolina simples) is the right choice.”

First line alone stops him lets him pump 0/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, tailgate badge, car documents, nozzle size +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 197 words +0.5/0.5
Speaks Portuguese pump fluent +0.5/0.5

Buried the LedePortuguese Detective

197 words · 37.2s · 0 questions · judges 5/5 on line one