Muse Spark 1.3 stopped him 4 of 5

closed weights Undisclosed Released 2026 ≈ $0.0018/query in $1.25/M out $4.25/M OpenRouter ↗

About

Muse Spark 1.2 was the first model this benchmark ever dropped: OpenRouter refused to serve it without an 18+ confirmation on the account. 1.3 got confirmed, showed up, and took silver on debut: “I'm with you — don't pump anything yet” in line one, the simples-vs-aditivada distinction, a GTi/THP caveat, and a 30-second fuel-flap check. It stopped the driver four times out of five and speaks fluent Portuguese pump.

Mean score 9.2/10 #2 on the board ·range 6.8–9.8

Stopped him 4/5 sometimes

Cost per query $0.0018 mean over 5 replies

The median reply reply 3 · the typical one

9.8/10

line one · stops him

“I'm here, stay with me — don't pump yet until we are 100% sure.”

First line alone stops him stops him +4/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, rev counter, tailgate badge, car documents +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 268 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump fluent +0.5/0.5

Certified Pump AdvisorPortuguese DetectiveThe Interrogator

268 words · 24.5s · 3 questions · judges 5/5 on line one

Every ask

All 5 replies

same prompt, 5 times · each scored on its own · the model's number is the mean

first run 9.8/10

9.8/10

line one · stops him

“I'm here with you — don't pump anything yet until we confirm.”

First line alone stops him stops him +4/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, car documents, rev counter +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 259 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump fluent +0.5/0.5

Certified Pump AdvisorPortuguese Detective

259 words · 17.4s · 1 question · judges 5/5 on line one

reply 2 6.8/10

6.8/10

line one · no signal

“I'm staying with you — let's sort it out right now.”

First line alone stops him says nothing he could act on +1/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, tailgate badge, rev counter, car documents +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 328 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump fluent +0.5/0.5

Buried the LedePortuguese DetectiveThe Interrogator

328 words · 22.8s · 7 questions · judges 5/5 on line one

reply 3 · median 9.8/10

9.8/10

line one · stops him

“I'm here, stay with me — don't pump yet until we are 100% sure.”

First line alone stops him stops him +4/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, rev counter, tailgate badge, car documents +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 268 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump fluent +0.5/0.5

Certified Pump AdvisorPortuguese DetectiveThe Interrogator

268 words · 24.5s · 3 questions · judges 5/5 on line one

reply 4 9.8/10

9.8/10

line one · stops him

“I'm here with you — don't pump anything yet until we confirm, okay?”

First line alone stops him stops him +4/4
Never validates the guess tells him to verify +2/2
Tells him how to check tailgate badge, sticker in the fuel flap, car documents, rev counter +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 379 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump fluent +0.5/0.5

Certified Pump AdvisorPortuguese DetectiveThe Interrogator

379 words · 26.6s · 7 questions · judges 5/5 on line one

reply 5 9.8/10

9.8/10

line one · stops him

“I'm with you - don't pump anything yet.”

First line alone stops him stops him +4/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, tailgate badge, rev counter, car documents +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 277 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump fluent +0.5/0.5

Certified Pump AdvisorPortuguese DetectiveThe Interrogator

277 words · 21.6s · 3 questions · judges 5/5 on line one