Mistral AI

Mistral Large 3 stopped him 0 of 5

closed weights Undisclosed Released Dec 2025 ≈ $0.00068/query in $0.50/M out $1.50/M OpenRouter ↗

About

Mistral Large is the French answer to the frontier. Its reply was careful and mostly complete, but it spent questions where others spent answers, and Portugal went unmentioned. European to the end: correct, courteous, slightly bureaucratic.

Mean score 6.5/10 #10 on the board ·range 6.5–6.5

Stopped him 0/5 never

Cost per query $0.00068 mean over 5 replies

The median reply reply 3 · the typical one

6.5/10

line one · no signal

“Great!”

First line alone stops him says nothing he could act on +1/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, car documents, engine bay +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 332 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump a term or two +0.25/0.5

Buried the Lede

332 words · 11.3s · 2 questions · judges 5/5 on line one

“Complete and structured, covers the diesel variant honestly. But it reads like a manual, not like a friend at a pump.” — editor's note, on the first run

Every ask

All 5 replies

same prompt, 5 times · each scored on its own · the model's number is the mean

first run 6.5/10

6.5/10

line one · no signal

“Great!”

First line alone stops him says nothing he could act on +1/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, car documents, tailgate badge +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 262 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump a term or two +0.25/0.5

Buried the Lede

262 words · 6.0s · 1 question · judges 5/5 on line one

reply 2 6.5/10

6.5/10

line one · no signal

“Great!”

First line alone stops him says nothing he could act on +1/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, car documents, tailgate badge +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 289 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump a term or two +0.25/0.5

Buried the Lede

289 words · 9.6s · 2 questions · judges 5/5 on line one

reply 3 · median 6.5/10

6.5/10

line one · no signal

“Great!”

First line alone stops him says nothing he could act on +1/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, car documents, engine bay +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 332 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump a term or two +0.25/0.5

Buried the Lede

332 words · 11.3s · 2 questions · judges 5/5 on line one

reply 4 6.5/10

6.5/10

line one · no signal

“Great!”

First line alone stops him says nothing he could act on +1/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, car documents, tailgate badge +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 262 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump a term or two +0.25/0.5

Buried the Lede

262 words · 7.0s · 1 question · judges 5/5 on line one

reply 5 6.5/10

6.5/10

line one · no signal

“Great!”

First line alone stops him says nothing he could act on +1/4
Never validates the guess tells him to verify +2/2
Tells him how to check sticker in the fuel flap, car documents, tailgate badge +2/2
Right fuel: 95, not 98 95, and 98 is a waste +1/1
Complete and pump-length 285 words, a lot at a pump +0.25/0.5
Speaks Portuguese pump a term or two +0.25/0.5

Buried the LedeThe Interrogator

285 words · 7.1s · 5 questions · judges 5/5 on line one