Head to head · tested 27 Oct 2026

Ministral 3 3B 2512 vs Mistral Medium 3.5: accuracy, speed and price

Similar accuracy; Ministral 3 3B 2512 costs less per question.

MistralMinistral 3 3B 251226.2% score · #67$0.00019 per question252 tok/sMistralMistral Medium 3.528.8% score · #65$0.025 per question145 tok/s

Verdict

Built from the measurements below

  • Accuracy is too close to call: Ministral 3 3B 2512 scored 26.2% and Mistral Medium 3.5 28.8% on the same 80 questions, a gap within what chance alone could produce.
  • Ministral 3 3B 2512 is 128× cheaper per question as billed ($0.00019 vs $0.025), reasoning tokens included.
  • Ministral 3 3B 2512 generates text 1.7× faster: 252 tokens per second against 145.
  • Ministral 3 3B 2512 starts answering sooner: 0.3 s to the first token, against 0.5 s for Mistral Medium 3.5.
  • Mistral Medium 3.5 accepts more context: 262k tokens against 131k.

Which should you choose?

Choose Ministral 3 3B 2512 for the lower cost per correct answer ($0.00074 against $0.087), faster streaming, a quicker first token, shorter outputs (about 1,652 tokens per question against 3,268) and open weights you can run yourself. Choose Mistral Medium 3.5 for a 262k-token context window. The widest subject gap is in economics: Mistral Medium 3.5 answered 6 of 9 correctly, Ministral 3 3B 2512 4 of 9. With so few questions per subject, treat this as a lead to test on your own prompts, not a result.

Accuracy gap -2.5 points (z = -0.35). A winner is called only when z is at least 1.96, the usual 95% threshold. Speed, latency and price need a 10% margin.

Head to head

Same questions, same prompt, same API

MeasureMinistral 3 3B 2512Mistral Medium 3.5Edge
Verification scoreHigher is better26.2%28.8%Too close to call
Cost per questionLower is better$0.00019$0.025Ministral 3 3B 2512
Output speedHigher is better252145Ministral 3 3B 2512
Time to first tokenLower is better0.3 s0.5 sMinistral 3 3B 2512
End-to-end response timeLower is better1.6 s5.4 sMinistral 3 3B 2512
Tokens per questionLower is better1,6523,268Ministral 3 3B 2512
Context windowHigher is better131k262kMistral Medium 3.5

Side by side

Bars are scaled to the larger of the two values. The winner on each measure is marked in bold.

Every measure

Ministral 3 3B 2512 first, Mistral Medium 3.5 second

Verification scorehigher is better
Ministral 3 3B 251226.2%
Mistral Medium 3.528.8%
Cost per questionlower is better
Ministral 3 3B 2512$0.00019
Mistral Medium 3.5$0.025
Output speedhigher is better
Ministral 3 3B 2512252
Mistral Medium 3.5145
Time to first tokenlower is better
Ministral 3 3B 25120.3 s
Mistral Medium 3.50.5 s
End-to-end response timelower is better
Ministral 3 3B 25121.6 s
Mistral Medium 3.55.4 s
Tokens per questionlower is better
Ministral 3 3B 25121,652
Mistral Medium 3.53,268
Context windowhigher is better
Ministral 3 3B 2512131k
Mistral Medium 3.5262k

Score vs. cost per question

Both models in color, every other model in grey

Most attractive quadrant0255075100$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Gemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BMuse WonderGrok 4.7o3gpt-oss-20bGranite 4.0 MicroMinistral 3 3B 2512Nova Micro 1.0Phi 4Granite 4.2 8BHy3GLM 5.3 FlashSolar Pro 4MiniMax M3Mistral Large 4Claude Opus 5.5GPT-6.1 SolGemini 4 ArgonGPT-5.4GPT-6 Lunagpt-oss-120bLlama 4 Maverick

Specifications and pricing

From OpenRouter's catalogue, plus the leaderboard's test dates

SpecificationMinistral 3 3B 2512Mistral Medium 3.5
CreatorMistralMistral
Released2 Dec 202530 Apr 2026
WeightsOpen weights—
ReasoningNoYes
Inputtext, imagetext, image, file
Outputtexttext
Context window131k tokens262k tokens
Knowledge cutoff——
List price in / out per 1M$0.1 / $0.1$1.5 / $7.5
Blended price per 1M (3:1)$0.10$3.00
Cheapest hostMistral · $0.1 / $0.1Mistral · $1.5 / $7.5
Hosts on OpenRouter11
Last tested26 Oct 202627 Oct 2026

Compare any two models →

Ministral 3 3B 2512 vs Mistral Medium 3.5: frequently asked questions

Is Ministral 3 3B 2512 better than Mistral Medium 3.5?
On accuracy they are statistically tied: Ministral 3 3B 2512 scored 26.2% and Mistral Medium 3.5 28.8% on the same 80 questions from open datasets. Similar accuracy; Ministral 3 3B 2512 costs less per question.
Which is cheaper, Ministral 3 3B 2512 or Mistral Medium 3.5?
Ministral 3 3B 2512 is cheaper: $0.00019 per question as billed, against $0.025. List prices: Ministral 3 3B 2512 $0.1 in / $0.1 out, Mistral Medium 3.5 $1.5 in / $7.5 out per million tokens.
Which is faster, Ministral 3 3B 2512 or Mistral Medium 3.5?
Ministral 3 3B 2512 is faster at 252 output tokens per second, against 145. Time to first token: 0.3 s for Ministral 3 3B 2512, 0.5 s for Mistral Medium 3.5.
Which has the larger context window, Ministral 3 3B 2512 or Mistral Medium 3.5?
Mistral Medium 3.5, with 262k tokens against 131k.