ResearchLLM Verifications Leaderboard

Data as of · 78 models, 80 questions · reviewed by Suhas Bhairav · methodology

Head to head · tested 27 Oct 2026

Ministral 3 14B 2512 vs Mistral Large 4: accuracy, speed and price

Mistral Large 4 is more accurate; Ministral 3 14B 2512 is cheaper.

MistralMinistral 3 14B 251233.8% score · #61$0.00031 per question32 tok/sMistralMistral Large 450.0% score · #47$0.011 per question83 tok/s

Verdict

Built from the measurements below

  • Mistral Large 4 is more accurate: 50.0% against 33.8% on the same 80 questions, a 16.2-point gap that is statistically significant.
  • Ministral 3 14B 2512 is 36× cheaper per question as billed ($0.00031 vs $0.011), reasoning tokens included.
  • Mistral Large 4 generates text 2.6× faster: 83 tokens per second against 32.
  • Ministral 3 14B 2512 starts answering sooner: 0.6 s to the first token, against 1.1 s for Mistral Large 4.
  • Mistral Large 4 accepts more context: 1M tokens against 262k.

Which should you choose?

Choose Ministral 3 14B 2512 for the lower cost per correct answer ($0.00092 against $0.023), a quicker first token, shorter outputs (about 1,255 tokens per question against 2,613) and open weights you can run yourself. Choose Mistral Large 4 for the most accurate answers of the two, faster streaming and a 1M-token context window. The widest subject gap is in science: Mistral Large 4 answered 20 of 30 correctly, Ministral 3 14B 2512 8 of 30. With so few questions per subject, treat this as a lead to test on your own prompts, not a result.

Accuracy gap -16.2 points (z = -2.08). A winner is called only when z is at least 1.96, the usual 95% threshold. Speed, latency and price need a 10% margin.

Head to head

Same questions, same prompt, same API

MeasureMinistral 3 14B 2512Mistral Large 4Edge
Verification scoreHigher is better33.8%50.0%Mistral Large 4
Cost per questionLower is better$0.00031$0.011Ministral 3 14B 2512
Output speedHigher is better3283Mistral Large 4
Time to first tokenLower is better0.6 s1.1 sMinistral 3 14B 2512
End-to-end response timeLower is better12.7 s9.5 sMistral Large 4
Tokens per questionLower is better1,2552,613Ministral 3 14B 2512
Context windowHigher is better262k1MMistral Large 4

Side by side

Bars are scaled to the larger of the two values. The winner on each measure is marked in bold.

Every measure

Ministral 3 14B 2512 first, Mistral Large 4 second

Verification scorehigher is better
Ministral 3 14B 251233.8%
Mistral Large 450.0%
Cost per questionlower is better
Ministral 3 14B 2512$0.00031
Mistral Large 4$0.011
Output speedhigher is better
Ministral 3 14B 251232
Mistral Large 483
Time to first tokenlower is better
Ministral 3 14B 25120.6 s
Mistral Large 41.1 s
End-to-end response timelower is better
Ministral 3 14B 251212.7 s
Mistral Large 49.5 s
Tokens per questionlower is better
Ministral 3 14B 25121,255
Mistral Large 42,613
Context windowhigher is better
Ministral 3 14B 2512262k
Mistral Large 41M

Score vs. cost per question

Both models in color, every other model in grey

Most attractive quadrant0255075100$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Gemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BMuse WonderGrok 4.7o3gpt-oss-20bMinistral 3 3B 2512Nova Micro 1.0Phi 4Granite 4.2 8BHy3GLM 5.3 FlashSolar Pro 4Trinity Large ThinkingMiniMax M3Mistral Large 4Claude Opus 5.5GPT-6.1 SolGemini 4 ArgonGPT-5.4GPT-6 Lunagpt-oss-120bLlama 4 Maverick

Specifications and pricing

From OpenRouter's catalogue, plus the leaderboard's test dates

SpecificationMinistral 3 14B 2512Mistral Large 4
CreatorMistralMistral
Released2 Dec 20256 Oct 2026
WeightsOpen weights—
ReasoningNoYes
Inputtext, imagetext, image
Outputtexttext
Context window262k tokens1M tokens
Knowledge cutoff——
List price in / out per 1M$0.2 / $0.2$1.36 / $4.18
Blended price per 1M (3:1)$0.20$2.06
Cheapest hostMistral · $0.2 / $0.2Mistral · $1.36 / $4.18
Hosts on OpenRouter11
Last tested26 Oct 202626 Oct 2026

Compare any two models →

Ministral 3 14B 2512 vs Mistral Large 4: frequently asked questions

Is Ministral 3 14B 2512 better than Mistral Large 4?
Mistral Large 4 is more accurate: it answered 40 of 80 questions correctly (50.0%) against 27 of 80 (33.8%) for Ministral 3 14B 2512. Mistral Large 4 is more accurate; Ministral 3 14B 2512 is cheaper.
Which is cheaper, Ministral 3 14B 2512 or Mistral Large 4?
Ministral 3 14B 2512 is cheaper: $0.00031 per question as billed, against $0.011. List prices: Ministral 3 14B 2512 $0.2 in / $0.2 out, Mistral Large 4 $1.36 in / $4.18 out per million tokens.
Which is faster, Ministral 3 14B 2512 or Mistral Large 4?
Mistral Large 4 is faster at 83 output tokens per second, against 32. Time to first token: 0.6 s for Ministral 3 14B 2512, 1.1 s for Mistral Large 4.
Which has the larger context window, Ministral 3 14B 2512 or Mistral Large 4?
Mistral Large 4, with 1M tokens against 262k.