ResearchLLM Verifications Leaderboard

Data as of · 78 models, 80 questions · reviewed by Suhas Bhairav · methodology

Head to head · tested 27 Oct 2026

Command A vs Mistral Large 4: accuracy, speed and price

Similar accuracy; Command A costs less per question.

CohereCommand A45.0% score · #49$0.007 per question7 tok/sMistralMistral Large 450.0% score · #47$0.011 per question83 tok/s

Verdict

Built from the measurements below

  • Accuracy is too close to call: Command A scored 45.0% and Mistral Large 4 50.0% on the same 80 questions, a gap within what chance alone could produce.
  • Command A is 1.6× cheaper per question as billed ($0.007 vs $0.011), reasoning tokens included.
  • Mistral Large 4 generates text 12× faster: 83 tokens per second against 7.
  • Mistral Large 4 starts answering sooner: 1.1 s to the first token, against 1.8 s for Command A.
  • Mistral Large 4 accepts more context: 1M tokens against 256k.

Which should you choose?

Choose Command A for the lower cost per correct answer ($0.015 against $0.023), shorter outputs (about 616 tokens per question against 2,613) and open weights you can run yourself. Choose Mistral Large 4 for faster streaming, a quicker first token and a 1M-token context window. The widest subject gap is in medicine: Command A answered 6 of 11 correctly, Mistral Large 4 2 of 11. With so few questions per subject, treat this as a lead to test on your own prompts, not a result.

Accuracy gap -5.0 points (z = -0.63). A winner is called only when z is at least 1.96, the usual 95% threshold. Speed, latency and price need a 10% margin.

Head to head

Same questions, same prompt, same API

MeasureCommand AMistral Large 4Edge
Verification scoreHigher is better45.0%50.0%Too close to call
Cost per questionLower is better$0.007$0.011Command A
Output speedHigher is better783Mistral Large 4
Time to first tokenLower is better1.8 s1.1 sMistral Large 4
End-to-end response timeLower is better53.4 s9.5 sMistral Large 4
Tokens per questionLower is better6162,613Command A
Context windowHigher is better256k1MMistral Large 4

Side by side

Bars are scaled to the larger of the two values. The winner on each measure is marked in bold.

Every measure

Command A first, Mistral Large 4 second

Verification scorehigher is better
Command A45.0%
Mistral Large 450.0%
Cost per questionlower is better
Command A$0.007
Mistral Large 4$0.011
Output speedhigher is better
Command A7
Mistral Large 483
Time to first tokenlower is better
Command A1.8 s
Mistral Large 41.1 s
End-to-end response timelower is better
Command A53.4 s
Mistral Large 49.5 s
Tokens per questionlower is better
Command A616
Mistral Large 42,613
Context windowhigher is better
Command A256k
Mistral Large 41M

Score vs. cost per question

Both models in color, every other model in grey

Most attractive quadrant0255075100$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Gemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BMuse WonderGrok 4.7o3gpt-oss-20bMinistral 3 3B 2512Nova Micro 1.0Phi 4Granite 4.2 8BHy3GLM 5.3 FlashSolar Pro 4Trinity Large ThinkingMiniMax M3Mistral Large 4Claude Opus 5.5GPT-6.1 SolGemini 4 ArgonGPT-5.4GPT-6 Lunagpt-oss-120bLlama 4 Maverick

Specifications and pricing

From OpenRouter's catalogue, plus the leaderboard's test dates

SpecificationCommand AMistral Large 4
CreatorCohereMistral
Released13 Mar 20256 Oct 2026
WeightsOpen weights—
ReasoningNoYes
Inputtexttext, image
Outputtexttext
Context window256k tokens1M tokens
Knowledge cutoff31 Aug 2024—
List price in / out per 1M$2.5 / $10$1.36 / $4.18
Blended price per 1M (3:1)$4.38$2.06
Cheapest hostCohere · $2.5 / $10Mistral · $1.36 / $4.18
Hosts on OpenRouter11
Last tested27 Oct 202626 Oct 2026

Compare any two models →

Command A vs Mistral Large 4: frequently asked questions

Is Command A better than Mistral Large 4?
On accuracy they are statistically tied: Command A scored 45.0% and Mistral Large 4 50.0% on the same 80 questions from open datasets. Similar accuracy; Command A costs less per question.
Which is cheaper, Command A or Mistral Large 4?
Command A is cheaper: $0.007 per question as billed, against $0.011. List prices: Command A $2.5 in / $10 out, Mistral Large 4 $1.36 in / $4.18 out per million tokens.
Which is faster, Command A or Mistral Large 4?
Mistral Large 4 is faster at 83 output tokens per second, against 7. Time to first token: 1.8 s for Command A, 1.1 s for Mistral Large 4.
Which has the larger context window, Command A or Mistral Large 4?
Mistral Large 4, with 1M tokens against 256k.