ResearchLLM Verifications Leaderboard

Data as of · 78 models, 80 questions · reviewed by Suhas Bhairav · methodology

Head to head · tested 27 Oct 2026

MiniMax M3 vs MiniMax M3.1 Flash: accuracy, speed and price

Similar accuracy; MiniMax M3.1 Flash costs less per question.

MiniMaxMiniMax M357.5% score · #43$0.0026 per question121 tok/sMiniMaxMiniMax M3.1 Flash66.2% score · #31$0.00087 per question131 tok/s

Verdict

Built from the measurements below

  • Accuracy is too close to call: MiniMax M3 scored 57.5% and MiniMax M3.1 Flash 66.2% on the same 80 questions, a gap within what chance alone could produce.
  • MiniMax M3.1 Flash is 3.0× cheaper per question as billed ($0.00087 vs $0.0026), reasoning tokens included.
  • Output speed is similar (121 vs 131 tokens per second).

Which should you choose?

Choose MiniMax M3.1 Flash for the lower cost per correct answer ($0.0013 against $0.0045) and shorter outputs (about 1,376 tokens per question against 2,129). The widest subject gap is in economics: MiniMax M3.1 Flash answered 8 of 9 correctly, MiniMax M3 6 of 9. With so few questions per subject, treat this as a lead to test on your own prompts, not a result.

Accuracy gap -8.8 points (z = -1.14). A winner is called only when z is at least 1.96, the usual 95% threshold. Speed, latency and price need a 10% margin.

Head to head

Same questions, same prompt, same API

MeasureMiniMax M3MiniMax M3.1 FlashEdge
Verification scoreHigher is better57.5%66.2%Too close to call
Cost per questionLower is better$0.0026$0.00087MiniMax M3.1 Flash
Output speedHigher is better121131Similar
Time to first tokenLower is better0.5 s0.5 sSimilar
End-to-end response timeLower is better4.2 s4.2 sSimilar
Tokens per questionLower is better2,1291,376MiniMax M3.1 Flash
Context windowHigher is better1M1MSimilar

Side by side

Bars are scaled to the larger of the two values. The winner on each measure is marked in bold.

Every measure

MiniMax M3 first, MiniMax M3.1 Flash second

Verification scorehigher is better
MiniMax M357.5%
MiniMax M3.1 Flash66.2%
Cost per questionlower is better
MiniMax M3$0.0026
MiniMax M3.1 Flash$0.00087
Output speedhigher is better
MiniMax M3121
MiniMax M3.1 Flash131
Time to first tokenlower is better
MiniMax M30.5 s
MiniMax M3.1 Flash0.5 s
End-to-end response timelower is better
MiniMax M34.2 s
MiniMax M3.1 Flash4.2 s
Tokens per questionlower is better
MiniMax M32,129
MiniMax M3.1 Flash1,376
Context windowhigher is better
MiniMax M31M
MiniMax M3.1 Flash1M

Score vs. cost per question

Both models in color, every other model in grey

Most attractive quadrant0255075100$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Gemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BMuse WonderGrok 4.7o3gpt-oss-20bMinistral 3 3B 2512Nova Micro 1.0Phi 4Granite 4.2 8BHy3GLM 5.3 FlashSolar Pro 4Trinity Large ThinkingMiniMax M3Mistral Large 4Claude Opus 5.5GPT-6.1 SolGemini 4 ArgonGPT-5.4GPT-6 Lunagpt-oss-120bLlama 4 Maverick

Specifications and pricing

From OpenRouter's catalogue, plus the leaderboard's test dates

SpecificationMiniMax M3MiniMax M3.1 Flash
CreatorMiniMaxMiniMax
Released31 May 202619 Oct 2026
WeightsOpen weightsOpen weights
ReasoningYesYes
Inputtext, image, videotext, image, video
Outputtexttext
Context window1M tokens1M tokens
Knowledge cutoff——
List price in / out per 1M$0.3 / $1.2$0.15 / $0.6
Blended price per 1M (3:1)$0.52$0.26
Cheapest hostDeepInfra · $0.224 / $0.88GMICloud · $0.1425 / $0.57
Hosts on OpenRouter1211
Last tested26 Oct 202625 Oct 2026

Compare any two models →

MiniMax M3 vs MiniMax M3.1 Flash: frequently asked questions

Is MiniMax M3 better than MiniMax M3.1 Flash?
On accuracy they are statistically tied: MiniMax M3 scored 57.5% and MiniMax M3.1 Flash 66.2% on the same 80 questions from open datasets. Similar accuracy; MiniMax M3.1 Flash costs less per question.
Which is cheaper, MiniMax M3 or MiniMax M3.1 Flash?
MiniMax M3.1 Flash is cheaper: $0.00087 per question as billed, against $0.0026. List prices: MiniMax M3 $0.3 in / $1.2 out, MiniMax M3.1 Flash $0.15 in / $0.6 out per million tokens.
Which is faster, MiniMax M3 or MiniMax M3.1 Flash?
Their output speed is similar: 121 and 131 tokens per second.
Which has the larger context window, MiniMax M3 or MiniMax M3.1 Flash?
Both accept about the same amount of context: 1M and 1M tokens.