ResearchLLM Verifications Leaderboard

Data as of · 78 models, 80 questions · reviewed by Suhas Bhairav · methodology

Head to head · tested 27 Oct 2026

Inkling Small vs MiniMax M3.1 Flash: accuracy, speed and price

Similar accuracy; Inkling Small costs less per question.

Thinking MachinesInkling Small67.5% score · #28$0.00047 per question233 tok/sMiniMaxMiniMax M3.1 Flash66.2% score · #31$0.00087 per question131 tok/s

Verdict

Built from the measurements below

  • Accuracy is too close to call: Inkling Small scored 67.5% and MiniMax M3.1 Flash 66.2% on the same 80 questions, a gap within what chance alone could produce.
  • Inkling Small is 1.9× cheaper per question as billed ($0.00047 vs $0.00087), reasoning tokens included.
  • Inkling Small generates text 1.8× faster: 233 tokens per second against 131.
  • MiniMax M3.1 Flash accepts more context: 1M tokens against 524k.

Which should you choose?

Choose Inkling Small for the lower cost per correct answer ($0.00069 against $0.0013), faster streaming and shorter outputs (about 273 tokens per question against 1,376). Choose MiniMax M3.1 Flash for a 1M-token context window and more hosts to choose from on OpenRouter (11 against 1). The widest subject gap is in law: Inkling Small answered 4 of 6 correctly, MiniMax M3.1 Flash 2 of 6. With so few questions per subject, treat this as a lead to test on your own prompts, not a result.

Accuracy gap +1.3 points (z = 0.17). A winner is called only when z is at least 1.96, the usual 95% threshold. Speed, latency and price need a 10% margin.

Head to head

Same questions, same prompt, same API

MeasureInkling SmallMiniMax M3.1 FlashEdge
Verification scoreHigher is better67.5%66.2%Too close to call
Cost per questionLower is better$0.00047$0.00087Inkling Small
Output speedHigher is better233131Inkling Small
Time to first tokenLower is better0.5 s0.5 sSimilar
End-to-end response timeLower is better3.6 s4.2 sInkling Small
Tokens per questionLower is better2731,376Inkling Small
Context windowHigher is better524k1MMiniMax M3.1 Flash

Side by side

Bars are scaled to the larger of the two values. The winner on each measure is marked in bold.

Every measure

Inkling Small first, MiniMax M3.1 Flash second

Verification scorehigher is better
Inkling Small67.5%
MiniMax M3.1 Flash66.2%
Cost per questionlower is better
Inkling Small$0.00047
MiniMax M3.1 Flash$0.00087
Output speedhigher is better
Inkling Small233
MiniMax M3.1 Flash131
Time to first tokenlower is better
Inkling Small0.5 s
MiniMax M3.1 Flash0.5 s
End-to-end response timelower is better
Inkling Small3.6 s
MiniMax M3.1 Flash4.2 s
Tokens per questionlower is better
Inkling Small273
MiniMax M3.1 Flash1,376
Context windowhigher is better
Inkling Small524k
MiniMax M3.1 Flash1M

Score vs. cost per question

Both models in color, every other model in grey

Most attractive quadrant0255075100$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Gemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BMuse WonderGrok 4.7o3gpt-oss-20bMinistral 3 3B 2512Nova Micro 1.0Phi 4Granite 4.2 8BHy3GLM 5.3 FlashSolar Pro 4Trinity Large ThinkingMiniMax M3Mistral Large 4Claude Opus 5.5GPT-6.1 SolGemini 4 ArgonGPT-5.4GPT-6 Lunagpt-oss-120bLlama 4 Maverick

Specifications and pricing

From OpenRouter's catalogue, plus the leaderboard's test dates

SpecificationInkling SmallMiniMax M3.1 Flash
CreatorThinking MachinesMiniMax
Released30 Jul 202619 Oct 2026
WeightsOpen weightsOpen weights
ReasoningYesYes
Inputtext, image, audiotext, image, video
Outputtexttext
Context window524k tokens1M tokens
Knowledge cutoff——
List price in / out per 1M$0.45 / $1.2$0.15 / $0.6
Blended price per 1M (3:1)$0.64$0.26
Cheapest hostDeepInfra · $0.45 / $1.2GMICloud · $0.1425 / $0.57
Hosts on OpenRouter111
Last tested26 Oct 202625 Oct 2026

Compare any two models →

Inkling Small vs MiniMax M3.1 Flash: frequently asked questions

Is Inkling Small better than MiniMax M3.1 Flash?
On accuracy they are statistically tied: Inkling Small scored 67.5% and MiniMax M3.1 Flash 66.2% on the same 80 questions from open datasets. Similar accuracy; Inkling Small costs less per question.
Which is cheaper, Inkling Small or MiniMax M3.1 Flash?
Inkling Small is cheaper: $0.00047 per question as billed, against $0.00087. List prices: Inkling Small $0.45 in / $1.2 out, MiniMax M3.1 Flash $0.15 in / $0.6 out per million tokens.
Which is faster, Inkling Small or MiniMax M3.1 Flash?
Inkling Small is faster at 233 output tokens per second, against 131. Time to first token: 0.5 s for Inkling Small, 0.5 s for MiniMax M3.1 Flash.
Which has the larger context window, Inkling Small or MiniMax M3.1 Flash?
MiniMax M3.1 Flash, with 1M tokens against 524k.