ResearchLLM Verifications Leaderboard

Data as of · 78 models, 80 questions · reviewed by Suhas Bhairav · methodology

Head to head · tested 27 Oct 2026

gpt-oss-120b vs MiniMax M3: accuracy, speed and price

Similar accuracy; gpt-oss-120b costs less per question.

OpenAIgpt-oss-120b58.8% score · #41$0.00013 per question82 tok/sMiniMaxMiniMax M357.5% score · #43$0.0026 per question121 tok/s

Verdict

Built from the measurements below

  • Accuracy is too close to call: gpt-oss-120b scored 58.8% and MiniMax M3 57.5% on the same 80 questions, a gap within what chance alone could produce.
  • gpt-oss-120b is 20× cheaper per question as billed ($0.00013 vs $0.0026), reasoning tokens included.
  • MiniMax M3 generates text 1.5× faster: 121 tokens per second against 82.
  • MiniMax M3 accepts more context: 1M tokens against 131k.

Which should you choose?

Choose gpt-oss-120b for the lower cost per correct answer ($0.00021 against $0.0045), shorter outputs (about 546 tokens per question against 2,129) and more hosts to choose from on OpenRouter (23 against 12). Choose MiniMax M3 for faster streaming and a 1M-token context window. The widest subject gap is in law: MiniMax M3 answered 3 of 6 correctly, gpt-oss-120b 1 of 6. With so few questions per subject, treat this as a lead to test on your own prompts, not a result.

Accuracy gap +1.3 points (z = 0.16). A winner is called only when z is at least 1.96, the usual 95% threshold. Speed, latency and price need a 10% margin.

Head to head

Same questions, same prompt, same API

Measuregpt-oss-120bMiniMax M3Edge
Verification scoreHigher is better58.8%57.5%Too close to call
Cost per questionLower is better$0.00013$0.0026gpt-oss-120b
Output speedHigher is better82121MiniMax M3
Time to first tokenLower is better0.5 s0.5 sSimilar
End-to-end response timeLower is better5.4 s4.2 sMiniMax M3
Tokens per questionLower is better5462,129gpt-oss-120b
Context windowHigher is better131k1MMiniMax M3

Side by side

Bars are scaled to the larger of the two values. The winner on each measure is marked in bold.

Every measure

gpt-oss-120b first, MiniMax M3 second

Verification scorehigher is better
gpt-oss-120b58.8%
MiniMax M357.5%
Cost per questionlower is better
gpt-oss-120b$0.00013
MiniMax M3$0.0026
Output speedhigher is better
gpt-oss-120b82
MiniMax M3121
Time to first tokenlower is better
gpt-oss-120b0.5 s
MiniMax M30.5 s
End-to-end response timelower is better
gpt-oss-120b5.4 s
MiniMax M34.2 s
Tokens per questionlower is better
gpt-oss-120b546
MiniMax M32,129
Context windowhigher is better
gpt-oss-120b131k
MiniMax M31M

Score vs. cost per question

Both models in color, every other model in grey

Most attractive quadrant0255075100$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Gemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BMuse WonderGrok 4.7o3gpt-oss-20bMinistral 3 3B 2512Nova Micro 1.0Phi 4Granite 4.2 8BHy3GLM 5.3 FlashSolar Pro 4Trinity Large ThinkingMiniMax M3Mistral Large 4Claude Opus 5.5GPT-6.1 SolGemini 4 ArgonGPT-5.4GPT-6 Lunagpt-oss-120bLlama 4 Maverick

Specifications and pricing

From OpenRouter's catalogue, plus the leaderboard's test dates

Specificationgpt-oss-120bMiniMax M3
CreatorOpenAIMiniMax
Released5 Aug 202531 May 2026
WeightsOpen weightsOpen weights
ReasoningYesYes
Inputtexttext, image, video
Outputtexttext
Context window131k tokens1M tokens
Knowledge cutoff30 Jun 2024—
List price in / out per 1M$0.15 / $0.6$0.3 / $1.2
Blended price per 1M (3:1)$0.26$0.52
Cheapest hostNear AI · $0.03 / $0.15DeepInfra · $0.224 / $0.88
Hosts on OpenRouter2312
Last tested25 Oct 202626 Oct 2026

Compare any two models →

gpt-oss-120b vs MiniMax M3: frequently asked questions

Is gpt-oss-120b better than MiniMax M3?
On accuracy they are statistically tied: gpt-oss-120b scored 58.8% and MiniMax M3 57.5% on the same 80 questions from open datasets. Similar accuracy; gpt-oss-120b costs less per question.
Which is cheaper, gpt-oss-120b or MiniMax M3?
gpt-oss-120b is cheaper: $0.00013 per question as billed, against $0.0026. List prices: gpt-oss-120b $0.15 in / $0.6 out, MiniMax M3 $0.3 in / $1.2 out per million tokens.
Which is faster, gpt-oss-120b or MiniMax M3?
MiniMax M3 is faster at 121 output tokens per second, against 82. Time to first token: 0.5 s for gpt-oss-120b, 0.5 s for MiniMax M3.
Which has the larger context window, gpt-oss-120b or MiniMax M3?
MiniMax M3, with 1M tokens against 131k.