ResearchLLM Verifications Leaderboard

Data as of · 78 models, 80 questions · reviewed by Suhas Bhairav · methodology

Head to head · tested 27 Oct 2026

gpt-oss-20b vs Granite 4.0 Micro: accuracy, speed and price

gpt-oss-20b is more accurate; Granite 4.0 Micro is cheaper.

OpenAIgpt-oss-20b51.2% score · #46$0.000066 per question103 tok/sIBMGranite 4.0 Micro25.0% score · #69$0.000051 per question38 tok/s

Verdict

Built from the measurements below

  • gpt-oss-20b is more accurate: 51.2% against 25.0% on the same 80 questions, a 26.2-point gap that is statistically significant.
  • Granite 4.0 Micro is 1.3× cheaper per question as billed ($0.000051 vs $0.000066), reasoning tokens included.
  • gpt-oss-20b generates text 2.7× faster: 103 tokens per second against 38.

Which should you choose?

Choose gpt-oss-20b for the most accurate answers of the two, the lower cost per correct answer ($0.00013 against $0.0002), faster streaming and more hosts to choose from on OpenRouter (10 against 1). The widest subject gap is in economics: gpt-oss-20b answered 6 of 9 correctly, Granite 4.0 Micro 2 of 9. With so few questions per subject, treat this as a lead to test on your own prompts, not a result.

Accuracy gap +26.2 points (z = 3.42). A winner is called only when z is at least 1.96, the usual 95% threshold. Speed, latency and price need a 10% margin.

Head to head

Same questions, same prompt, same API

Measuregpt-oss-20bGranite 4.0 MicroEdge
Verification scoreHigher is better51.2%25.0%gpt-oss-20b
Cost per questionLower is better$0.000066$0.000051Granite 4.0 Micro
Output speedHigher is better10338gpt-oss-20b
Time to first tokenLower is better0.7 s0.7 sSimilar
End-to-end response timeLower is better4.0 s8.9 sgpt-oss-20b
Tokens per questionLower is better472403Granite 4.0 Micro
Context windowHigher is better131k131kSimilar

Side by side

Bars are scaled to the larger of the two values. The winner on each measure is marked in bold.

Every measure

gpt-oss-20b first, Granite 4.0 Micro second

Verification scorehigher is better
gpt-oss-20b51.2%
Granite 4.0 Micro25.0%
Cost per questionlower is better
gpt-oss-20b$0.000066
Granite 4.0 Micro$0.000051
Output speedhigher is better
gpt-oss-20b103
Granite 4.0 Micro38
Time to first tokenlower is better
gpt-oss-20b0.7 s
Granite 4.0 Micro0.7 s
End-to-end response timelower is better
gpt-oss-20b4.0 s
Granite 4.0 Micro8.9 s
Tokens per questionlower is better
gpt-oss-20b472
Granite 4.0 Micro403
Context windowhigher is better
gpt-oss-20b131k
Granite 4.0 Micro131k

Score vs. cost per question

Both models in color, every other model in grey

Most attractive quadrant0255075100$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Gemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BMuse WonderGrok 4.7o3gpt-oss-20bGranite 4.0 MicroNova Micro 1.0Phi 4Granite 4.2 8BHy3GLM 5.3 FlashSolar Pro 4Trinity Large ThinkingMiniMax M3Mistral Large 4Claude Opus 5.5GPT-6.1 SolGemini 4 ArgonGPT-5.4GPT-6 Lunagpt-oss-120bLlama 4 Maverick

Specifications and pricing

From OpenRouter's catalogue, plus the leaderboard's test dates

Specificationgpt-oss-20bGranite 4.0 Micro
CreatorOpenAIIBM
Released5 Aug 202520 Oct 2025
WeightsOpen weightsOpen weights
ReasoningYesNo
Inputtexttext
Outputtexttext
Context window131k tokens131k tokens
Knowledge cutoff30 Jun 2024—
List price in / out per 1M$0.018 / $0.09$0.017 / $0.112
Blended price per 1M (3:1)$0.04$0.04
Cheapest hostDarkbloom · $0.018 / $0.09Cloudflare · $0.017 / $0.112
Hosts on OpenRouter101
Last tested26 Oct 202626 Oct 2026

Compare any two models →

gpt-oss-20b vs Granite 4.0 Micro: frequently asked questions

Is gpt-oss-20b better than Granite 4.0 Micro?
gpt-oss-20b is more accurate: it answered 41 of 80 questions correctly (51.2%) against 20 of 80 (25.0%) for Granite 4.0 Micro. gpt-oss-20b is more accurate; Granite 4.0 Micro is cheaper.
Which is cheaper, gpt-oss-20b or Granite 4.0 Micro?
Granite 4.0 Micro is cheaper: $0.000051 per question as billed, against $0.000066. List prices: gpt-oss-20b $0.018 in / $0.09 out, Granite 4.0 Micro $0.017 in / $0.112 out per million tokens.
Which is faster, gpt-oss-20b or Granite 4.0 Micro?
gpt-oss-20b is faster at 103 output tokens per second, against 38. Time to first token: 0.7 s for gpt-oss-20b, 0.7 s for Granite 4.0 Micro.
Which has the larger context window, gpt-oss-20b or Granite 4.0 Micro?
Both accept about the same amount of context: 131k and 131k tokens.