ResearchLLM Verifications Leaderboard

Data as of · 78 models, 80 questions · reviewed by Suhas Bhairav · methodology

Head to head · tested 27 Oct 2026

Gemma 4 26B A4B vs Gemma 4 31B: accuracy, speed and price

Gemma 4 31B is more accurate; Gemma 4 26B A4B is cheaper.

GoogleGemma 4 26B A4B15.0% score · #71$0.0011 per question172 tok/sGoogleGemma 4 31B30.0% score · #64$0.0014 per question58 tok/s

Verdict

Built from the measurements below

  • Gemma 4 31B is more accurate: 30.0% against 15.0% on the same 80 questions, a 15.0-point gap that is statistically significant.
  • Gemma 4 26B A4B is 1.3× cheaper per question as billed ($0.0011 vs $0.0014), reasoning tokens included.
  • Gemma 4 26B A4B generates text 2.9× faster: 172 tokens per second against 58.

Which should you choose?

Choose Gemma 4 26B A4B for faster streaming and more hosts to choose from on OpenRouter (15 against 13). Choose Gemma 4 31B for the most accurate answers of the two and the lower cost per correct answer ($0.0046 against $0.0072). The widest subject gap is in humanities & social science: Gemma 4 31B answered 5 of 9 correctly, Gemma 4 26B A4B 2 of 9. With so few questions per subject, treat this as a lead to test on your own prompts, not a result.

Accuracy gap -15.0 points (z = -2.27). A winner is called only when z is at least 1.96, the usual 95% threshold. Speed, latency and price need a 10% margin.

Head to head

Same questions, same prompt, same API

MeasureGemma 4 26B A4BGemma 4 31BEdge
Verification scoreHigher is better15.0%30.0%Gemma 4 31B
Cost per questionLower is better$0.0011$0.0014Gemma 4 26B A4B
Output speedHigher is better17258Gemma 4 26B A4B
Time to first tokenLower is better0.7 s0.6 sSimilar
End-to-end response timeLower is better4.8 s12.6 sGemma 4 26B A4B
Tokens per questionLower is better3,7223,307Gemma 4 31B
Context windowHigher is better262k262kSimilar

Side by side

Bars are scaled to the larger of the two values. The winner on each measure is marked in bold.

Every measure

Gemma 4 26B A4B first, Gemma 4 31B second

Verification scorehigher is better
Gemma 4 26B A4B15.0%
Gemma 4 31B30.0%
Cost per questionlower is better
Gemma 4 26B A4B$0.0011
Gemma 4 31B$0.0014
Output speedhigher is better
Gemma 4 26B A4B172
Gemma 4 31B58
Time to first tokenlower is better
Gemma 4 26B A4B0.7 s
Gemma 4 31B0.6 s
End-to-end response timelower is better
Gemma 4 26B A4B4.8 s
Gemma 4 31B12.6 s
Tokens per questionlower is better
Gemma 4 26B A4B3,722
Gemma 4 31B3,307
Context windowhigher is better
Gemma 4 26B A4B262k
Gemma 4 31B262k

Score vs. cost per question

Both models in color, every other model in grey

Most attractive quadrant0255075100$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Gemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BMuse WonderGrok 4.7o3gpt-oss-20bMinistral 3 3B 2512Nova Micro 1.0Phi 4Granite 4.2 8BHy3GLM 5.3 FlashSolar Pro 4Trinity Large ThinkingMiniMax M3Mistral Large 4Claude Opus 5.5GPT-6.1 SolGemini 4 ArgonGPT-5.4GPT-6 Lunagpt-oss-120bLlama 4 Maverick

Specifications and pricing

From OpenRouter's catalogue, plus the leaderboard's test dates

SpecificationGemma 4 26B A4BGemma 4 31B
CreatorGoogleGoogle
Released3 Apr 20262 Apr 2026
WeightsOpen weightsOpen weights
ReasoningYesYes
Inputimage, text, videoimage, text, video
Outputtexttext
Context window262k tokens262k tokens
Knowledge cutoff——
List price in / out per 1M$0.09 / $0.3$0.2 / $0.4
Blended price per 1M (3:1)$0.14$0.25
Cheapest hostDarkbloom · $0.042 / $0.22DeepInfra · $0.16 / $0.32
Hosts on OpenRouter1513
Last tested27 Oct 202627 Oct 2026

Compare any two models →

Gemma 4 26B A4B vs Gemma 4 31B: frequently asked questions

Is Gemma 4 26B A4B better than Gemma 4 31B?
Gemma 4 31B is more accurate: it answered 24 of 80 questions correctly (30.0%) against 12 of 80 (15.0%) for Gemma 4 26B A4B. Gemma 4 31B is more accurate; Gemma 4 26B A4B is cheaper.
Which is cheaper, Gemma 4 26B A4B or Gemma 4 31B?
Gemma 4 26B A4B is cheaper: $0.0011 per question as billed, against $0.0014. List prices: Gemma 4 26B A4B $0.09 in / $0.3 out, Gemma 4 31B $0.2 in / $0.4 out per million tokens.
Which is faster, Gemma 4 26B A4B or Gemma 4 31B?
Gemma 4 26B A4B is faster at 172 output tokens per second, against 58. Time to first token: 0.7 s for Gemma 4 26B A4B, 0.6 s for Gemma 4 31B.
Which has the larger context window, Gemma 4 26B A4B or Gemma 4 31B?
Both accept about the same amount of context: 262k and 262k tokens.