ResearchLLM Verifications Leaderboard

Data as of · 78 models, 80 questions · reviewed by Suhas Bhairav · methodology

Head to head · tested 27 Oct 2026

Gemma 4 31B vs Trinity Large Thinking: accuracy, speed and price

Similar accuracy; Gemma 4 31B costs less per question.

GoogleGemma 4 31B30.0% score · #64$0.0014 per question58 tok/sArcee AITrinity Large Thinking28.8% score · #65$0.0025 per question329 tok/s

Verdict

Built from the measurements below

  • Accuracy is too close to call: Gemma 4 31B scored 30.0% and Trinity Large Thinking 28.8% on the same 80 questions, a gap within what chance alone could produce.
  • Gemma 4 31B is 1.8× cheaper per question as billed ($0.0014 vs $0.0025), reasoning tokens included.
  • Trinity Large Thinking generates text 5.6× faster: 329 tokens per second against 58.
  • Trinity Large Thinking starts answering sooner: 0.6 s to the first token, against 0.6 s for Gemma 4 31B.

Which should you choose?

Choose Gemma 4 31B for the lower cost per correct answer ($0.0046 against $0.0087), open weights you can run yourself and more hosts to choose from on OpenRouter (13 against 1). Choose Trinity Large Thinking for faster streaming and a quicker first token.

Accuracy gap +1.3 points (z = 0.17). A winner is called only when z is at least 1.96, the usual 95% threshold. Speed, latency and price need a 10% margin.

Head to head

Same questions, same prompt, same API

MeasureGemma 4 31BTrinity Large ThinkingEdge
Verification scoreHigher is better30.0%28.8%Too close to call
Cost per questionLower is better$0.0014$0.0025Gemma 4 31B
Output speedHigher is better58329Trinity Large Thinking
Time to first tokenLower is better0.6 s0.6 sTrinity Large Thinking
End-to-end response timeLower is better12.6 s2.7 sTrinity Large Thinking
Tokens per questionLower is better3,3073,043Similar
Context windowHigher is better262k262kSimilar

Side by side

Bars are scaled to the larger of the two values. The winner on each measure is marked in bold.

Every measure

Gemma 4 31B first, Trinity Large Thinking second

Verification scorehigher is better
Gemma 4 31B30.0%
Trinity Large Thinking28.8%
Cost per questionlower is better
Gemma 4 31B$0.0014
Trinity Large Thinking$0.0025
Output speedhigher is better
Gemma 4 31B58
Trinity Large Thinking329
Time to first tokenlower is better
Gemma 4 31B0.6 s
Trinity Large Thinking0.6 s
End-to-end response timelower is better
Gemma 4 31B12.6 s
Trinity Large Thinking2.7 s
Tokens per questionlower is better
Gemma 4 31B3,307
Trinity Large Thinking3,043
Context windowhigher is better
Gemma 4 31B262k
Trinity Large Thinking262k

Score vs. cost per question

Both models in color, every other model in grey

Most attractive quadrant0255075100$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Gemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BMuse WonderGrok 4.7o3gpt-oss-20bMinistral 3 3B 2512Nova Micro 1.0Phi 4Granite 4.2 8BHy3GLM 5.3 FlashSolar Pro 4Trinity Large ThinkingMiniMax M3Mistral Large 4Claude Opus 5.5GPT-6.1 SolGemini 4 ArgonGPT-5.4GPT-6 Lunagpt-oss-120bLlama 4 Maverick

Specifications and pricing

From OpenRouter's catalogue, plus the leaderboard's test dates

SpecificationGemma 4 31BTrinity Large Thinking
CreatorGoogleArcee AI
Released2 Apr 20261 Apr 2026
WeightsOpen weights—
ReasoningYesYes
Inputimage, text, videotext
Outputtexttext
Context window262k tokens262k tokens
Knowledge cutoff——
List price in / out per 1M$0.2 / $0.4$0.25 / $0.8
Blended price per 1M (3:1)$0.25$0.39
Cheapest hostDeepInfra · $0.16 / $0.32Arcee AI · $0.25 / $0.8
Hosts on OpenRouter131
Last tested27 Oct 202626 Oct 2026

Compare any two models →

Gemma 4 31B vs Trinity Large Thinking: frequently asked questions

Is Gemma 4 31B better than Trinity Large Thinking?
On accuracy they are statistically tied: Gemma 4 31B scored 30.0% and Trinity Large Thinking 28.8% on the same 80 questions from open datasets. Similar accuracy; Gemma 4 31B costs less per question.
Which is cheaper, Gemma 4 31B or Trinity Large Thinking?
Gemma 4 31B is cheaper: $0.0014 per question as billed, against $0.0025. List prices: Gemma 4 31B $0.2 in / $0.4 out, Trinity Large Thinking $0.25 in / $0.8 out per million tokens.
Which is faster, Gemma 4 31B or Trinity Large Thinking?
Trinity Large Thinking is faster at 329 output tokens per second, against 58. Time to first token: 0.6 s for Gemma 4 31B, 0.6 s for Trinity Large Thinking.
Which has the larger context window, Gemma 4 31B or Trinity Large Thinking?
Both accept about the same amount of context: 262k and 262k tokens.