ResearchLLM Verifications Leaderboard

Data as of · 78 models, 80 questions · reviewed by Suhas Bhairav · methodology

Head to head · tested 27 Oct 2026

Qwen3.8 2.4T A95B vs Qwen3.8 Max (0902): accuracy, speed and price

Qwen3.8 Max (0902) is more accurate and cheaper.

QwenQwen3.8 2.4T A95B57.5% score · #43$0.015 per question44 tok/sQwenQwen3.8 Max (0902)75.0% score · #15$0.011 per question46 tok/s

Verdict

Built from the measurements below

  • Qwen3.8 Max (0902) is more accurate: 75.0% against 57.5% on the same 80 questions, a 17.5-point gap that is statistically significant.
  • Qwen3.8 Max (0902) is 1.4× cheaper per question as billed ($0.011 vs $0.015), reasoning tokens included.
  • Output speed is similar (44 vs 46 tokens per second).
  • Qwen3.8 Max (0902) starts answering sooner: 1.2 s to the first token, against 3.1 s for Qwen3.8 2.4T A95B.

Which should you choose?

Choose Qwen3.8 2.4T A95B for open weights you can run yourself and more hosts to choose from on OpenRouter (5 against 1). Choose Qwen3.8 Max (0902) for the most accurate answers of the two, the lower cost per correct answer ($0.015 against $0.026) and a quicker first token. The widest subject gap is in law: Qwen3.8 Max (0902) answered 4 of 6 correctly, Qwen3.8 2.4T A95B 2 of 6. With so few questions per subject, treat this as a lead to test on your own prompts, not a result.

Accuracy gap -17.5 points (z = -2.34). A winner is called only when z is at least 1.96, the usual 95% threshold. Speed, latency and price need a 10% margin.

Head to head

Same questions, same prompt, same API

MeasureQwen3.8 2.4T A95BQwen3.8 Max (0902)Edge
Verification scoreHigher is better57.5%75.0%Qwen3.8 Max (0902)
Cost per questionLower is better$0.015$0.011Qwen3.8 Max (0902)
Output speedHigher is better4446Similar
Time to first tokenLower is better3.1 s1.2 sQwen3.8 Max (0902)
End-to-end response timeLower is better14.8 s12.2 sQwen3.8 Max (0902)
Tokens per questionLower is better2,4081,722Qwen3.8 Max (0902)
Context windowHigher is better1M1MSimilar

Side by side

Bars are scaled to the larger of the two values. The winner on each measure is marked in bold.

Every measure

Qwen3.8 2.4T A95B first, Qwen3.8 Max (0902) second

Verification scorehigher is better
Qwen3.8 2.4T A95B57.5%
Qwen3.8 Max (0902)75.0%
Cost per questionlower is better
Qwen3.8 2.4T A95B$0.015
Qwen3.8 Max (0902)$0.011
Output speedhigher is better
Qwen3.8 2.4T A95B44
Qwen3.8 Max (0902)46
Time to first tokenlower is better
Qwen3.8 2.4T A95B3.1 s
Qwen3.8 Max (0902)1.2 s
End-to-end response timelower is better
Qwen3.8 2.4T A95B14.8 s
Qwen3.8 Max (0902)12.2 s
Tokens per questionlower is better
Qwen3.8 2.4T A95B2,408
Qwen3.8 Max (0902)1,722
Context windowhigher is better
Qwen3.8 2.4T A95B1M
Qwen3.8 Max (0902)1M

Score vs. cost per question

Both models in color, every other model in grey

Most attractive quadrant0255075100$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Gemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BGrok 4.7o3gpt-oss-20bMinistral 3 3B 2512Nova Micro 1.0Phi 4Granite 4.2 8BHy3GLM 5.3 FlashSolar Pro 4Trinity Large ThinkingMiniMax M3Mistral Large 4Claude Opus 5.5GPT-6.1 SolGemini 4 ArgonGPT-6 Lunagpt-oss-120bLlama 4 MaverickQwen3.8 Max (0902)

Specifications and pricing

From OpenRouter's catalogue, plus the leaderboard's test dates

SpecificationQwen3.8 2.4T A95BQwen3.8 Max (0902)
CreatorQwenQwen
Released12 Aug 20263 Sept 2026
WeightsOpen weights—
ReasoningYesYes
Inputtexttext, image, video
Outputtexttext
Context window1M tokens1M tokens
Knowledge cutoff——
List price in / out per 1M$2 / $6$2 / $6
Blended price per 1M (3:1)$3.00$3.00
Cheapest hostNovita · $2 / $6Alibaba · $2 / $6
Hosts on OpenRouter51
Last tested27 Oct 202625 Oct 2026

Compare any two models →

Qwen3.8 2.4T A95B vs Qwen3.8 Max (0902): frequently asked questions

Is Qwen3.8 2.4T A95B better than Qwen3.8 Max (0902)?
Qwen3.8 Max (0902) is more accurate: it answered 60 of 80 questions correctly (75.0%) against 46 of 80 (57.5%) for Qwen3.8 2.4T A95B. Qwen3.8 Max (0902) is more accurate and cheaper.
Which is cheaper, Qwen3.8 2.4T A95B or Qwen3.8 Max (0902)?
Qwen3.8 Max (0902) is cheaper: $0.011 per question as billed, against $0.015. List prices: Qwen3.8 2.4T A95B $2 in / $6 out, Qwen3.8 Max (0902) $2 in / $6 out per million tokens.
Which is faster, Qwen3.8 2.4T A95B or Qwen3.8 Max (0902)?
Their output speed is similar: 44 and 46 tokens per second.
Which has the larger context window, Qwen3.8 2.4T A95B or Qwen3.8 Max (0902)?
Both accept about the same amount of context: 1M and 1M tokens.