ResearchLLM Verifications Leaderboard

Data as of · 78 models, 80 questions · reviewed by Suhas Bhairav · methodology

Head to head · tested 27 Oct 2026

Solar Mini 4 vs Solar Pro 4: accuracy, speed and price

Similar accuracy; Solar Mini 4 costs less per question.

UpstageSolar Mini 441.2% score · #54$0.00053 per question107 tok/sUpstageSolar Pro 445.0% score · #49$0.0018 per question91 tok/s

Verdict

Built from the measurements below

  • Accuracy is too close to call: Solar Mini 4 scored 41.2% and Solar Pro 4 45.0% on the same 80 questions, a gap within what chance alone could produce.
  • Solar Mini 4 is 3.5× cheaper per question as billed ($0.00053 vs $0.0018), reasoning tokens included.
  • Solar Mini 4 generates text 1.2× faster: 107 tokens per second against 91.
  • Solar Pro 4 starts answering sooner: 0.6 s to the first token, against 0.7 s for Solar Mini 4.

Which should you choose?

Choose Solar Mini 4 for the lower cost per correct answer ($0.0013 against $0.0041) and faster streaming. Choose Solar Pro 4 for a quicker first token. The widest subject gap is in medicine: Solar Pro 4 answered 5 of 11 correctly, Solar Mini 4 2 of 11. With so few questions per subject, treat this as a lead to test on your own prompts, not a result.

Accuracy gap -3.8 points (z = -0.48). A winner is called only when z is at least 1.96, the usual 95% threshold. Speed, latency and price need a 10% margin.

Head to head

Same questions, same prompt, same API

MeasureSolar Mini 4Solar Pro 4Edge
Verification scoreHigher is better41.2%45.0%Too close to call
Cost per questionLower is better$0.00053$0.0018Solar Mini 4
Output speedHigher is better10791Solar Mini 4
Time to first tokenLower is better0.7 s0.6 sSolar Pro 4
End-to-end response timeLower is better7.4 s8.3 sSolar Mini 4
Tokens per questionLower is better2,5522,952Solar Mini 4
Context windowHigher is better524k524kSimilar

Side by side

Bars are scaled to the larger of the two values. The winner on each measure is marked in bold.

Every measure

Solar Mini 4 first, Solar Pro 4 second

Verification scorehigher is better
Solar Mini 441.2%
Solar Pro 445.0%
Cost per questionlower is better
Solar Mini 4$0.00053
Solar Pro 4$0.0018
Output speedhigher is better
Solar Mini 4107
Solar Pro 491
Time to first tokenlower is better
Solar Mini 40.7 s
Solar Pro 40.6 s
End-to-end response timelower is better
Solar Mini 47.4 s
Solar Pro 48.3 s
Tokens per questionlower is better
Solar Mini 42,552
Solar Pro 42,952
Context windowhigher is better
Solar Mini 4524k
Solar Pro 4524k

Score vs. cost per question

Both models in color, every other model in grey

Most attractive quadrant0255075100$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Gemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BMuse WonderGrok 4.7o3gpt-oss-20bMinistral 3 3B 2512Nova Micro 1.0Phi 4Granite 4.2 8BHy3GLM 5.3 FlashSolar Pro 4Trinity Large ThinkingMiniMax M3Mistral Large 4Claude Opus 5.5GPT-6.1 SolGemini 4 ArgonGPT-5.4GPT-6 Lunagpt-oss-120bLlama 4 Maverick

Specifications and pricing

From OpenRouter's catalogue, plus the leaderboard's test dates

SpecificationSolar Mini 4Solar Pro 4
CreatorUpstageUpstage
Released23 Sept 202610 Aug 2026
Weights——
ReasoningYesYes
Inputtexttext
Outputtexttext
Context window524k tokens524k tokens
Knowledge cutoff——
List price in / out per 1M$0.05 / $0.2$0.15 / $0.6
Blended price per 1M (3:1)$0.09$0.26
Cheapest hostUpstage · $0.05 / $0.2Upstage · $0.15 / $0.6
Hosts on OpenRouter11
Last tested26 Oct 202626 Oct 2026

Compare any two models →

Solar Mini 4 vs Solar Pro 4: frequently asked questions

Is Solar Mini 4 better than Solar Pro 4?
On accuracy they are statistically tied: Solar Mini 4 scored 41.2% and Solar Pro 4 45.0% on the same 80 questions from open datasets. Similar accuracy; Solar Mini 4 costs less per question.
Which is cheaper, Solar Mini 4 or Solar Pro 4?
Solar Mini 4 is cheaper: $0.00053 per question as billed, against $0.0018. List prices: Solar Mini 4 $0.05 in / $0.2 out, Solar Pro 4 $0.15 in / $0.6 out per million tokens.
Which is faster, Solar Mini 4 or Solar Pro 4?
Solar Mini 4 is faster at 107 output tokens per second, against 91. Time to first token: 0.7 s for Solar Mini 4, 0.6 s for Solar Pro 4.
Which has the larger context window, Solar Mini 4 or Solar Pro 4?
Both accept about the same amount of context: 524k and 524k tokens.