ResearchLLM Verifications Leaderboard

Data as of · 78 models, 80 questions · reviewed by Suhas Bhairav · methodology

Head to head · tested 27 Oct 2026

LongCat 2.0 vs Solar Pro 4: accuracy, speed and price

Similar accuracy; Solar Pro 4 costs less per question.

MeituanLongCat 2.048.8% score · #48$0.0032 per question67 tok/sUpstageSolar Pro 445.0% score · #49$0.0018 per question91 tok/s

Verdict

Built from the measurements below

  • Accuracy is too close to call: LongCat 2.0 scored 48.8% and Solar Pro 4 45.0% on the same 80 questions, a gap within what chance alone could produce.
  • Solar Pro 4 is 1.8× cheaper per question as billed ($0.0018 vs $0.0032), reasoning tokens included.
  • Solar Pro 4 generates text 1.4× faster: 91 tokens per second against 67.
  • Solar Pro 4 starts answering sooner: 0.6 s to the first token, against 1.4 s for LongCat 2.0.
  • LongCat 2.0 accepts more context: 1M tokens against 524k.

Which should you choose?

Choose LongCat 2.0 for open weights you can run yourself and a 1M-token context window. Choose Solar Pro 4 for the lower cost per correct answer ($0.0041 against $0.0066), faster streaming and a quicker first token. The widest subject gap is in economics: LongCat 2.0 answered 7 of 9 correctly, Solar Pro 4 5 of 9. With so few questions per subject, treat this as a lead to test on your own prompts, not a result.

Accuracy gap +3.7 points (z = 0.48). A winner is called only when z is at least 1.96, the usual 95% threshold. Speed, latency and price need a 10% margin.

Head to head

Same questions, same prompt, same API

MeasureLongCat 2.0Solar Pro 4Edge
Verification scoreHigher is better48.8%45.0%Too close to call
Cost per questionLower is better$0.0032$0.0018Solar Pro 4
Output speedHigher is better6791Solar Pro 4
Time to first tokenLower is better1.4 s0.6 sSolar Pro 4
End-to-end response timeLower is better10.0 s8.3 sSolar Pro 4
Tokens per questionLower is better2,6002,952LongCat 2.0
Context windowHigher is better1M524kLongCat 2.0

Side by side

Bars are scaled to the larger of the two values. The winner on each measure is marked in bold.

Every measure

LongCat 2.0 first, Solar Pro 4 second

Verification scorehigher is better
LongCat 2.048.8%
Solar Pro 445.0%
Cost per questionlower is better
LongCat 2.0$0.0032
Solar Pro 4$0.0018
Output speedhigher is better
LongCat 2.067
Solar Pro 491
Time to first tokenlower is better
LongCat 2.01.4 s
Solar Pro 40.6 s
End-to-end response timelower is better
LongCat 2.010.0 s
Solar Pro 48.3 s
Tokens per questionlower is better
LongCat 2.02,600
Solar Pro 42,952
Context windowhigher is better
LongCat 2.01M
Solar Pro 4524k

Score vs. cost per question

Both models in color, every other model in grey

Most attractive quadrant0255075100$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Gemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BMuse WonderGrok 4.7o3gpt-oss-20bMinistral 3 3B 2512Nova Micro 1.0Mercury 2.5Phi 4Granite 4.2 8BGLM 5.3 FlashTrinity Large ThinkingMiniMax M3LongCat 2.0Mistral Large 4Claude Opus 5.5GPT-6.1 SolGemini 4 ArgonGPT-5.4GPT-6 Lunagpt-oss-120b

Specifications and pricing

From OpenRouter's catalogue, plus the leaderboard's test dates

SpecificationLongCat 2.0Solar Pro 4
CreatorMeituanUpstage
Released20 Jul 202610 Aug 2026
WeightsOpen weights—
ReasoningYesYes
Inputtexttext
Outputtexttext
Context window1M tokens524k tokens
Knowledge cutoff——
List price in / out per 1M$0.3 / $1.2$0.15 / $0.6
Blended price per 1M (3:1)$0.52$0.26
Cheapest hostAtlasCloud · $0.3 / $1.2Upstage · $0.15 / $0.6
Hosts on OpenRouter11
Last tested26 Oct 202626 Oct 2026

Compare any two models →

LongCat 2.0 vs Solar Pro 4: frequently asked questions

Is LongCat 2.0 better than Solar Pro 4?
On accuracy they are statistically tied: LongCat 2.0 scored 48.8% and Solar Pro 4 45.0% on the same 80 questions from open datasets. Similar accuracy; Solar Pro 4 costs less per question.
Which is cheaper, LongCat 2.0 or Solar Pro 4?
Solar Pro 4 is cheaper: $0.0018 per question as billed, against $0.0032. List prices: LongCat 2.0 $0.3 in / $1.2 out, Solar Pro 4 $0.15 in / $0.6 out per million tokens.
Which is faster, LongCat 2.0 or Solar Pro 4?
Solar Pro 4 is faster at 91 output tokens per second, against 67. Time to first token: 1.4 s for LongCat 2.0, 0.6 s for Solar Pro 4.
Which has the larger context window, LongCat 2.0 or Solar Pro 4?
LongCat 2.0, with 1M tokens against 524k.