ResearchLLM Verifications Leaderboard

Data as of · 78 models, 80 questions · reviewed by Suhas Bhairav · methodology

Provider

Anthropic AI models

4 models tested, compared with 74 models from other labs.

Best verification score85.0Claude Opus 5.5 · #1 of 78Best output speed192Claude Haiku 5.5 · #8 of 78Best time to first token0.7 sClaude Haiku 5.5 · #32 of 78Best cost per question$0.00048Claude Haiku 5.5 · #15 of 78
Anthropic#1Claude Opus 5.585.0% verification score129 tok/s2.3 s first token$0.015 / questionAnthropic#5Claude Fable 5.181.2% verification score70 tok/s2.1 s first token$0.016 / questionAnthropic#7Claude Sonnet 5.578.8% verification score126 tok/s0.7 s first token$0.0054 / questionAnthropic#26Claude Haiku 5.568.8% verification score192 tok/s0.7 s first token$0.00048 / question

Score vs. cost per question

Anthropic models in color, every other model in grey

Most attractive quadrant0255075100$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Gemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BMuse WonderGrok 4.7o3gpt-oss-20bMinistral 3 3B 2512Nova Micro 1.0Phi 4Granite 4.2 8BHy3GLM 5.3 FlashSolar Pro 4Trinity Large ThinkingMiniMax M3Mistral Large 4Claude Opus 5.5GPT-6.1 SolGemini 4 ArgonGPT-5.4GPT-6 Lunagpt-oss-120bLlama 4 Maverick

Output speed vs. cost per question

Anthropic models in color, every other model in grey

Most attractive quadrant0200400600800$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Output speed (tok/s) →Nemotron 3.5 Super VLQwen3.5 397B A17BMuse WonderGrok 4.7o3gpt-oss-20bMinistral 3 3B 2512Nova Micro 1.0Trinity Large ThinkingGemini 3.5 Flash LiteMuse Spark OpenClaude Haiku 5.5GPT-6 Luna

Verification score

Anthropic models highlighted against every model in this run · higher is better

  1. 1Claude Opus 5.585.0
  2. 2Gemini 4 Argon83.8
  3. 3GPT-5.3-Codex82.5
  4. 3Gemini 3.8 Flash82.5
  5. 5Claude Fable 5.181.2
  6. 6Grok 4.780.0
  7. 7Muse Wonder78.8
  8. 7Claude Sonnet 5.578.8
  9. 9Gemini 3.1 Pro Preview77.5
  10. 9Muse Spark Open77.5
  11. 26Claude Haiku 5.568.8

61 more models · see the full leaderboard

6 of 78 tested models have no verification score

Output speed

Anthropic models highlighted against every model in this run · higher is better

  1. 1Nemotron 3.5 Super VL715
  2. 2Gemini 3.5 Flash Lite409
  3. 3Trinity Large Thinking329
  4. 4Ministral 3 3B 2512252
  5. 5Qwen3.5 397B A17B240
  6. 6Inkling Small233
  7. 7Muse Spark Open220
  8. 8Claude Haiku 5.5192
  9. 9Nova Micro 1.0180
  10. 10Muse Wonder175
  11. 24Claude Opus 5.5129
  12. 25Claude Sonnet 5.5126
  13. 49Claude Fable 5.170

59 more models · see the full leaderboard

6 of 78 tested models have no output speed

Time to first token

Anthropic models highlighted against every model in this run · lower is better

  1. 1Ministral 3 3B 25120.3 s
  2. 2Ministral 3 8B 25120.3 s
  3. 3Hermes 4 405B0.3 s
  4. 4Kimi K2.7 Code0.4 s
  5. 5MiMo-V2.6-Flash0.4 s
  6. 6Qwen3.6 35B A3B0.4 s
  7. 7Qwen3 Coder Next0.4 s
  8. 8Mistral Medium 3.50.5 s
  9. 9Phi 40.5 s
  10. 10Nova Micro 1.00.5 s
  11. 32Claude Haiku 5.50.7 s
  12. 38Claude Sonnet 5.50.7 s
  13. 63Claude Fable 5.12.1 s
  14. 66Claude Opus 5.52.3 s

60 more models · see the full leaderboard

4 of 78 tested models have no time to first token

Cost per question

Anthropic models highlighted against every model in this run · lower is better

  1. 1Granite 4.0 Micro$0.000051
  2. 2gpt-oss-20b$0.000066
  3. 3Granite 4.2 8B$0.000077
  4. 4Nova Micro 1.0$0.000087
  5. 5Mercury 2.5$0.00011
  6. 6Phi 4$0.00012
  7. 7gpt-oss-120b$0.00013
  8. 8GLM 5.3 Flash$0.00015
  9. 9Ministral 3 3B 2512$0.00019
  10. 10GPT-6 Luna$0.00025
  11. 15Claude Haiku 5.5$0.00048
  12. 51Claude Sonnet 5.5$0.0054
  13. 66Claude Opus 5.5$0.015
  14. 68Claude Fable 5.1$0.016

58 more models · see the full leaderboard

6 of 78 tested models have no cost per question
  • LFM2.5-2.6B: no verification score (80 of 80 questions failed on the host's side)
  • Ling 3.0 Flash VL: no verification score (not yet run on the current question suite)
  • Qwen3.5-122B-A10B: no verification score (not yet run on the current question suite)
  • Qwen3 Next 80B A3B Thinking: no verification score (not yet run on the current question suite)
  • Nova Premier 1.0: no verification score (not yet run on the current question suite)
  • GPT-5.5 Pro: no verification score (not yet run on the current question suite)

End-to-end response time

Anthropic models highlighted against every model in this run · lower is better

  1. 1Nemotron 3.5 Super VL1.5 s
  2. 2Ministral 3 3B 25121.6 s
  3. 3Nova Micro 1.02.1 s
  4. 4Trinity Large Thinking2.7 s
  5. 5Gemini 3.5 Flash Lite2.8 s
  6. 6DeepSeek V4 Flash Vision Exp3.2 s
  7. 7Muse Spark Open3.2 s
  8. 8GLM 5.33.4 s
  9. 9Ministral 3 8B 25123.5 s
  10. 10Qwen3.5 397B A17B3.5 s
  11. 13Claude Haiku 5.53.9 s
  12. 34Claude Sonnet 5.56.2 s
  13. 42Claude Opus 5.57.6 s
  14. 60Claude Fable 5.111.0 s

60 more models · see the full leaderboard

4 of 78 tested models have no end-to-end response time

All Anthropic results

Leaderboard
#
1Claude Opus 5.5
Anthropic · served by Claude Platform on AWS
85.068 / 801292.3 s$0.015$4 / $201M
2Claude Fable 5.1
Anthropic · served by Anthropic
81.265 / 80702.1 s$0.016$10 / $501M
3Claude Sonnet 5.5
Anthropic · served by Claude Platform on AWS
78.863 / 801260.7 s$0.0054$2 / $101M
4Claude Haiku 5.5
Anthropic · served by Claude Platform on AWS
68.855 / 801920.7 s$0.00048$0.1 / $0.51M

Anthropic: quick answers

What is the best Anthropic model?
Claude Opus 5.5 has the highest verification score of the Anthropic models the leaderboard tested: 85.0% (68 of 80 correct) in the 2026-10-27 run.
What is the fastest Anthropic model?
Claude Haiku 5.5 is the fastest Anthropic model the leaderboard tested, at a median 192 output tokens per second.
What is the cheapest Anthropic model?
Claude Haiku 5.5 has the lowest billed cost per question of the Anthropic models the leaderboard tested: $0.00048.
Which Anthropic models do you test?
Claude Opus 5.5, Claude Fable 5.1, Claude Sonnet 5.5, Claude Haiku 5.5.