ResearchLLM Verifications Leaderboard

Data as of · 78 models, 80 questions · reviewed by Suhas Bhairav · methodology

Provider

DeepSeek AI models

3 models tested, compared with 75 models from other labs.

Best verification score73.8DeepSeek V4.1 Flash 1017 · #18 of 78Best output speed170DeepSeek V4 Flash Vision Exp · #13 of 78Best time to first token0.7 sDeepSeek V4 Flash Vision Exp · #39 of 78Best cost per question$0.00091DeepSeek V4.1 Flash 1017 · #24 of 78
DeepSeek#18DeepSeek V4.1 Flash 101773.8% verification score57 tok/s0.9 s first token$0.00091 / questionDeepSeek#24DeepSeek V4 Flash Vision Exp71.2% verification score170 tok/s0.7 s first token$0.0011 / questionDeepSeek#24DeepSeek V4 Pro 081371.2% verification score56 tok/s0.8 s first token$0.0036 / question

Score vs. cost per question

DeepSeek models in color, every other model in grey

Most attractive quadrant0255075100$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Gemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BMuse WonderGrok 4.7o3gpt-oss-20bMinistral 3 3B 2512Nova Micro 1.0Phi 4Granite 4.2 8BHy3GLM 5.3 FlashSolar Pro 4Trinity Large ThinkingMiniMax M3Mistral Large 4Claude Opus 5.5DeepSeek V4.1 Flash 1017Gemini 4 ArgonGPT-5.4gpt-oss-120bLlama 4 Maverick

Output speed vs. cost per question

DeepSeek models in color, every other model in grey

Most attractive quadrant0200400600800$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Output speed (tok/s) →Nemotron 3.5 Super VLQwen3.5 397B A17BMuse WonderGrok 4.7o3gpt-oss-20bMinistral 3 3B 2512Nova Micro 1.0Trinity Large ThinkingInkling SmallGemini 3.5 Flash LiteMuse Spark OpenGPT-6 Luna

Verification score

DeepSeek models highlighted against every model in this run · higher is better

  1. 1Claude Opus 5.585.0
  2. 2Gemini 4 Argon83.8
  3. 3GPT-5.3-Codex82.5
  4. 3Gemini 3.8 Flash82.5
  5. 5Claude Fable 5.181.2
  6. 6Grok 4.780.0
  7. 7Muse Wonder78.8
  8. 7Claude Sonnet 5.578.8
  9. 9Gemini 3.1 Pro Preview77.5
  10. 9Muse Spark Open77.5
  11. 18DeepSeek V4.1 Flash 101773.8
  12. 24DeepSeek V4 Flash Vision Exp71.2
  13. 24DeepSeek V4 Pro 081371.2

59 more models · see the full leaderboard

6 of 78 tested models have no verification score

Output speed

DeepSeek models highlighted against every model in this run · higher is better

  1. 1Nemotron 3.5 Super VL715
  2. 2Gemini 3.5 Flash Lite409
  3. 3Trinity Large Thinking329
  4. 4Ministral 3 3B 2512252
  5. 5Qwen3.5 397B A17B240
  6. 6Inkling Small233
  7. 7Muse Spark Open220
  8. 8Claude Haiku 5.5192
  9. 9Nova Micro 1.0180
  10. 10Muse Wonder175
  11. 13DeepSeek V4 Flash Vision Exp170
  12. 56DeepSeek V4.1 Flash 101757
  13. 57DeepSeek V4 Pro 081356

59 more models · see the full leaderboard

6 of 78 tested models have no output speed

Time to first token

DeepSeek models highlighted against every model in this run · lower is better

  1. 1Ministral 3 3B 25120.3 s
  2. 2Ministral 3 8B 25120.3 s
  3. 3Hermes 4 405B0.3 s
  4. 4Kimi K2.7 Code0.4 s
  5. 5MiMo-V2.6-Flash0.4 s
  6. 6Qwen3.6 35B A3B0.4 s
  7. 7Qwen3 Coder Next0.4 s
  8. 8Mistral Medium 3.50.5 s
  9. 9Phi 40.5 s
  10. 10Nova Micro 1.00.5 s
  11. 39DeepSeek V4 Flash Vision Exp0.7 s
  12. 42DeepSeek V4 Pro 08130.8 s
  13. 43DeepSeek V4.1 Flash 10170.9 s

61 more models · see the full leaderboard

4 of 78 tested models have no time to first token

Cost per question

DeepSeek models highlighted against every model in this run · lower is better

  1. 1Granite 4.0 Micro$0.000051
  2. 2gpt-oss-20b$0.000066
  3. 3Granite 4.2 8B$0.000077
  4. 4Nova Micro 1.0$0.000087
  5. 5Mercury 2.5$0.00011
  6. 6Phi 4$0.00012
  7. 7gpt-oss-120b$0.00013
  8. 8GLM 5.3 Flash$0.00015
  9. 9Ministral 3 3B 2512$0.00019
  10. 10GPT-6 Luna$0.00025
  11. 24DeepSeek V4.1 Flash 1017$0.00091
  12. 26DeepSeek V4 Flash Vision Exp$0.0011
  13. 44DeepSeek V4 Pro 0813$0.0036

59 more models · see the full leaderboard

6 of 78 tested models have no cost per question
  • LFM2.5-2.6B: no verification score (80 of 80 questions failed on the host's side)
  • Ling 3.0 Flash VL: no verification score (not yet run on the current question suite)
  • Qwen3.5-122B-A10B: no verification score (not yet run on the current question suite)
  • Qwen3 Next 80B A3B Thinking: no verification score (not yet run on the current question suite)
  • Nova Premier 1.0: no verification score (not yet run on the current question suite)
  • GPT-5.5 Pro: no verification score (not yet run on the current question suite)

End-to-end response time

DeepSeek models highlighted against every model in this run · lower is better

  1. 1Nemotron 3.5 Super VL1.5 s
  2. 2Ministral 3 3B 25121.6 s
  3. 3Nova Micro 1.02.1 s
  4. 4Trinity Large Thinking2.7 s
  5. 5Gemini 3.5 Flash Lite2.8 s
  6. 6DeepSeek V4 Flash Vision Exp3.2 s
  7. 7Muse Spark Open3.2 s
  8. 8GLM 5.33.4 s
  9. 9Ministral 3 8B 25123.5 s
  10. 10Qwen3.5 397B A17B3.5 s
  11. 37DeepSeek V4.1 Flash 10177.3 s
  12. 57DeepSeek V4 Pro 081310.1 s

62 more models · see the full leaderboard

4 of 78 tested models have no end-to-end response time

DeepSeek: quick answers

What is the best DeepSeek model?
DeepSeek V4.1 Flash 1017 has the highest verification score of the DeepSeek models the leaderboard tested: 73.8% (59 of 80 correct) in the 2026-10-27 run.
What is the fastest DeepSeek model?
DeepSeek V4 Flash Vision Exp is the fastest DeepSeek model the leaderboard tested, at a median 170 output tokens per second.
What is the cheapest DeepSeek model?
DeepSeek V4.1 Flash 1017 has the lowest billed cost per question of the DeepSeek models the leaderboard tested: $0.00091.
Which DeepSeek models do you test?
DeepSeek V4.1 Flash 1017, DeepSeek V4 Flash Vision Exp, DeepSeek V4 Pro 0813.