ResearchLLM Verifications Leaderboard

Data as of · 78 models, 80 questions · reviewed by Suhas Bhairav · methodology

Head to head · tested 27 Oct 2026

DeepSeek V4 Pro 0813 vs GPT-5.4: accuracy, speed and price

Similar accuracy; DeepSeek V4 Pro 0813 costs less per question.

DeepSeekDeepSeek V4 Pro 081371.2% score · #24$0.0036 per question56 tok/sOpenAIGPT-5.472.5% score · #21$0.011 per question55 tok/s

Verdict

Built from the measurements below

  • Accuracy is too close to call: DeepSeek V4 Pro 0813 scored 71.2% and GPT-5.4 72.5% on the same 80 questions, a gap within what chance alone could produce.
  • DeepSeek V4 Pro 0813 is 3.1× cheaper per question as billed ($0.0036 vs $0.011), reasoning tokens included.
  • Output speed is similar (56 vs 55 tokens per second).
  • DeepSeek V4 Pro 0813 starts answering sooner: 0.8 s to the first token, against 1.7 s for GPT-5.4.

Which should you choose?

Choose DeepSeek V4 Pro 0813 for the lower cost per correct answer ($0.0051 against $0.016), a quicker first token, open weights you can run yourself and more hosts to choose from on OpenRouter (23 against 3). Choose GPT-5.4 for shorter outputs (about 706 tokens per question against 1,318). The widest subject gap is in engineering: GPT-5.4 answered 10 of 15 correctly, DeepSeek V4 Pro 0813 8 of 15. With so few questions per subject, treat this as a lead to test on your own prompts, not a result.

Accuracy gap -1.2 points (z = -0.18). A winner is called only when z is at least 1.96, the usual 95% threshold. Speed, latency and price need a 10% margin.

Head to head

Same questions, same prompt, same API

MeasureDeepSeek V4 Pro 0813GPT-5.4Edge
Verification scoreHigher is better71.2%72.5%Too close to call
Cost per questionLower is better$0.0036$0.011DeepSeek V4 Pro 0813
Output speedHigher is better5655Similar
Time to first tokenLower is better0.8 s1.7 sDeepSeek V4 Pro 0813
End-to-end response timeLower is better10.1 s8.7 sGPT-5.4
Tokens per questionLower is better1,318706GPT-5.4
Context windowHigher is better1M1.1MSimilar

Side by side

Bars are scaled to the larger of the two values. The winner on each measure is marked in bold.

Every measure

DeepSeek V4 Pro 0813 first, GPT-5.4 second

Verification scorehigher is better
DeepSeek V4 Pro 081371.2%
GPT-5.472.5%
Cost per questionlower is better
DeepSeek V4 Pro 0813$0.0036
GPT-5.4$0.011
Output speedhigher is better
DeepSeek V4 Pro 081356
GPT-5.455
Time to first tokenlower is better
DeepSeek V4 Pro 08130.8 s
GPT-5.41.7 s
End-to-end response timelower is better
DeepSeek V4 Pro 081310.1 s
GPT-5.48.7 s
Tokens per questionlower is better
DeepSeek V4 Pro 08131,318
GPT-5.4706
Context windowhigher is better
DeepSeek V4 Pro 08131M
GPT-5.41.1M

Score vs. cost per question

Both models in color, every other model in grey

Most attractive quadrant0255075100$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Gemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BMuse WonderGrok 4.7o3gpt-oss-20bMinistral 3 3B 2512Nova Micro 1.0Phi 4Granite 4.2 8BHy3GLM 5.3 FlashSolar Pro 4Trinity Large ThinkingMiniMax M3Mistral Large 4Claude Opus 5.5GPT-6.1 SolGemini 4 ArgonGPT-5.4GPT-6 Lunagpt-oss-120bLlama 4 Maverick

Specifications and pricing

From OpenRouter's catalogue, plus the leaderboard's test dates

SpecificationDeepSeek V4 Pro 0813GPT-5.4
CreatorDeepSeekOpenAI
Released12 Aug 20265 Mar 2026
WeightsOpen weights—
ReasoningYesYes
Inputtexttext, image, file
Outputtexttext
Context window1M tokens1.1M tokens
Knowledge cutoff——
List price in / out per 1M$1.32 / $3.96$2.5 / $15
Blended price per 1M (3:1)$1.98$5.63
Cheapest hostBaidu · $0.13992 / $0.41976OpenAI · $1.25 / $7.5
Hosts on OpenRouter233
Last tested26 Oct 202625 Oct 2026

Compare any two models →

DeepSeek V4 Pro 0813 vs GPT-5.4: frequently asked questions

Is DeepSeek V4 Pro 0813 better than GPT-5.4?
On accuracy they are statistically tied: DeepSeek V4 Pro 0813 scored 71.2% and GPT-5.4 72.5% on the same 80 questions from open datasets. Similar accuracy; DeepSeek V4 Pro 0813 costs less per question.
Which is cheaper, DeepSeek V4 Pro 0813 or GPT-5.4?
DeepSeek V4 Pro 0813 is cheaper: $0.0036 per question as billed, against $0.011. List prices: DeepSeek V4 Pro 0813 $1.32 in / $3.96 out, GPT-5.4 $2.5 in / $15 out per million tokens.
Which is faster, DeepSeek V4 Pro 0813 or GPT-5.4?
Their output speed is similar: 56 and 55 tokens per second.
Which has the larger context window, DeepSeek V4 Pro 0813 or GPT-5.4?
Both accept about the same amount of context: 1M and 1.1M tokens.