ResearchLLM Verifications Leaderboard

Data as of · 78 models, 80 questions · reviewed by Suhas Bhairav · methodology

Head to head · tested 27 Oct 2026

GPT-5.4 vs GPT-6 Luna: accuracy, speed and price

Similar accuracy; GPT-6 Luna costs less per question.

OpenAIGPT-5.472.5% score · #21$0.011 per question55 tok/sOpenAIGPT-6 Luna72.5% score · #21$0.00025 per question137 tok/s

Verdict

Built from the measurements below

  • Accuracy is too close to call: GPT-5.4 scored 72.5% and GPT-6 Luna 72.5% on the same 80 questions, a gap within what chance alone could produce.
  • GPT-6 Luna is 46× cheaper per question as billed ($0.00025 vs $0.011), reasoning tokens included.
  • GPT-6 Luna generates text 2.5× faster: 137 tokens per second against 55.
  • GPT-6 Luna starts answering sooner: 1.2 s to the first token, against 1.7 s for GPT-5.4.

Which should you choose?

Choose GPT-6 Luna for the lower cost per correct answer ($0.00034 against $0.016), faster streaming, a quicker first token and shorter outputs (about 431 tokens per question against 706). The widest subject gap is in medicine: GPT-6 Luna answered 6 of 11 correctly, GPT-5.4 4 of 11. With so few questions per subject, treat this as a lead to test on your own prompts, not a result.

Accuracy gap +0.0 points (z = 0.00). A winner is called only when z is at least 1.96, the usual 95% threshold. Speed, latency and price need a 10% margin.

Head to head

Same questions, same prompt, same API

MeasureGPT-5.4GPT-6 LunaEdge
Verification scoreHigher is better72.5%72.5%Too close to call
Cost per questionLower is better$0.011$0.00025GPT-6 Luna
Output speedHigher is better55137GPT-6 Luna
Time to first tokenLower is better1.7 s1.2 sGPT-6 Luna
End-to-end response timeLower is better8.7 s4.3 sGPT-6 Luna
Tokens per questionLower is better706431GPT-6 Luna
Context windowHigher is better1.1M1.1MSimilar

Side by side

Bars are scaled to the larger of the two values. The winner on each measure is marked in bold.

Every measure

GPT-5.4 first, GPT-6 Luna second

Verification scorehigher is better
GPT-5.472.5%
GPT-6 Luna72.5%
Cost per questionlower is better
GPT-5.4$0.011
GPT-6 Luna$0.00025
Output speedhigher is better
GPT-5.455
GPT-6 Luna137
Time to first tokenlower is better
GPT-5.41.7 s
GPT-6 Luna1.2 s
End-to-end response timelower is better
GPT-5.48.7 s
GPT-6 Luna4.3 s
Tokens per questionlower is better
GPT-5.4706
GPT-6 Luna431
Context windowhigher is better
GPT-5.41.1M
GPT-6 Luna1.1M

Score vs. cost per question

Both models in color, every other model in grey

Most attractive quadrant0255075100$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Gemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BMuse WonderGrok 4.7o3gpt-oss-20bMinistral 3 3B 2512Nova Micro 1.0Phi 4Granite 4.2 8BHy3GLM 5.3 FlashSolar Pro 4Trinity Large ThinkingMiniMax M3Mistral Large 4Claude Opus 5.5GPT-6.1 SolGemini 4 ArgonGPT-5.4GPT-6 Lunagpt-oss-120bLlama 4 Maverick

Specifications and pricing

From OpenRouter's catalogue, plus the leaderboard's test dates

SpecificationGPT-5.4GPT-6 Luna
CreatorOpenAIOpenAI
Released5 Mar 202622 Sept 2026
Weights——
ReasoningYesYes
Inputtext, image, filefile, image, text
Outputtexttext
Context window1.1M tokens1.1M tokens
Knowledge cutoff——
List price in / out per 1M$2.5 / $15$0.1 / $0.5
Blended price per 1M (3:1)$5.63$0.20
Cheapest hostOpenAI · $1.25 / $7.5OpenAI · $0.05 / $0.25
Hosts on OpenRouter33
Last tested25 Oct 202625 Oct 2026

Compare any two models →

GPT-5.4 vs GPT-6 Luna: frequently asked questions

Is GPT-5.4 better than GPT-6 Luna?
On accuracy they are statistically tied: GPT-5.4 scored 72.5% and GPT-6 Luna 72.5% on the same 80 questions from open datasets. Similar accuracy; GPT-6 Luna costs less per question.
Which is cheaper, GPT-5.4 or GPT-6 Luna?
GPT-6 Luna is cheaper: $0.00025 per question as billed, against $0.011. List prices: GPT-5.4 $2.5 in / $15 out, GPT-6 Luna $0.1 in / $0.5 out per million tokens.
Which is faster, GPT-5.4 or GPT-6 Luna?
GPT-6 Luna is faster at 137 output tokens per second, against 55. Time to first token: 1.7 s for GPT-5.4, 1.2 s for GPT-6 Luna.
Which has the larger context window, GPT-5.4 or GPT-6 Luna?
Both accept about the same amount of context: 1.1M and 1.1M tokens.