ResearchLLM Verifications Leaderboard

Data as of · 78 models, 80 questions · reviewed by Suhas Bhairav · methodology

Head to head · tested 27 Oct 2026

Kimi K2.7 Code vs Step 5 Preview: accuracy, speed and price

Similar accuracy; Step 5 Preview costs less per question.

MoonshotAIKimi K2.7 Code65.0% score · #33$0.006 per question136 tok/sStepFunStep 5 Preview63.8% score · #34$0.0047 per question93 tok/s

Verdict

Built from the measurements below

  • Accuracy is too close to call: Kimi K2.7 Code scored 65.0% and Step 5 Preview 63.8% on the same 80 questions, a gap within what chance alone could produce.
  • Step 5 Preview is 1.3× cheaper per question as billed ($0.0047 vs $0.006), reasoning tokens included.
  • Kimi K2.7 Code generates text 1.5× faster: 136 tokens per second against 93.
  • Kimi K2.7 Code starts answering sooner: 0.4 s to the first token, against 0.6 s for Step 5 Preview.
  • Step 5 Preview accepts more context: 1M tokens against 262k.

Which should you choose?

Choose Kimi K2.7 Code for faster streaming, a quicker first token and more hosts to choose from on OpenRouter (11 against 4). Choose Step 5 Preview for the lower cost per correct answer ($0.0074 against $0.0092) and a 1M-token context window.

Accuracy gap +1.3 points (z = 0.17). A winner is called only when z is at least 1.96, the usual 95% threshold. Speed, latency and price need a 10% margin.

Head to head

Same questions, same prompt, same API

MeasureKimi K2.7 CodeStep 5 PreviewEdge
Verification scoreHigher is better65.0%63.8%Too close to call
Cost per questionLower is better$0.006$0.0047Step 5 Preview
Output speedHigher is better13693Kimi K2.7 Code
Time to first tokenLower is better0.4 s0.6 sKimi K2.7 Code
End-to-end response timeLower is better5.3 s8.2 sKimi K2.7 Code
Tokens per questionLower is better1,7811,630Similar
Context windowHigher is better262k1MStep 5 Preview

Side by side

Bars are scaled to the larger of the two values. The winner on each measure is marked in bold.

Every measure

Kimi K2.7 Code first, Step 5 Preview second

Verification scorehigher is better
Kimi K2.7 Code65.0%
Step 5 Preview63.8%
Cost per questionlower is better
Kimi K2.7 Code$0.006
Step 5 Preview$0.0047
Output speedhigher is better
Kimi K2.7 Code136
Step 5 Preview93
Time to first tokenlower is better
Kimi K2.7 Code0.4 s
Step 5 Preview0.6 s
End-to-end response timelower is better
Kimi K2.7 Code5.3 s
Step 5 Preview8.2 s
Tokens per questionlower is better
Kimi K2.7 Code1,781
Step 5 Preview1,630
Context windowhigher is better
Kimi K2.7 Code262k
Step 5 Preview1M

Score vs. cost per question

Both models in color, every other model in grey

Most attractive quadrant0255075100$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Gemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BMuse WonderGrok 4.7o3gpt-oss-20bMinistral 3 3B 2512Nova Micro 1.0Phi 4Granite 4.2 8BHy3GLM 5.3 FlashSolar Pro 4Trinity Large ThinkingMiniMax M3Mistral Large 4Claude Opus 5.5GPT-6.1 SolGemini 4 ArgonGPT-5.4GPT-6 Lunagpt-oss-120bLlama 4 Maverick

Specifications and pricing

From OpenRouter's catalogue, plus the leaderboard's test dates

SpecificationKimi K2.7 CodeStep 5 Preview
CreatorMoonshotAIStepFun
Released12 Jun 20268 Oct 2026
WeightsOpen weightsOpen weights
ReasoningYesYes
Inputtext, imagetext, image, video
Outputtexttext
Context window262k tokens1M tokens
Knowledge cutoff——
List price in / out per 1M$0.56 / $3.1$1 / $2.7
Blended price per 1M (3:1)$1.20$1.43
Cheapest hostCoreWeave · $0.6 / $3InferenceNet · $1 / $2.7
Hosts on OpenRouter114
Last tested27 Oct 202627 Oct 2026

Compare any two models →

Kimi K2.7 Code vs Step 5 Preview: frequently asked questions

Is Kimi K2.7 Code better than Step 5 Preview?
On accuracy they are statistically tied: Kimi K2.7 Code scored 65.0% and Step 5 Preview 63.8% on the same 80 questions from open datasets. Similar accuracy; Step 5 Preview costs less per question.
Which is cheaper, Kimi K2.7 Code or Step 5 Preview?
Step 5 Preview is cheaper: $0.0047 per question as billed, against $0.006. List prices: Kimi K2.7 Code $0.56 in / $3.1 out, Step 5 Preview $1 in / $2.7 out per million tokens.
Which is faster, Kimi K2.7 Code or Step 5 Preview?
Kimi K2.7 Code is faster at 136 output tokens per second, against 93. Time to first token: 0.4 s for Kimi K2.7 Code, 0.6 s for Step 5 Preview.
Which has the larger context window, Kimi K2.7 Code or Step 5 Preview?
Step 5 Preview, with 1M tokens against 262k.