ResearchLLM Verifications Leaderboard

Data as of · 78 models, 80 questions · reviewed by Suhas Bhairav · methodology

Head to head · tested 27 Oct 2026

Gemini 3.8 Flash vs Muse Spark Open: accuracy, speed and price

Similar accuracy; Gemini 3.8 Flash costs less per question.

GoogleGemini 3.8 Flash82.5% score · #3$0.0037 per question142 tok/sMetaMuse Spark Open77.5% score · #9$0.0045 per question220 tok/s

Verdict

Built from the measurements below

  • Accuracy is too close to call: Gemini 3.8 Flash scored 82.5% and Muse Spark Open 77.5% on the same 80 questions, a gap within what chance alone could produce.
  • Gemini 3.8 Flash is 1.2× cheaper per question as billed ($0.0037 vs $0.0045), reasoning tokens included.
  • Muse Spark Open generates text 1.5× faster: 220 tokens per second against 142.
  • Muse Spark Open starts answering sooner: 0.5 s to the first token, against 3.2 s for Gemini 3.8 Flash.

Which should you choose?

Choose Gemini 3.8 Flash for the lower cost per correct answer ($0.0045 against $0.0058). Choose Muse Spark Open for faster streaming, a quicker first token, open weights you can run yourself and more hosts to choose from on OpenRouter (6 against 2). The widest subject gap is in law: Gemini 3.8 Flash answered 6 of 6 correctly, Muse Spark Open 4 of 6. With so few questions per subject, treat this as a lead to test on your own prompts, not a result.

Accuracy gap +5.0 points (z = 0.79). A winner is called only when z is at least 1.96, the usual 95% threshold. Speed, latency and price need a 10% margin.

Head to head

Same questions, same prompt, same API

MeasureGemini 3.8 FlashMuse Spark OpenEdge
Verification scoreHigher is better82.5%77.5%Too close to call
Cost per questionLower is better$0.0037$0.0045Gemini 3.8 Flash
Output speedHigher is better142220Muse Spark Open
Time to first tokenLower is better3.2 s0.5 sMuse Spark Open
End-to-end response timeLower is better5.6 s3.2 sMuse Spark Open
Tokens per questionLower is better925964Similar
Context windowHigher is better1M1MSimilar

Side by side

Bars are scaled to the larger of the two values. The winner on each measure is marked in bold.

Every measure

Gemini 3.8 Flash first, Muse Spark Open second

Verification scorehigher is better
Gemini 3.8 Flash82.5%
Muse Spark Open77.5%
Cost per questionlower is better
Gemini 3.8 Flash$0.0037
Muse Spark Open$0.0045
Output speedhigher is better
Gemini 3.8 Flash142
Muse Spark Open220
Time to first tokenlower is better
Gemini 3.8 Flash3.2 s
Muse Spark Open0.5 s
End-to-end response timelower is better
Gemini 3.8 Flash5.6 s
Muse Spark Open3.2 s
Tokens per questionlower is better
Gemini 3.8 Flash925
Muse Spark Open964
Context windowhigher is better
Gemini 3.8 Flash1M
Muse Spark Open1M

Score vs. cost per question

Both models in color, every other model in grey

Most attractive quadrant0255075100$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Gemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BMuse WonderGrok 4.7o3gpt-oss-20bMinistral 3 3B 2512Nova Micro 1.0Phi 4Granite 4.2 8BHy3GLM 5.3 FlashSolar Pro 4Trinity Large ThinkingMiniMax M3Mistral Large 4Claude Opus 5.5Gemini 3.8 FlashGPT-6.1 SolGPT-5.4GPT-6 Lunagpt-oss-120bLlama 4 Maverick

Specifications and pricing

From OpenRouter's catalogue, plus the leaderboard's test dates

SpecificationGemini 3.8 FlashMuse Spark Open
CreatorGoogleMeta
Released2 Sept 202615 Oct 2026
Weights—Open weights
ReasoningYesYes
Inputtext, image, video, file, audiotext, image, video, file, audio
Outputtexttext
Context window1M tokens1M tokens
Knowledge cutoff——
List price in / out per 1M$0.825 / $4.125$1.25 / $4.25
Blended price per 1M (3:1)$1.65$2.00
Cheapest hostGoogle AI Studio · $0.375 / $1.875Makora · $1.25 / $4.25
Hosts on OpenRouter26
Last tested25 Oct 202626 Oct 2026

Compare any two models →

Gemini 3.8 Flash vs Muse Spark Open: frequently asked questions

Is Gemini 3.8 Flash better than Muse Spark Open?
On accuracy they are statistically tied: Gemini 3.8 Flash scored 82.5% and Muse Spark Open 77.5% on the same 80 questions from open datasets. Similar accuracy; Gemini 3.8 Flash costs less per question.
Which is cheaper, Gemini 3.8 Flash or Muse Spark Open?
Gemini 3.8 Flash is cheaper: $0.0037 per question as billed, against $0.0045. List prices: Gemini 3.8 Flash $0.825 in / $4.125 out, Muse Spark Open $1.25 in / $4.25 out per million tokens.
Which is faster, Gemini 3.8 Flash or Muse Spark Open?
Muse Spark Open is faster at 220 output tokens per second, against 142. Time to first token: 3.2 s for Gemini 3.8 Flash, 0.5 s for Muse Spark Open.
Which has the larger context window, Gemini 3.8 Flash or Muse Spark Open?
Both accept about the same amount of context: 1M and 1M tokens.