ResearchLLM Verifications Leaderboard

Data as of · 78 models, 80 questions · reviewed by Suhas Bhairav · methodology

Head to head · tested 27 Oct 2026

Gemini 3.5 Flash Lite vs GPT-6.1 Sol: accuracy, speed and price

Similar accuracy; GPT-6.1 Sol costs less per question.

GoogleGemini 3.5 Flash Lite75.0% score · #15$0.0034 per question409 tok/sOpenAIGPT-6.1 Sol76.2% score · #12$0.0029 per question41 tok/s

Verdict

Built from the measurements below

  • Accuracy is too close to call: Gemini 3.5 Flash Lite scored 75.0% and GPT-6.1 Sol 76.2% on the same 80 questions, a gap within what chance alone could produce.
  • GPT-6.1 Sol is 1.2× cheaper per question as billed ($0.0029 vs $0.0034), reasoning tokens included.
  • Gemini 3.5 Flash Lite generates text 9.9× faster: 409 tokens per second against 41.
  • Gemini 3.5 Flash Lite starts answering sooner: 1.1 s to the first token, against 2.1 s for GPT-6.1 Sol.

Which should you choose?

Choose Gemini 3.5 Flash Lite for faster streaming and a quicker first token. Choose GPT-6.1 Sol for the lower cost per correct answer ($0.0037 against $0.0045) and shorter outputs (about 224 tokens per question against 1,311). The widest subject gap is in medicine: Gemini 3.5 Flash Lite answered 7 of 11 correctly, GPT-6.1 Sol 5 of 11. With so few questions per subject, treat this as a lead to test on your own prompts, not a result.

Accuracy gap -1.2 points (z = -0.18). A winner is called only when z is at least 1.96, the usual 95% threshold. Speed, latency and price need a 10% margin.

Head to head

Same questions, same prompt, same API

MeasureGemini 3.5 Flash LiteGPT-6.1 SolEdge
Verification scoreHigher is better75.0%76.2%Too close to call
Cost per questionLower is better$0.0034$0.0029GPT-6.1 Sol
Output speedHigher is better40941Gemini 3.5 Flash Lite
Time to first tokenLower is better1.1 s2.1 sGemini 3.5 Flash Lite
End-to-end response timeLower is better2.8 s10.8 sGemini 3.5 Flash Lite
Tokens per questionLower is better1,311224GPT-6.1 Sol
Context windowHigher is better1M1.1MSimilar

Side by side

Bars are scaled to the larger of the two values. The winner on each measure is marked in bold.

Every measure

Gemini 3.5 Flash Lite first, GPT-6.1 Sol second

Verification scorehigher is better
Gemini 3.5 Flash Lite75.0%
GPT-6.1 Sol76.2%
Cost per questionlower is better
Gemini 3.5 Flash Lite$0.0034
GPT-6.1 Sol$0.0029
Output speedhigher is better
Gemini 3.5 Flash Lite409
GPT-6.1 Sol41
Time to first tokenlower is better
Gemini 3.5 Flash Lite1.1 s
GPT-6.1 Sol2.1 s
End-to-end response timelower is better
Gemini 3.5 Flash Lite2.8 s
GPT-6.1 Sol10.8 s
Tokens per questionlower is better
Gemini 3.5 Flash Lite1,311
GPT-6.1 Sol224
Context windowhigher is better
Gemini 3.5 Flash Lite1M
GPT-6.1 Sol1.1M

Score vs. cost per question

Both models in color, every other model in grey

Most attractive quadrant0255075100$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Gemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BMuse WonderGrok 4.7o3gpt-oss-20bMinistral 3 3B 2512Nova Micro 1.0Phi 4Granite 4.2 8BHy3GLM 5.3 FlashSolar Pro 4Trinity Large ThinkingMiniMax M3Mistral Large 4Claude Opus 5.5GPT-6.1 SolGemini 4 ArgonGPT-5.4GPT-6 Lunagpt-oss-120bLlama 4 Maverick

Specifications and pricing

From OpenRouter's catalogue, plus the leaderboard's test dates

SpecificationGemini 3.5 Flash LiteGPT-6.1 Sol
CreatorGoogleOpenAI
Released21 Jul 202629 Sept 2026
Weights——
ReasoningYesYes
Inputtext, image, video, file, audiofile, image, text
Outputtexttext
Context window1M tokens1.1M tokens
Knowledge cutoff——
List price in / out per 1M$0.3 / $2.5$2 / $10
Blended price per 1M (3:1)$0.85$4.00
Cheapest hostGoogle · $0.15 / $1.25OpenAI · $1 / $5
Hosts on OpenRouter23
Last tested26 Oct 202625 Oct 2026

Compare any two models →

Gemini 3.5 Flash Lite vs GPT-6.1 Sol: frequently asked questions

Is Gemini 3.5 Flash Lite better than GPT-6.1 Sol?
On accuracy they are statistically tied: Gemini 3.5 Flash Lite scored 75.0% and GPT-6.1 Sol 76.2% on the same 80 questions from open datasets. Similar accuracy; GPT-6.1 Sol costs less per question.
Which is cheaper, Gemini 3.5 Flash Lite or GPT-6.1 Sol?
GPT-6.1 Sol is cheaper: $0.0029 per question as billed, against $0.0034. List prices: Gemini 3.5 Flash Lite $0.3 in / $2.5 out, GPT-6.1 Sol $2 in / $10 out per million tokens.
Which is faster, Gemini 3.5 Flash Lite or GPT-6.1 Sol?
Gemini 3.5 Flash Lite is faster at 409 output tokens per second, against 41. Time to first token: 1.1 s for Gemini 3.5 Flash Lite, 2.1 s for GPT-6.1 Sol.
Which has the larger context window, Gemini 3.5 Flash Lite or GPT-6.1 Sol?
Both accept about the same amount of context: 1M and 1.1M tokens.