Scores come from 80 multiple-choice questions from SuperGPQA and MMLU-Pro. With that many questions, a score has a margin of error of several points, so models a few points apart are effectively tied on accuracy; the comparison pages run a significance test for any pair. To see the top two side by side, compare Mercury 2.5 and gpt-oss-20b.
Speed, latency and cost are measured through OpenRouter and depend on which host serves the request; your numbers on a direct API may differ. The full procedure is on the methodology page, and the data behind this ranking can be downloaded.
Mercury 2.5 by Inception: 57.5% at $0.00011 per question. Rule: Models with a blended list price under $0.15 per million tokens (3 input : 1 output), ordered by verification score.
What is the runner-up?
gpt-oss-20b by OpenAI: 51.2% at $0.000066 per question.
Which of these costs least per correct answer?
gpt-oss-20b: $0.00013 per correct answer (cost per question divided by its score).