ResearchLLM Verifications Leaderboard

Data as of · 78 models, 80 questions · reviewed by Suhas Bhairav · methodology

Z.aiOpen weightsReleased 26 Aug 2026

GLM 5.3 Flash benchmarks, speed and API pricing

Reviewed by Suhas Bhairav · Tested

Compare

Available through OpenRouter on

  • Relace$0.0379 in · $0.074 out
  • OpenInference$0.0363 in · $0.110001 out
  • Darkbloom$0.065 in · $0.18 out
  • Wafer$0.054 in · $0.2 out
  • GMICloud$0.075 in · $0.25 out
  • Sail Research$0.07835 in · $0.25 out
  • Novita$0.084 in · $0.28 out
  • StreamLake$0.0885 in · $0.295 out
  • CoreWeave$0.12 in · $0.38 out
  • InferenceNet$0.12 in · $0.388 out
  • Phala$0.1275 in · $0.425 out
  • DigitalOcean$0.13125 in · $0.4375 out
  • Makora$0.14 in · $0.47 out
  • Near AI$0.08 in · $0.5 out
  • Reka$0.12 in · $0.5 out
  • NextBit$0.125 in · $0.5 out
  • Mistral$0.15 in · $0.5 out
  • Cohere$0.15 in · $0.5 out
  • PrimeIntellect$0.15 in · $0.5 out
  • Nebius$0.15 in · $0.5 out
  • Modal$0.15 in · $0.5 out
  • BaseTen$0.15 in · $0.5 out
  • Crusoe$0.15 in · $0.5 out
  • AtlasCloud$0.15 in · $0.5 out
  • Fireworks$0.15 in · $0.5 out
  • Friendli$0.15 in · $0.5 out
  • SiliconFlow$0.15 in · $0.5 out
  • Morph$0.15 in · $0.5 out
  • Together$0.15 in · $0.5 out
  • Parasail$0.15 in · $0.5 out
  • Venice$0.15 in · $0.5 out
  • DeepInfra$0.15 in · $0.5 out
  • Z.AI$0.15 in · $0.5 out
  • Inceptron$0.17 in · $0.6 out
Intelligence67.5% correct#28 of 72
Speed83tok/s#45 of 72
Cost$0.00015per question#8 of 72List $0.15 in · $0.5 out per 1M
Verbosity560tokens per question#19 of 72

Summary

  • Answers 54 of 80 verification questions correctly (67.5%), placing #28 of 72 models tested on the current suite.
  • Generates 83 output tokens per second, faster than 38% of the models the leaderboard measures.
  • Starts responding after 0.5 s (median time to first token), including thinking time.
  • Costs $0.00015 per question as billed, #2 cheapest of 29 models priced $0.15 to $1 per 1M tokens.

Specifications

Reasoning
Yes
Input
text, image, video
Output
text
Context window
1M tokens
Knowledge cutoff
—
OpenRouter ID
z-ai/glm-5.3-flash
Last tested
26 Oct 2026

Peer group: 31 models with a blended list price $0.15 to $1 per 1M tokens (3 input : 1 output). Charts below compare GLM 5.3 Flash with all models; cost and speed charts focus on this peer group.

Intelligence

Verification score: the share of 80 questions from open datasets answered correctly. See the benchmark datasets.

Score vs. cost per question

GLM 5.3 Flash circled; dashed line joins models no cheaper model beats

Most attractive quadrant0255075100$0.00001$0.0001$0.001$0.01$0.10Cost per question (USD, log) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Gemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BMuse WonderGrok 4.7o3gpt-oss-20bGranite 4.0 MicroNova Micro 1.0Mercury 2.5Phi 4Granite 4.2 8BHy3GLM 5.3 FlashSolar Pro 4Trinity Large ThinkingMiniMax M3Mistral Large 4Claude Opus 5.5GPT-6.1 SolGemini 4 ArgonGPT-5.4GPT-6 Lunagpt-oss-120b

Score vs. end-to-end response time

GLM 5.3 Flash circled · accurate and quick sits top left

Most attractive quadrant02550751000 s25 s50 s75 s100 sEnd-to-end response time (s) →Verification score (%) →Qwen3.8 2.4T A95BCommand AReka Flash 3Llama 4 ScoutGemma 4 26B A4BLing 3.1 FlashHermes 4 405BMuse WonderGranite 4.0 MicroSolar Pro 4DeepSeek V4 Pro 0813Mistral Large 4Claude Opus 5.5Llama 4 MaverickKimi K3.1 Pro

Score vs. tokens per question

GLM 5.3 Flash circled · output tokens, reasoning included

Most attractive quadrant02550751001001,00010,000Output tokens per question (log) →Verification score (%) →Command AReka Flash 3Llama 4 ScoutQwen3.7 PlusGemma 4 26B A4BGemma 4 31BQwen3.5 397B A17BHermes 4 405BClaude Fable 5.1GPT-6 AstraMuse WonderGrok 4.7o3gpt-oss-20bGranite 4.0 MicroNova Micro 1.0Mercury 2.5Granite 4.2 8BMinistral 3 14B 2512Hy3GLM 5.3 FlashSolar Pro 4Qwen3.6 35B A3BInkling SmallNemotron 3 UltraClaude Opus 5.5Gemini 4 ArgonGPT-5.4GPT-6 SolMiMo-V2.6-Pro

Verification score

All models tested on the current suite

  1. 1Claude Opus 5.585.0
  2. 2Gemini 4 Argon83.8
  3. 3GPT-5.3-Codex82.5
  4. 3Gemini 3.8 Flash82.5
  5. 5Claude Fable 5.181.2
  6. 6Grok 4.780.0
  7. 7Muse Wonder78.8
  8. 7Claude Sonnet 5.578.8
  9. 9Gemini 3.1 Pro Preview77.5
  10. 9Muse Spark Open77.5
  11. 28GLM 5.3 Flash67.5

61 more models · see the full leaderboard

6 of 78 tested models have no verification score

Cost

Average cost of one question, split into input, reasoning and answer tokens at each model's list price. Reasoning tokens are billed as output.

Cost per question, by token type

Peer group: blended price $0.15 to $1

  1. 1Llama 4 Scout$0.00025
  2. 2GPT-6 Luna$0.00025
  3. 3Ministral 3 8B 2512$0.00027
  4. 4Llama 3.3 70B Instruct$0.00031
  5. 5Ministral 3 14B 2512$0.00031
  6. 6GLM 5.3 Flash$0.00033
  7. 7gpt-oss-120b$0.00038
  8. 8Inkling Small$0.00047
  9. 9Claude Haiku 5.5$0.00048
  10. 10MiMo-V2.6-Flash$0.00056
  11. 11Llama 4 Maverick$0.00057
  12. 12GLM 5.3$0.00076
  13. 13DeepSeek V4.1 Flash 1017$0.00084
  14. 14MiniMax M3.1 Flash$0.0009
  15. 15DeepSeek V4 Flash Vision Exp$0.00092
  16. 16Hy3$0.0013
  17. 17Gemma 4 31B$0.0014
  18. 18Nemotron 3.5 Super VL$0.0014
  19. 19Qwen3 Coder Next$0.0017
  20. 20Solar Pro 4$0.0018
  21. 21Mistral Small 4$0.0019
  22. 22MiMo-V2.6-Pro$0.002
  23. 23Trinity Large Thinking$0.0025
  24. 24MiniMax M3$0.0027
  25. 25LongCat 2.0$0.0032
  26. 26Qwen3.7 Plus$0.0033
  27. 27Gemini 3.5 Flash Lite$0.0034
  28. 28Qwen3.6 35B A3B$0.0034
  29. 29Qwen3.8 27B$0.0049
Input Reasoning Answer

Cost per question, as billed

All models · lower is better

  1. 1Granite 4.0 Micro$0.000051
  2. 2gpt-oss-20b$0.000066
  3. 3Granite 4.2 8B$0.000077
  4. 4Nova Micro 1.0$0.000087
  5. 5Mercury 2.5$0.00011
  6. 6Phi 4$0.00012
  7. 7gpt-oss-120b$0.00013
  8. 8GLM 5.3 Flash$0.00015
  9. 9Ministral 3 3B 2512$0.00019
  10. 10GPT-6 Luna$0.00025

62 more models · see the full leaderboard

6 of 78 tested models have no cost per question
  • LFM2.5-2.6B: no verification score (80 of 80 questions failed on the host's side)
  • Ling 3.0 Flash VL: no verification score (not yet run on the current question suite)
  • Qwen3.5-122B-A10B: no verification score (not yet run on the current question suite)
  • Qwen3 Next 80B A3B Thinking: no verification score (not yet run on the current question suite)
  • Nova Premier 1.0: no verification score (not yet run on the current question suite)
  • GPT-5.5 Pro: no verification score (not yet run on the current question suite)

Speed and latency

Median of 3 streamed runs of the same prompt, measured 25 Oct 2026.

Output speed

Peer group ($0.15 to $1) · higher is better

  1. 1Nemotron 3.5 Super VL715
  2. 2Gemini 3.5 Flash Lite409
  3. 3Trinity Large Thinking329
  4. 4Inkling Small233
  5. 5Claude Haiku 5.5192
  6. 6Mistral Small 4170
  7. 7DeepSeek V4 Flash Vision Exp170
  8. 8GLM 5.3154
  9. 9GPT-6 Luna137
  10. 10Qwen3.6 35B A3B135
  11. 11MiniMax M3.1 Flash131
  12. 12Ministral 3 8B 2512124
  13. 17GLM 5.3 Flash83

16 more models · see the full leaderboard

2 of 31 tested models have no output speed

Time to first token

Peer group ($0.15 to $1) · lower is better

  1. 1Ministral 3 8B 25120.3 s
  2. 2MiMo-V2.6-Flash0.4 s
  3. 3Qwen3.6 35B A3B0.4 s
  4. 4Qwen3 Coder Next0.4 s
  5. 5Mistral Small 40.5 s
  6. 6GLM 5.3 Flash0.5 s
  7. 7Inkling Small0.5 s
  8. 8MiniMax M30.5 s
  9. 9MiniMax M3.1 Flash0.5 s
  10. 10Qwen3.8 27B0.5 s
  11. 11gpt-oss-120b0.5 s
  12. 12Trinity Large Thinking0.6 s

17 more models · see the full leaderboard

2 of 31 tested models have no time to first token

End-to-end response time

Peer group ($0.15 to $1) · lower is better

  1. 1Nemotron 3.5 Super VL1.5 s
  2. 2Trinity Large Thinking2.7 s
  3. 3Gemini 3.5 Flash Lite2.8 s
  4. 4DeepSeek V4 Flash Vision Exp3.2 s
  5. 5GLM 5.33.4 s
  6. 6Ministral 3 8B 25123.5 s
  7. 7Inkling Small3.6 s
  8. 8Claude Haiku 5.53.9 s
  9. 9MiniMax M3.1 Flash4.2 s
  10. 10Qwen3 Coder Next4.2 s
  11. 11MiniMax M34.2 s
  12. 12GPT-6 Luna4.3 s
  13. 18GLM 5.3 Flash7.4 s

16 more models · see the full leaderboard

2 of 31 tested models have no end-to-end response time

Latency vs. output speed

GLM 5.3 Flash circled · quick to start and fast sits top left

Most attractive quadrant02004006008000.0 s5.0 s10.0 s15.0 s20.0 sTime to first token (s) →Output speed (tok/s) →Nemotron 3.5 Super VLQwen3.5 397B A17BMuse WonderMinistral 3 3B 2512Trinity Large ThinkingGemini 3.5 Flash LiteGemini 3.1 Pro PreviewGemini 3.8 FlashGemini 4 Argon

Results by category

Questions answered correctly in each category

Science22/30
Engineering8/15
Medicine5/11
Economics7/9
Law4/6
Humanities & social science8/9

More from Z.ai

Z.ai#28GLM 5.367.5% verification score154 tok/s0.8 s first token$0.00093 / question

All Z.ai models →

Compare GLM 5.3 Flash

Head to head with its closest rivals, other Z.ai models and the top models overall.

Hosts and prices

Every host serving this model through OpenRouter, from OpenRouter's catalogue

HostInput / 1MOutput / 1MContextMax outputQuantization
Relace$0.0379$0.0741M131k—
OpenInference$0.0363$0.1100011M944kfp4
Darkbloom$0.065$0.18262k66kfp4
Wafer$0.054$0.21M131knvfp4
GMICloud$0.075$0.251M944kfp8
Sail Research$0.07835$0.251M131kfp4
Novita$0.084$0.281M131kfp8
StreamLake$0.0885$0.2951M128kfp8
CoreWeave$0.12$0.381M944knvfp4
InferenceNet$0.12$0.3881M262kfp4
Phala$0.1275$0.4251M131knvfp4
DigitalOcean$0.13125$0.43751M131k—
Makora$0.14$0.471M131k—
Near AI$0.08$0.51M944kfp8
Reka$0.12$0.51M944k—
NextBit$0.125$0.51M128kfp4
Mistral$0.15$0.51M131k—
Cohere$0.15$0.51M131k—
PrimeIntellect$0.15$0.51M131k—
Nebius$0.15$0.51M922kfp4
Modal$0.15$0.51M944kfp4
BaseTen$0.15$0.51M131kfp8
Crusoe$0.15$0.51M944kfp4
AtlasCloud$0.15$0.51M131kfp8
Fireworks$0.15$0.51M944k—
Friendli$0.15$0.51M944k—
SiliconFlow$0.15$0.51M262kfp8
Morph$0.15$0.51M944kfp8
Together$0.15$0.51M944k—
Parasail$0.15$0.51M944kfp4
Venice$0.15$0.51M131k—
DeepInfra$0.15$0.51M944kfp4
Z.AI$0.15$0.51M131kfp8
Inceptron$0.17$0.61M944kfp8

GLM 5.3 Flash: frequently asked questions

How accurate is GLM 5.3 Flash?
GLM 5.3 Flash answered 54 of 80 questions correctly (67.5%) in the 2026-10-27 run, ranking #28 of 78 models.
How fast is GLM 5.3 Flash?
GLM 5.3 Flash generated a median of 83 output tokens per second in the 2026-10-27 run, ranking #45 of 78. Median time to first token was 0.5 s.
What is the latency of GLM 5.3 Flash?
GLM 5.3 Flash had a median time to first token of 0.5 s in the 2026-10-27 run, ranking #15 of 78 models.
How much does GLM 5.3 Flash cost?
GLM 5.3 Flash cost $0.00015 per question on average as billed in the 2026-10-27 run, reasoning tokens included.
What is GLM 5.3 Flash API pricing?
GLM 5.3 Flash is listed at $0.15 per million input tokens and $0.5 per million output tokens on OpenRouter.
What is the context window of GLM 5.3 Flash?
GLM 5.3 Flash accepts up to 1,048,576 tokens of context, according to OpenRouter's model catalogue.
Is GLM 5.3 Flash open source?
Yes. GLM 5.3 Flash is an open-weights model: Z.ai publishes the weights, so you can run it yourself as well as through an API.
Who makes GLM 5.3 Flash?
GLM 5.3 Flash is made by Z.ai. The LLM Verifications Leaderboard tested it through OpenRouter using the model ID z-ai/glm-5.3-flash.
Where can I use GLM 5.3 Flash via API?
Through OpenRouter, GLM 5.3 Flash is served by 9 hosts: Cohere, DigitalOcean, Friendli, InferenceNet, NextBit, OpenInference, Relace, Together, Wafer.