cd /news/large-language-models/show-hn-independent-llm-benchmark-in… Β· home β€Ί topics β€Ί large-language-models β€Ί article
[ARTICLE Β· art-152324] src=vibecoderjournal.com β†— pub= topic=large-language-models verified=true sentiment=Β· neutral

Show HN: Independent LLM benchmark index tracking 22 frontier models

An independent LLM benchmark index launched on Hacker News' Show HN, ranking 22 frontier models on the Artificial Analysis Intelligence Index, coding proficiency, GPQA, SWE-bench Verified and HLE reasoning tests, plus real-time value-for-money ($/point) metrics updated daily. GPT-6 Astra (max) from OpenAI tops the intelligence index at 55, ahead of Anthropic's Claude Fable 5.1 (max with fallback) and Claude Opus 5 (max) at 53 each, Meta's Muse Spark 1.3 (max) and OpenAI's GPT-5.6 Sol (max) at 48, and Z AI's GLM-5.3 (max), Alibaba's Qwen3.8 Max (0902), StepFun's Step 5 Preview, SpaceXAI's Grok 4.6 (high) and Kimi's Kimi K3 (max) at 44-45. On output speed, Google's Gemini 3.5 Flash-Lite leads at 358 tokens per second and Gemini 3.8 Flash (high) at 298 t/s, with Meta's Muse Spark 1.3 (max) and DeepSeek's V4 Flash Vision (max) at 214 t/s.

read8 min views1 publishedOct 18, 2026

Empirical evaluations measuring coding proficiency, reasoning benchmarks (GPQA, SWE-bench Verified, HLE), and real-time value-for-money ($/point) metrics.

                    Highlights
                

                    Updated Daily β€’ Empirical Telemetry
                

Intelligence

Updated

                            Artificial Analysis Intelligence Index β€’ Higher is better
                        

GPT-6 Astra (max) Benchmarks, Price & Specs (Oct 2026): 55 (OpenAI)

                                55                            

                                O                            

                                    GPT-6 Astra (m..                                

Claude Fable 5.1 (max with fallback): 53 (Anthropic)

                                53                            

                                A                            

                                    Claude Fable 5..                                

Claude Opus 5 (max) Benchmarks, Price & Specs (Oct 2026): 53 (Anthropic)

                                53                            

                                A                            

                                    Claude Opus 5 ..                                

Muse Spark 1.3 (max): 48 (Meta)

                                48                            

                                M                            

                                    Muse Spark 1.3..                                

GPT-5.6 Sol (max) Benchmarks, Price & Specs (Oct 2026): 48 (OpenAI)

                                48                            

                                O                            

                                    GPT-5.6 Sol (m..                                

GLM-5.3 (max): 45 (Z AI)

                                45                            

                                Z                            

                                    GLM-5.3 (max)                                

Qwen3.8 Max (0902): 45 (Alibaba)

                                45                            

                                Q                            

                                    Qwen3.8 Max (0..                                

Step 5 Preview: 44 (StepFun)

                                44                            

                                S                            

                                    Step 5 Preview                                

Grok 4.6 (high): 44 (SpaceXAI)

                                44                            

                                X                            

                                    Grok 4.6 (high)                                

Kimi K3 (max): 44 (Kimi)

                                44                            

                                K                            

                                    Kimi K3 (max)                                

Speed

                            Output tokens per second β€’ Higher is better
                        

Gemini 3.5 Flash-Lite: 358 t/s (Google)

                                358 t/s                            

                                G                            

                                    Gemini 3.5 Fla..                                

Gemini 3.8 Flash (high): 298 t/s (Google)

                                298 t/s                            

                                G                            

                                    Gemini 3.8 Fla..                                

Muse Spark 1.3 (max): 214 t/s (Meta)

                                214 t/s                            

                                M                            

                                    Muse Spark 1.3..                                

DeepSeek V4 Flash Vision (max): 214 t/s (DeepSeek)

                                214 t/s                            

                                D                            

                                    DeepSeek V4 Fl..                                

DeepSeek V4.1 Flash (max): 208 t/s (DeepSeek)

                                208 t/s                            

                                D                            

                                    DeepSeek V4.1 ..                                

MiniMax-M3: 186 t/s (MiniMax)

                                186 t/s                            

                                M                            

                                    MiniMax-M3                                

gpt-oss-120b (high): 181 t/s (OpenAI)

                                181 t/s                            

                                O                            

                                    gpt-oss-120b (..                                

Nemotron 3 Ultra: 164 t/s (NVIDIA)

                                164 t/s                            

                                N                            

                                    Nemotron 3 Ultra                                

Mistral Medium 3.5: 137 t/s (Mistral)

                                137 t/s                            

                                M                            

                                    Mistral Medium..                                

GPT-5.6 Luna (max): 133 t/s (OpenAI)

                                133 t/s                            

                                O                            

                                    GPT-5.6 Luna (..                                

Cost per 1M Tokens

                            Weighted average blended price (USD) β€’ Lower is better
                        

Muse Glimmer (high): $0.12 (Meta)

                                $0.12                            

                                M                            

                                    Muse Glimmer (..                                

Gemini 3.5 Flash-Lite: $0.18 (Google)

                                $0.18                            

                                G                            

                                    Gemini 3.5 Fla..                                

gpt-oss-120b (high): $0.18 (OpenAI)

                                $0.18                            

                                O                            

                                    gpt-oss-120b (..                                

GLM-5.3-Flash: $0.35 (Z AI)

                                $0.35                            

                                Z                            

                                    GLM-5.3-Flash                                

DeepSeek V4.1 Flash (max): $0.37 (DeepSeek)

                                $0.37                            

                                D                            

                                    DeepSeek V4.1 ..                                

Qwen3.8-Flash-Next: $0.45 (Alibaba)

                                $0.45                            

                                Q                            

                                    Qwen3.8-Flash-..                                

DeepSeek V4 Flash Vision (max): $0.47 (DeepSeek)

                                $0.47                            

                                D                            

                                    DeepSeek V4 Fl..                                

GPT-5.6 Luna (max): $0.52 (OpenAI)

                                $0.52                            

                                O                            

                                    GPT-5.6 Luna (..                                

Mistral Medium 3.5: $0.60 (Mistral)

                                $0.60                            

                                M                            

                                    Mistral Medium..                                

MiniMax-M3: $0.60 (MiniMax)

                                $0.60                            

                                M                            

                                    MiniMax-M3

Artificial Analysis Intelligence Index #

β†— Intelligence Index v4.3 incorporates evaluations: SWE-bench Verified (40%), Terminal-Bench 2.0 (25%), Aider Polyglot (20%), LiveCodeBench (15%). Every figure is verified against primary source logs without prompt leakage.

Intelligence Index vs. Cost per 1M Tokens

Code Intelligence Index vs. Weighted average cost (USD, Log Scale)

Frontier Language Model Intelligence, Over Time

Progressive evolution across Anthropic, OpenAI, DeepSeek, Google, and Meta from 2023 to 2026.

Canonical Benchmark Suite

Breakdown across isolated execution harnesses matching Artificial Analysis methodologies.

Value-for-Money Intelligence vs. Cost Matrix

RANK MODEL & CREATOR
01 Claude Fable 5.1 (max with fallback) Anthropic β€’ API β€’ β–² +1 β€”% β€”% 1M 68 t/s TTFT: 262210ms $30.0000 β€”
02 Muse Spark 1.3 (max) Meta β€’ API β€’ β–² +1 β€”% β€”% 1M 214 t/s TTFT: 24160ms $2.2500 β€”
03 GLM-5.3 (max) Z AI β€’ API β€’ β–² +1 β€”% β€”% 1M 72 t/s TTFT: 2960ms $1.5000 β€”
04 Qwen3.8 Max (0902) Alibaba β€’ API β€’ β–² +1 β€”% β€”% 984K 37 t/s TTFT: 2720ms $3.0000 β€”
05 Step 5 Preview StepFun β€’ API β€’ β–² +1 β€”% β€”% 1M 100 t/s TTFT: 2960ms $1.2000 β€”
06 Grok 4.6 (high) SpaceXAI β€’ API β€’ β–² +1 β€”% β€”% 500K 60 t/s TTFT: 44250ms $4.0000 β€”
07 Kimi K3 (max) Kimi β€’ API β€’ β–² +1 β€”% β€”% 1.05M 38 t/s TTFT: 3990ms $1.8000 β€”
08 GPT-5.6 Terra (max) OpenAI β€’ API β€’ β–² +1 β€”% β€”% 1M 84 t/s TTFT: 220860ms $3.1500 β€”
09 GLM-5.3-Flash Z AI β€’ API β€’ β–² +1 β€”% β€”% 1M 95 t/s TTFT: 2500ms $0.3500 β€”
10 Gemini 3.8 Flash (high) Google β€’ API β€’ β–² +1 β€”% β€”% 1M 298 t/s TTFT: 15470ms $1.3100 β€”
11 DeepSeek V4.1 Flash (max) DeepSeek β€’ API β€’ β–² +1 β€”% β€”% 1M 208 t/s TTFT: 1140ms $0.3700 β€”
12 Qwen3.8-Flash-Next Alibaba β€’ API β€’ β–² +1 β€”% β€”% 256K 55 t/s TTFT: 2890ms $0.4500 β€”
13 Qwen3.8 2.4T A95B Alibaba β€’ API β€’ β–² +1 β€”% β€”% 984K 38 t/s TTFT: 2690ms $2.2500 β€”
14 Claude Sonnet 5 (max) Anthropic β€’ API β€’ β–² +1 β€”% β€”% 1M 74 t/s TTFT: 133400ms $8.0000 β€”
15 GPT-5.6 Luna (max) OpenAI β€’ API β€’ β–² +1 β€”% β€”% 1M 133 t/s TTFT: 113240ms $0.5200 β€”
16 DeepSeek V4 Flash Vision (max) DeepSeek β€’ API β€’ β–² +1 β€”% β€”% 1M 214 t/s TTFT: 1050ms $0.4700 β€”
17 Qwen3.8 27B (xhigh) Alibaba β€’ API β€’ β–² +1 β€”% β€”% 256K 43 t/s TTFT: 3840ms $0.9000 β€”
18 Nemotron 3 Ultra NVIDIA β€’ API β€’ β–² +1 β€”% β€”% 262K 164 t/s TTFT: 2400ms $0.7500 β€”
19 gpt-oss-120b (high) OpenAI β€’ API β€’ β–² +1 β€”% β€”% 131K 181 t/s TTFT: 850ms $0.1800 β€”
20 Mistral Medium 3.5 Mistral β€’ API β€’ β–Ό -1 β€”% β€”% 256K 137 t/s TTFT: 2290ms $0.6000 β€”
21 Muse Glimmer (high) Meta β€’ API β€’ β–Ό -2 β€”% β€”% 131K 93 t/s TTFT: 990ms $0.1200 β€”
22 Gemini 3.5 Flash-Lite Google β€’ API β€’ β–Ό -3 β€”% β€”% 1M 358 t/s TTFT: 9780ms $0.1750 β€”
23 Inkling Thinking Machines β€’ API β€’ β–Ό -5 β€”% β€”% 1M 81 t/s TTFT: 2480ms $0.7500 β€”
24 Gemini 3.1 Pro Benchmarks, Price & Specs (Oct 2026) Google β€’ API β€’ β–² +1 β€”% β€”% 1M 119 t/s TTFT: 33160ms $1.4000 β€”
25 MiniMax-M3 MiniMax β€’ API β€’ β–Ό -7 β€”% β€”% 1M 186 t/s TTFT: 1000ms $0.6000 β€”
26 K2 Horizon 375B A23B Institute of Foundation Models β€’ API β€’ β–Ό -8 β€”% β€”% 524K 80 t/s TTFT: 3500ms $1.2000 β€”
27 DeepSeek V4 Pro Benchmarks, Price & Specs (Oct 2026) DeepSeek β€’ API β€’ β–Ό -11 β€”% β€”% 1M 88 t/s TTFT: 1700ms $0.9600 β€”
28 GPT-5.6 Sol (max) Benchmarks, Price & Specs (Oct 2026) OpenAI β€’ API β€’ β–Ό -25 β€”% β€”% 1M 61 t/s TTFT: 129500ms $6.1250 β€”
29 Claude Opus 5 (max) Benchmarks, Price & Specs (Oct 2026) Anthropic β€’ API β€’ β–² +1 β€”% β€”% 1M 51 t/s TTFT: 57030ms $20.0000 β€”
30 GPT-6 Astra (max) Benchmarks, Price & Specs (Oct 2026) OpenAI β€’ API β€’ β–Ό -29 β€”% β€”% 1M 57 t/s TTFT: 283660ms $12.0000 β€”

53.1%

β€”%

β€”%

1M

68 t/s (262210ms)

$30.0000

β€”

48.0%

β€”%

β€”%

1M

214 t/s (24160ms)

$2.2500

β€”

GLM-5.3 (max)

45.1%

β€”%

β€”%

1M

72 t/s (2960ms)

$1.5000

β€”

45.0%

β€”%

β€”%

984K

37 t/s (2720ms)

$3.0000

β€”

Step 5 Preview

44.1%

β€”%

β€”%

1M

100 t/s (2960ms)

$1.2000

β€”

Grok 4.6 (high)

44.0%

β€”%

β€”%

500K

60 t/s (44250ms)

$4.0000

β€”

Kimi K3 (max)

44.0%

β€”%

β€”%

1.05M

38 t/s (3990ms)

$1.8000

β€”

42.1%

β€”%

β€”%

1M

84 t/s (220860ms)

$3.1500

β€”

GLM-5.3-Flash

42.1%

β€”%

β€”%

1M

95 t/s (2500ms)

$0.3500

β€”

41.0%

β€”%

β€”%

1M

298 t/s (15470ms)

$1.3100

β€”

40.0%

β€”%

β€”%

1M

208 t/s (1140ms)

$0.3700

β€”

40.0%

β€”%

β€”%

256K

55 t/s (2890ms)

$0.4500

β€”

40.0%

β€”%

β€”%

984K

38 t/s (2690ms)

$2.2500

β€”

38.1%

β€”%

β€”%

1M

74 t/s (133400ms)

$8.0000

β€”

38.0%

β€”%

β€”%

1M

133 t/s (113240ms)

$0.5200

β€”

35.0%

β€”%

β€”%

1M

214 t/s (1050ms)

$0.4700

β€”

34.0%

β€”%

β€”%

256K

43 t/s (3840ms)

$0.9000

β€”

Nemotron 3 Ultra

23.0%

β€”%

β€”%

262K

164 t/s (2400ms)

$0.7500

β€”

0.0%

β€”%

β€”%

131K

181 t/s (850ms)

$0.1800

β€”

0.0%

β€”%

β€”%

256K

137 t/s (2290ms)

$0.6000

β€”

0.0%

β€”%

β€”%

131K

93 t/s (990ms)

$0.1200

β€”

0.0%

β€”%

β€”%

1M

358 t/s (9780ms)

$0.1750

β€”

Inkling

0.0%

β€”%

β€”%

1M

81 t/s (2480ms)

$0.7500

β€”

0.0%

β€”%

β€”%

1M

119 t/s (33160ms)

$1.4000

β€”

MiniMax-M3

0.0%

β€”%

β€”%

1M

186 t/s (1000ms)

$0.6000

β€”

0.0%

β€”%

β€”%

524K

80 t/s (3500ms)

$1.2000

β€”

0.0%

β€”%

β€”%

1M

88 t/s (1700ms)

$0.9600

β€”

0.0%

β€”%

β€”%

1M

61 t/s (129500ms)

$6.1250

β€”

0.0%

β€”%

β€”%

1M

51 t/s (57030ms)

$20.0000

β€”

0.0%

β€”%

β€”%

1M

57 t/s (283660ms)

$12.0000

β€”

── more in #large-language-models 4 stories Β· sorted by recency
── more on @openai 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain β€” perfect for shipping the agent you just read about.

$git push zahid main
β†’ Live at https://your-agent.zahid.host βœ“
Get free account β†’ Pricing
from €0/mo Β· no card required
LIVE [news/show-hn-independent-…] indexed:0 read:8min 2026-10-18 Β· β€”