LLM API vs NeonAI Gateway Benchmark Comparison
Neon was faster in both shared AI gateway benchmarks.
- Shared benchmarks
- 2
- Last run
- October 30, 2026
Scorecard
Median of each benchmark's primary metric; lower is better. Medians within 5% count as roughly even, and a benchmark gets no speed verdict when either provider completed fewer than 50% of runs.
OpenAI
Run October 30, 2026Time for a cold request routed through the gateway to GPT-5.4 Mini to return its complete response.
Cold end-to-end latency
Neon had a 2.15x lower median cold end-to-end latency (830ms vs 1781ms for LLM API).
Median cold end-to-end latency over time
9 runs from August 28, 2026 to October 30, 2026.
Kimi
Run October 30, 2026Time for a cold request routed through the gateway to Kimi K3 to return its complete response.
Cold end-to-end latency
Neon had a 2.24x lower median cold end-to-end latency (947ms vs 2118ms for LLM API).
Median cold end-to-end latency over time
10 runs from August 28, 2026 to October 30, 2026.
Methodology
- One workload, every provider. The same script, payload, and model hit every provider, addressed the way its own API expects. Nobody gets a tuned or special path.
- Repeated on a schedule. Every suite runs many iterations per provider, automated on a recurring schedule, so results reflect steady state rather than one lucky request.
- Raw results published. Every run is committed as JSON to the public benchmarks repo, next to the code that produced it. Nothing is cherry-picked or held back.
- How this comparison is built. Each benchmark compares the two providers' medians; results within 5% count as roughly even. A comparison is published only when both providers completed the latency benchmark on at least two of the same model families reliably: at least 50% success for each provider, in benchmark runs from the last 30 days.
Frequently asked questions
Have another question? Email us.
Neon was faster in both shared AI gateway benchmarks. In OpenAI (October 30, 2026), Neon had a median cold end-to-end latency of 830ms versus 1781ms for LLM API, 2.15x faster. In Kimi (October 30, 2026), Neon had a median cold end-to-end latency of 947ms versus 2118ms for LLM API, 2.24x faster.