Stealth benchmarks
Our benchmarks, run privately for your organization.
Public benchmarks run on Fridays. Stealth benchmarks run every day.
Benchmark summaries
Latest results
Public results, updated every Friday.
What you get
Daily runs
Public benchmarks run every Friday. With stealth benchmarks, the same benchmarks also run every day in your organization. Daily results stay private.
Pinned regions
Pick the regions your benchmarks run in. Without stealth benchmarks, runs use the default region.
Start in stealth, publish when you're ready
Providers that aren't live yet can start with stealth benchmarks. Results stay private until you join the public leaderboard.
- StealthPrivate, daily runs
- PublishWhen you're ready
- Public leaderboardRanked every Friday
On-demand runs
Rerun a benchmark whenever you want instead of waiting for the next scheduled run.
Run logs
On both plans, every run includes its logs, with the request, region and timing behind each result.
A CLI for your agents
Runs, results and logs are available from the bench CLI as JSON, the same data as the dashboard.
npm i -g @benchsdk/runner
bench auth login
bench results sandbox-dax-daily --jsonStealth-only benchmarks
Benchmarks that aren't on the public leaderboard. They run privately, for your organization only.
Public vs stealth
| Feature | Public Free | Stealth Paid |
|---|---|---|
| Schedule | Every Friday | Every day |
| Results | Public leaderboard | Private to your organization |
| Region | Default region | Pinned regions |
| Usage charges for runs | Paid by you | Paid by you |
| Stealth-only benchmarks | Not included | Included |
| On-demand reruns | Not included | Included |
| Run logs | Included | Included |
| Scheduled public releases | Not included | Included |
| Available before you go live | Not included | Included |
Pricing
Public benchmarks are free. Stealth benchmarks are priced per category.
Public benchmarks
$0forever
- Ranked every Friday
- Results on the public leaderboard
- Runs in the default region
- Results via web, API and CLI
- Run logs
- You cover the usage charges for runs
Stealth benchmarks
Per category
Added to your platform organization.
Includes:
- The public benchmarks, run every day, privately
- Stealth-only benchmarks, never published
- Pinned regions
- On-demand reruns
- Scheduled public releases
- Available before you go live
On both plans, you cover the usage charges our benchmarks incur on your platform. See Responsibility for Benchmark Charges in our Terms.
Need every category or custom benchmarks? Talk to us →