Reliability Benchmarks

Our reliability benchmark creates a sandbox, runs a workload, and destroys it every minute to test the uptime reliability of sandbox providers. All times are UTC.

All passedBlipsDownMissed (scheduler)Pending
ParticipantUptimeDowntimep50
Schedulerours3.84%16349 missed—
Promigence100%—154ms
Novita100%—822ms
Gravixlayer99.83%1 min256ms
Buddy99.83%1 min459ms
sfcompute99.83%1 min1.09s
Freestyle99.83%1 min1.27s
Upstash99.68%2 min907ms
Railway99.67%2 min5.05s
CreateOS99.53%3 min302ms
Beam99.53%3 min513ms
E2B99.53%3 min1.69s
Isorun99.37%4 min241ms
Sandbox099.22%5 min3.05s
Sail99.22%5 min3.31s
Daytona99.06%6 min420ms
Superserve98.91%7 min449ms
Vercel98.75%8 min1.76s
Tenki98.60%9 min1.02s
Sprites98.44%10 min902ms
Blaxel98.29%11 min500ms
Cloudflare98.29%11 min704ms
Arker98.13%12 min424ms
CodeSandbox98.13%12 min8.27s
Tensorlake97.67%15 min2.25s
Modal97.51%16 min778ms
Mosaic97.20%18 min912ms
Run Cloud97.20%18 min4.40s
Archil97.04%19 min284ms
Namespace96.42%23 min2.23s
Cloud Run95.96%26 min741ms
Miosa95.53%29 min192ms
Declaw76.00%6 min43.66s
Microsandbox40.74%16 min27.58s
Hopx0.00%5 min—
Lightning AI0.00%5 min—
Northflank0.00%5 min—
OpenComputer0.00%5 min—

Hover a cell for its numbers. Click a participant cell to open their checks for that day.

No ongoing incidents in this window. Incidents are stretches of 3+ consecutive checks that did not pass.

What went wrong (8 errors)
  • 129×reliability_install_failed
  • 106×reliability_run_failed
  • 57×reliability_create_failed
  • 12×step_timeout
  • 10×participant failed
  • 6×reliability_verify_failed
  • 2×probe_failed
  • 1×participant failed before reporting results

How it works: a ComputeSDK Actions run fires on schedule and, for each provider, creates a fresh sandbox through that provider’s ComputeSDK adapter — the same create path our TTI and DAX benchmarks use. Inside the sandbox it writes a 1 MiB file of random data, SHA-256 hashes it twice, requires the digests to match, deletes the file, and destroys the sandbox. The check passes only if the full create → probe → destroy loop succeeds in time; runs that fail to dispatch count as scheduler misses, not provider downtime.

Need a provider’s uptime on demand? Sign up for a free ComputeSDK account and query any provider’s status through the API, CLI, or MCP.

On this leaderboard? Your next public run is benchmark Friday — know your number every day.Get stealth benchmarks →