Reliability Benchmarks

Our reliability benchmark creates a sandbox, runs a workload, and destroys it every minute to test the uptime reliability of sandbox providers. All times are UTC.

All passedBlipsDownMissed (scheduler)Pending
ParticipantUptimeDowntimep50
Schedulerours4.19%16349 missed—
Promigence100%—153ms
Novita100%—821ms
Gravixlayer99.85%1 min257ms
Buddy99.85%1 min459ms
sfcompute99.85%1 min1.09s
Freestyle99.85%1 min1.27s
Upstash99.71%2 min905ms
Railway99.70%2 min5.05s
CreateOS99.57%3 min299ms
Beam99.57%3 min511ms
E2B99.57%3 min1.66s
Isorun99.43%4 min239ms
Sandbox099.29%5 min3.04s
Sail99.29%5 min3.29s
Daytona99.15%6 min418ms
Superserve99.00%7 min447ms
Vercel98.86%8 min1.76s
Tenki98.72%9 min1.02s
Sprites98.58%10 min902ms
Blaxel98.44%11 min498ms
Cloudflare98.44%11 min692ms
Arker98.30%12 min424ms
CodeSandbox98.30%12 min8.27s
Tensorlake97.87%15 min2.25s
Modal97.73%16 min781ms
Mosaic97.45%18 min890ms
Run Cloud97.45%18 min4.40s
Archil97.31%19 min282ms
Namespace96.74%23 min2.23s
Cloud Run96.32%26 min739ms
Miosa95.92%29 min192ms
Declaw76.00%6 min43.66s
Microsandbox40.74%16 min27.58s
Hopx0.00%5 min—
Lightning AI0.00%5 min—
Northflank0.00%5 min—
OpenComputer0.00%5 min—

Hover a cell for its numbers. Click a participant cell to open their checks for that day.

  • DownTenki
    Wed, Nov 4 08:28 UTC → Wed, Nov 4 08:31 UTC · 4 min · 3 failed
    step_timeout
  • DownSail
    Wed, Nov 4 04:51 UTC → Wed, Nov 4 04:54 UTC · 4 min · 3 failed
    step_timeout
What went wrong (8 errors)
  • 129×reliability_install_failed
  • 106×reliability_run_failed
  • 57×reliability_create_failed
  • 12×step_timeout
  • 10×participant failed
  • 6×reliability_verify_failed
  • 2×probe_failed
  • 1×participant failed before reporting results

How it works: a ComputeSDK Actions run fires on schedule and, for each provider, creates a fresh sandbox through that provider’s ComputeSDK adapter — the same create path our TTI and DAX benchmarks use. Inside the sandbox it writes a 1 MiB file of random data, SHA-256 hashes it twice, requires the digests to match, deletes the file, and destroys the sandbox. The check passes only if the full create → probe → destroy loop succeeds in time; runs that fail to dispatch count as scheduler misses, not provider downtime.

Need a provider’s uptime on demand? Sign up for a free ComputeSDK account and query any provider’s status through the API, CLI, or MCP.

On this leaderboard? Your next public run is benchmark Friday — know your number every day.Get stealth benchmarks →