Reliability Benchmarks

Our reliability benchmark creates a sandbox, runs a workload, and destroys it every minute to test the uptime reliability of sandbox providers. All times are UTC.

All passedBlipsDownMissed (scheduler)Pending
ParticipantUptimeDowntimep50
Schedulerours8.65%7207 missed—
Promigence100%—153ms
Miosa100%—192ms
Archil100%—281ms
CreateOS100%—297ms
Daytona100%—415ms
Superserve100%—445ms
Blaxel100%—494ms
Beam100%—509ms
Novita100%—821ms
Mosaic100%—885ms
Upstash100%—902ms
Vercel100%—1.76s
Namespace100%—2.22s
Tensorlake100%—2.25s
Run Cloud100%—4.39s
Isorun99.85%1 min237ms
Gravixlayer99.85%1 min257ms
Arker99.85%1 min422ms
Buddy99.85%1 min459ms
Cloudflare99.85%1 min685ms
Cloud Run99.85%1 min739ms
Modal99.85%1 min779ms
sfcompute99.85%1 min1.09s
Freestyle99.85%1 min1.27s
E2B99.85%1 min1.64s
Sandbox099.85%1 min3.03s
CodeSandbox99.85%1 min8.27s
Sprites99.70%2 min871ms
Railway99.70%2 min5.05s
Sail99.56%3 min3.27s
Tenki99.12%6 min1.00s

Hover a cell for its numbers. Click a participant cell to open their checks for that day.

  • MissedAll participants
    Tue, Nov 3 22:33 UTC → Tue, Nov 3 22:36 UTC · 4 min · 0 failed, 3 missed
  • MissedAll participants
    Thu, Oct 29 00:00 UTC → Tue, Nov 3 00:00 UTC · 5 d 0 h · 0 failed, 7200 missed
What went wrong (4 errors)
  • 12×step_timeout
  • 10×participant failed
  • 2×probe_failed
  • 1×participant failed before reporting results

How it works: a ComputeSDK Actions run fires on schedule and, for each provider, creates a fresh sandbox through that provider’s ComputeSDK adapter — the same create path our TTI and DAX benchmarks use. Inside the sandbox it writes a 1 MiB file of random data, SHA-256 hashes it twice, requires the digests to match, deletes the file, and destroys the sandbox. The check passes only if the full create → probe → destroy loop succeeds in time; runs that fail to dispatch count as scheduler misses, not provider downtime.

Need a provider’s uptime on demand? Sign up for a free ComputeSDK account and query any provider’s status through the API, CLI, or MCP.

On this leaderboard? Your next public run is benchmark Friday — know your number every day.Get stealth benchmarks →