CreateOS vs IsorunSandbox Benchmark Comparison

CreateOS
Faster in 0 of 2
vs
Isorun
Faster in 2 of 2

Isorun was faster in both shared sandbox benchmarks.

Shared benchmarks
2
Last run
October 30, 2026
Want the full run details?Sign up free →

Scorecard

Median of each benchmark's primary metric; lower is better. Medians within 5% count as roughly even, and a benchmark gets no speed verdict when either provider completed fewer than 50% of runs.

BenchmarkCreateOSIsorunResultRatio
Burst TTI
Time to interactive · Run October 30, 2026
136ms
100% success
49ms
100% success
Isorun faster
2.78x
DAX
Total workload time · Run October 30, 2026
53.21s
100% success
36.13s
100% success
Isorun faster
1.47x

Burst TTI

Run October 30, 2026

Time from sandbox creation to the first successful command, with 100 sandboxes launched at the same time.

Time to interactive

CreateOS

100% success
Median
136ms
P95
176ms
P99
178ms
CreateOS Burst TTI results →

Isorun

100% success
Median
49ms
P95
57ms
P99
63ms
Isorun Burst TTI results →

Isorun had a 2.78x lower median time to interactive (49ms vs 136ms for CreateOS).

Median time to interactive over time

31 runs from July 2, 2026 to October 30, 2026.

CreateOSIsorun
View the full Burst TTI leaderboard →

DAX

Run October 30, 2026

A real developer workload: install system packages, download Bun, clone the opencode repo, then run bun install and bun typecheck.

Total workload time

CreateOS

100% success
Median
53.21s
P95
53.21s
P99
53.21s
CreateOS DAX results →

Isorun

100% success
Median
36.13s
P95
36.13s
P99
36.13s
Isorun DAX results →

Isorun had a 1.47x lower median total workload time (36.13s vs 53.21s for CreateOS).

Median total workload time over time

16 runs from August 7, 2026 to October 30, 2026.

CreateOSIsorun
View the full DAX leaderboard →

Cost per DAX run

Each provider's DAX median total workload time (run October 30, 2026) multiplied by its published rate at the 8 vCPU / 16 GiB benchmark spec. Workload time excludes sandbox create and destroy, and subscription floors and included credits are not modeled.

CreateOS

Per-second wall clock
$0.0098per run
53.21s median at $0.6624/hr

$0.0504/vCPU-hr + $0.0162/GiB-hr — parity with E2B. No egress fees.

Source pricing page

Isorun

Per-second wall clock
$0.0044per run
36.13s median at $0.4400/hr

$0.025/vCPU-hr + $0.015/GiB-hr. Published profile for 8 vCPU + 16 GiB is exactly $0.44/hr.

Source pricing page
Compare sandbox costs across all providers →

Methodology

  • One workload, every provider. The same script, payload, and model hit every provider, addressed the way its own API expects. Nobody gets a tuned or special path.
  • Repeated on a schedule. Every suite runs many iterations per provider, automated on a recurring schedule, so results reflect steady state rather than one lucky request.
  • Raw results published. Every run is committed as JSON to the public benchmarks repo, next to the code that produced it. Nothing is cherry-picked or held back.
  • How this comparison is built. Each benchmark compares the two providers' medians; results within 5% count as roughly even. A comparison is published only when both providers completed at least 50% of runs in 2 or more shared benchmarks run in the last 30 days.

Frequently asked questions

Have another question? Email us.

Isorun was faster in both shared sandbox benchmarks. In Burst TTI (October 30, 2026), Isorun had a median time to interactive of 49ms versus 136ms for CreateOS, 2.78x faster. In DAX (October 30, 2026), Isorun had a median total workload time of 36.13s versus 53.21s for CreateOS, 1.47x faster.

PartnersGoogle Cloud Run