Introducing provider add-ons

Today I'm excited to announce our first product and it's built around our benchmarks.

In a very noisy market Sandbox, AI Gateway, Browser, and Storage providers have been using our benchmarks as signals to prospects, investors, and customers.

Since the beginning we've been working with providers to help them understand and improve their performance. We started to see trends between the 50+ infra companies that we support and decided that there could be a real product to offer here.

What providers asked for

• Experiment in private. Providers wanted to be able to experiment with their infra and performance in private. They were comfortable with a big show on Fridays, but wanted more telemetry so they could bring their best to the public releases.
• More data points. They wanted to see more of our runs on a consistent basis so they could get more data points on how their infra worked.
• More foresight. They wanted more insight into what we were planning so they wouldn't be caught off guard when we released a new benchmark.

What's included

To that end our provider add-ons are built around daily private runs, with an option for providers to rerun as they need. We're also now releasing new benchmarks two weeks early to subscribed providers so they have plenty of forewarning of new benchmarks.

We, of course, have all of the table stakes features that providers expect for their agents like logs, CLI access, and APIs to make performance work even easier than before.

Get started

If you're a provider who wants to improve your performance you can subscribe to your category add-ons here or reach out to us in slack.

P.S. We also offer free accounts for our weekly runs with features like logs, CLI access, and APIs.