Wade Foster is at Zapier, and AutomationBench is their own benchmark rather than a public one.
Wade Foster
GPT 6 Astra is here. We ran the numbers on AutomationBench:
It's the highest score we've ever recorded. Clean sweep across every domain.
Scores 41.4% at Max effort. For context, no model had cleared 40% before today (GPT-5.6-Sol scored 28.8%)
Dan Shipper
3h
Astra one-shotted the first draft of its own vibe check for @every 🤯
we learned Astra was launching at 3 am yesterday morning. by 7 am we had a 3,000 word vibe check written.
Bhavy☄️
4h
GPT-6 Astra vs Kimi K3 vs Fable 5.1 vs Sol
Astra is a beast at 3D scenes, a clear jump up from Sol.
Kimi K3 is real competition. It generated this for $2.3. Waiting on Kimi K3.1.
With Fable 5.1, I was expecting a much better result.
Viktor Oddy
6h
GPT-6 Astra Is Finally Here (And It's REALLY Good)
One-shot anything.
