Benchmarks
Publish comparable checks — or publish the gap.
No public cross-vendor flight-performance benchmark is claimed for the current browser-only Open Studio tools. The published checks concern deterministic inputs, workflow outputs, routes, and builds.
Current benchmark register
What can be compared today
| Check | Current state | What it does not prove |
|---|---|---|
| Deterministic sample replay | Available in the three browser tools | Field performance or hardware compatibility |
| Input validation and boundary handling | Locally checked per release record | Safety certification or legal compliance |
| Exported decision/evidence record | Locally checked per release record | Completeness of operator evidence in every jurisdiction |
| Cross-vendor performance | Not published | No ranking or superiority claim is made |
| Independent replay | Not yet recorded publicly | E4 status is not claimed |
Benchmark integrity
Future comparisons must use the same input set, environment, success criterion, cost boundary, and version. Tuned or synthetic results must be labelled as such.