Braintrust charges by data processed and scores, with plans from free to Enterprise. Omnia is free while you build, the core is free in production, and the enterprise licence is per environment per year from £30,000, with nothing metered.

omnia vs braintrust

Braintrust measures quality. Omnia makes quality the release gate.

In Omnia the pass threshold, the rollout and the live scores are one system, inside your cluster. Braintrust reports the score to CI; turning it into a release decision is a reporter you write.

A prompt change drops task completion from 94% to 81%.

on omnia

The suite carries its own pass threshold. 81% is below it, so the version stops at the gate. docs

on braintrust

bt eval returns a non-zero exit code if any eval throws an exception. Failing on a score needs a custom reporter. their docs

The gate is the quality bar

Each version faces simulated users, hostile and voice callers, and assertions on the tool calls it makes. The threshold is part of the suite, and the gate reads it directly. docs

Braintrust: CI gates on exceptions by default; voice simulation comes through a partner. source

Online scores that act

Online scores feed the rollout. Each step to more traffic waits for them, and a drop triggers a rollback. docs enterprise

Braintrust: Online scoring runs asynchronously in the background, on a sample. source

All of it in your cluster

Testing, the runtime, the scores and the session archive stay in your Kubernetes cluster, on every edition. docs

Braintrust: Self-hosting is on the Enterprise plan, with Braintrust hosting the control plane. source

At a glance

Topic	Omnia	Braintrust, per its docs
Datasets and scorers	yes Scenarios, assertions and judges. docs enterprise	documented Datasets, scorers, playground. source
Quality gate in CI	yes Built in. docs	partly Custom reporter. source
Simulated users	yes Multi-turn, against real tools. docs	not documented Not documented. source
Voice testing	yes Built in. docs	partly Through a partner. source
Runs and rolls out agents	yes Yes. docs	not documented Not documented. source
Self-hosted	yes Every edition. docs	partly Enterprise, hybrid. source

Common questions

How is each priced?: Braintrust charges by data processed and scores, with plans from free to Enterprise. Omnia is free while you build, the core is free in production, and the enterprise licencelicense is per environment per year from £30,000, with nothing metered.

Put your own agent through the gate.

Install Omnia in your cluster and run it free while you build.

Braintrust claims are from Braintrust’s published documentation, checked 22 October 2026. Spot something out of date? Tell us.

Install it in your cluster Or walk through it with us →