# Omnia vs Retell AI

> Omnia runs recorded duplex voice tests on every release, gates on them, and rolls out in steps. Retell’s batch tests simulate the call as text, so timing problems only show up on a web call made by hand.

Category: Customer service and voice. Checked against Retell AI’s published material on 2026-10-22. Canonical page: https://www.altairalabs.ai/vs/retell-ai/

## Retell versions and tests voice agents, and Omnia tests them the way a caller hears them, as audio.

Omnia’s voice tests run as audio, so a caller going quiet or talking over the agent is caught before release. Retell’s batch tests simulate a text conversation, and timing problems only show up on a web call someone makes by hand.

## When it matters: A new prompt passes every batch test.

**On Omnia:** On Omnia it also has to pass a set of calls, including a caller who goes quiet to find a card. The new prompt starts talking again before they’re back, so the version stays at the gate. (Omnia docs: https://promptarena.altairalabs.ai/arena/how-to/voice/setup-voice-testing/)

**On Retell AI:** Simulation runs as a text conversation. Voice is tested with manual web calls, and agents using a custom LLM aren’t supported in simulation. (source: https://docs.retellai.com/test/llm-simulation-testing)

## Tests that make the call

Voice scenarios run as duplex audio on every version. Each call is recorded for playback. (Omnia docs: https://promptarena.altairalabs.ai/arena/how-to/voice/setup-voice-testing/)

Retell AI: Automated simulation is text; voice is tested by hand. (source: https://docs.retellai.com/test/test-overview)

## Rollback on a slice of calls

A version that passes the suite takes calls in steps, and Omnia moves traffic back if its metrics drop. Callers already on the line finish on the version they started with. *(enterprise)* (Omnia docs: https://promptarena.altairalabs.ai/arena/how-to/interfaces/run-in-ci/)

Retell AI: Published versions are read-only with prod and staging tags; rolling back means moving the tag. Automatic rollback isn’t documented. (source: https://docs.retellai.com/agent/version)

## Tests that can’t book a real appointment

Tests run against the tools in an environment you choose, and tool-call assertions check what the agent did. Policy on every call refuses anything you haven’t allowed. *(enterprise)* (Omnia docs: https://promptarena.altairalabs.ai/arena/reference/assertions/)

Retell AI: Unmocked functions call their real endpoints during simulation, and MCP tools ignore mocks. (source: https://docs.retellai.com/test/llm-simulation-testing)

## At a glance

| Topic | Omnia | Omnia docs | Retell AI | Retell AI docs | Source |
|---|---|---|---|---|---|
| Immutable versions | A versioned pack. | https://omnia.altairalabs.ai/reference/core/promptpacksource/ | Read-only published versions. | documented | https://docs.retellai.com/agent/version |
| Batch regression tests | Yes, and they gate the release. | https://promptarena.altairalabs.ai/arena/explanation/scenario-design/ | Batch tests with an API. | documented | https://docs.retellai.com/test/batch-test-simulation |
| Automated voice tests | Barge-in, overlap, dead air. | https://promptarena.altairalabs.ai/arena/how-to/voice/setup-voice-testing/ | Text simulation only. | not documented | https://docs.retellai.com/test/llm-simulation-testing |
| Adversarial callers | Yes. | https://promptarena.altairalabs.ai/arena/how-to/voice/voice-red-team/ | Not documented. | not documented | https://docs.retellai.com/test/test-overview |
| Stepped rollout, auto rollback | Yes. | https://omnia.altairalabs.ai/tutorials/progressive-rollouts/ | A/B split across agents. | partly documented | https://docs.retellai.com/deploy/ab-testing |
| PII redaction | Sessions and memory. *(enterprise)* | https://omnia.altairalabs.ai/how-to/privacy/configure-privacy-policies/ | Per-minute add-on. | documented | https://www.retellai.com/pricing |
| Runs in your infrastructure | Yes. | https://omnia.altairalabs.ai/how-to/workspaces/manage-workspaces/ | Not documented. | not documented | https://www.retellai.com/pricing |

## Questions

**How is each priced?**

Retell charges per minute, with add-ons such as PII removal priced per minute too. Omnia has no per-minute meter: free while you build, the core free in production, and an enterprise licence per environment per year from £30,000.