{"slug":"langfuse","url":"https://www.altairalabs.ai/vs/langfuse/","markdown":"https://www.altairalabs.ai/vs/langfuse.md","name":"Langfuse","vendor":"Langfuse, now part of ClickHouse","category":"Tracing and evaluation","checked":"2026-10-22","summary":"Omnia acts on what it measures: simulated users before release, rollout on live scores and policy on each tool call, with traces still going to Langfuse. Langfuse records and scores, and acting on it is left to you.","headline":"We already trace everything in Langfuse.","scene":{"setup":"An online evaluator flags a jump in wrong answers.","omnia":"That version was on part of the traffic, as every new version is. The same metrics stopped its promotion and rolled it back, and its failing sessions became regression scenarios.","omniaCaps":["progressive-rollout","metric-gated-promotion","prod-to-regression"],"them":"Online evaluation scores live traces as they arrive. Langfuse describes its role as ex-post evaluation, and points to other libraries for run-time measures.","source":"https://langfuse.com/docs/security-and-guardrails","omniaEvidence":"https://omnia.altairalabs.ai/tutorials/progressive-rollouts/"},"differences":[{"title":"Scores that move traffic","body":"Evaluations score live sessions, and the rollout reads those scores. Promotion and rollback follow from them automatically.","caps":["progressive-rollout","metric-gated-promotion","inline-evals"],"them":"Online evaluators score traces as they arrive; acting on the score is up to you.","source":"https://langfuse.com/docs/evaluation/get-started/online","omniaEnterprise":true,"omniaEvidence":"https://omnia.altairalabs.ai/tutorials/progressive-rollouts/"},{"title":"Simulated users, built in","body":"Simulated users ship with the platform and run against each version through its real tools, hostile and duplex voice callers included. The release waits on the suite.","caps":["selfplay","adversarial","voice-testing","deploy-gate"],"them":"Simulated multi-turn conversations are a cookbook built on the OpenEvals library.","source":"https://langfuse.com/guides/cookbook/example_simulated_multi_turn_conversations","omniaEnterprise":false,"omniaEvidence":"https://promptarena.altairalabs.ai/arena/explanation/scenario-design/"},{"title":"Policy before the tool runs","body":"Each tool call’s arguments and caller are checked against a CEL rule first. Named fields in the response are redacted before the model reads it.","caps":["per-call-policy","tool-response-redaction"],"them":"Run-time security is left to separate libraries.","source":"https://langfuse.com/docs/security-and-guardrails","omniaEnterprise":true,"omniaEvidence":"https://omnia.altairalabs.ai/how-to/security/configure-tool-policies/"}],"rows":[{"topic":"Open source","omnia":"PromptArena and PromptKit, Apache 2.0.","caps":["selfplay"],"them":"MIT outside the enterprise folders.","coverage":"yes","source":"https://langfuse.com/docs/open-source","omniaEnterprise":false,"omniaEvidence":"https://promptarena.altairalabs.ai/arena/explanation/scenario-design/"},{"topic":"OpenTelemetry","omnia":"Emits it, and ingests it from agents elsewhere.","caps":["tracing","observe-remote"],"them":"Ingests OTLP over HTTP.","coverage":"yes","source":"https://langfuse.com/integrations/native/opentelemetry","omniaEnterprise":false,"omniaEvidence":"https://omnia.altairalabs.ai/reference/platform/telemetry/"},{"topic":"CI gate","omnia":"The suite gates the release.","caps":["deploy-gate"],"them":"A GitHub Action fails on a score threshold.","coverage":"yes","source":"https://langfuse.com/docs/evaluation/experiments/experiments-ci-cd","omniaEnterprise":false,"omniaEvidence":"https://promptarena.altairalabs.ai/arena/how-to/interfaces/run-in-ci/"},{"topic":"Simulated users","omnia":"Built in, against real tools.","caps":["selfplay"],"them":"Cookbook.","coverage":"partly","source":"https://langfuse.com/guides/cookbook/example_simulated_multi_turn_conversations","omniaEnterprise":false,"omniaEvidence":"https://promptarena.altairalabs.ai/arena/explanation/scenario-design/"},{"topic":"Voice testing","omnia":"Barge-in, overlap, dead air.","caps":["voice-testing"],"them":"Not documented.","coverage":"undocumented","source":"https://langfuse.com/docs/evaluation/overview","omniaEnterprise":false,"omniaEvidence":"https://promptarena.altairalabs.ai/arena/how-to/voice/setup-voice-testing/"},{"topic":"Runs and rolls out agents","omnia":"Yes, with automatic rollback.","caps":["progressive-rollout"],"them":"Observes only.","coverage":"undocumented","source":"https://langfuse.com/docs/evaluation/overview","omniaEnterprise":false,"omniaEvidence":"https://omnia.altairalabs.ai/tutorials/progressive-rollouts/"},{"topic":"Runtime enforcement","omnia":"Per-call policy and redaction.","caps":["per-call-policy"],"them":"Not in scope.","coverage":"undocumented","source":"https://langfuse.com/docs/security-and-guardrails","omniaEnterprise":true,"omniaEvidence":"https://omnia.altairalabs.ai/how-to/security/configure-tool-policies/"}],"faq":[{"q":"Can I keep Langfuse and use Omnia?","a":"Yes. Omnia emits standard OpenTelemetry, which Langfuse ingests."},{"q":"Who owns Langfuse?","a":"ClickHouse acquired Langfuse in January 2026; the core stays MIT licensed."}]}