Keep your traces. Add security and compliance.
Comet Opik is a great open-source LLM tracing + evaluation platform. EvalGuard imports your Opik traces and spans — model, provider, token usage, cost, and feedback scores all carry over — then adds hosted red-team scans (300+ plugins), a runtime LLM firewall, an AI gateway, and a SOC 2 evidence engine on the same data. No sign-up needed to run your first import.
Honest positioning
Where Opik stops, EvalGuard keeps going
Opik is a first-class open-source tracing + eval tool — clean SDK, native cost tracking, self-hostable. EvalGuard overlaps on tracing and evals, then extends into the hosted security platform, runtime firewall, AI gateway, and compliance work you'd otherwise buy separately.
| Capability | Comet Opik | EvalGuard |
|---|---|---|
| Open-source LLM tracing + spans | Yes | Yes — OTLP + OpenInference ingestion, governed |
| Evaluation + feedback scores | Yes | Yes — 200+ scorers (LLM-as-judge, pairwise, rubric) |
| Native cost / token tracking | Yes | Yes — per-org cost ledger + budgets |
| Open source & self-hosting | Yes | Yes — Apache-2.0 core, self-host available |
| Red-team & security scans | Not offered | Yes — 300+ attack plugins with threat-feed sync |
| Runtime LLM firewall / guardrails | Not offered | Yes — real-time input + output firewall |
| AI gateway / BYOK proxy | Not offered | Yes — BYOK gateway, 15 proxied providers, semantic cache |
| SOC 2 evidence engine | Not offered | Yes — live evidence engine + audit log |
Migration path
Bring your traces in one command
Everything stays local until you choose to run it — we never touch your Opik project. Export your traces, then convert them to neutral-shape spans with the EvalGuard CLI.
# Python: traces = client.search_traces(project_name='...', truncate=False)
# json.dump([t.dict() for t in traces], open('opik-traces.json','w'))npx @evalguard/cli import:traces --from opik opik-traces.json --output spans.jsonnpx @evalguard/cli scan # 300+ red-team attacks on your migrated dataModel, provider, token usage, cost, and every feedback_score map over natively — a failed check stays a normal run, only a real error is flagged. Then layer on red team, a runtime firewall, and a SOC 2 evidence engine.
Want a hand with the migration?
Send us your Opik export and we'll help you map it and validate the first import. Free.