Documentation

Everything you need to evaluate, secure, and monitor your AI applications with EvalGuard.

Get started

Install, migrate, and run your first eval.

Install the SDK, run your first eval in under 5 minutes.

Drop-in replacement guide — keep your YAML, gain a dashboard, security, and team features.

Reference for the REST API, CLI, and three first-party SDKs.

307 REST endpoints for evals, security, gateway, traces, datasets, and more.

33 commands: eval, scan, firewall, gateway, models-scan, shadow-ai, siem, debug, BYOK, budgets, and more.

93+ methods covering evals, security, traces, gateway, cost, compliance, and more.

99+ methods with full parity — evals, scans, traces, OTLP, Shadow AI, AI-SPM.

93+ methods for Go backends — evals, security, gateway, monitoring, compliance.

What ships in the box — scorers, attack plugins, and provider adapters.

166 built-in scorers across 8 categories: accuracy, relevance, safety, quality, RAG, agent, cost, custom.

249 red-team plugins across 43 adversarial strategies.

87 LLM providers including OpenAI, Anthropic, Gemini, Bedrock, Azure, Vertex, Groq, and more.

Wire EvalGuard into your stack and deploy on your terms.

15 integrations — Slack, Discord, Teams, PagerDuty, Jira, Linear, GitHub Actions, GitLab CI, and more.

Point any OTLP/HTTP exporter at EvalGuard. Traces, metrics, and logs — no agent install.

Docker Compose, Kubernetes, and Helm deployment guides.

Mapping findings to compliance frameworks.

33 frameworks — OWASP LLM Top 10, NIST AI RMF, MITRE ATLAS, EU AI Act, ISO 42001, SOC 2, GDPR, HIPAA, India DPDP, and more.

Get running with EvalGuard in three commands.

npm install @evalguard/sdk
npx @evalguard/cli login --key eg_your_api_key
npx @evalguard/cli eval my-eval.json