AI safety + compliance for healthcare
The eval + guardrail + red-team + audit platform purpose-built for AI workloads that touch PHI. Eliminate hallucinations on clinical decision support, redact PHI before it reaches third-party LLMs, generate the audit trail your auditors and payers expect.
What ships today
Honest posture, not roadmap promises
Every checked item is in production today. In-progress items are flagged explicitly, and anything needing an auditor we have not engaged is marked not commissioned — no overclaiming, no vapor.
Built for buyer reality
Healthcare AI use cases we ship for
Chart summarization + clinical handoff
AI summarizes a patient chart for a covering clinician at shift change. PHI must stay inside the workload; summaries must not hallucinate a diagnosis or medication that isn't in the record.
EvalGuard features
- PHI firewall: redacts SSN / MRN / DOB / patient name from logs by default
- Hallucination scorer: faithfulness check against the source chart
- Output guardrail: block mode rejects responses introducing un-cited claims
- Audit log: every summary logged with clinician + patient resource_id for §164.312(b)
Patient-facing triage chatbot
Public-internet chatbot collects symptoms + routes patients to the right service. Cannot output medication dosing, cannot impersonate a clinician, cannot leak prior patients' PHI.
EvalGuard features
- Prompt-injection defense: 300+ attack plugins catch jailbreak attempts trying to extract prior sessions
- Output toxicity + medical-advice scorers flag responses crossing into clinical advice
- Per-route rate limits prevent enumeration attacks against the symptom-collection endpoint
- Consent gates at /api/v1/privacy/consent — refuses LLM call when subject withdraws
Prior-authorization automation
AI drafts prior-auth letters from claims + chart data, then a human reviews + signs. PHI flows through multiple LLM calls; cost + audit trail per claim must be perfect for payer disputes.
EvalGuard features
- Gateway cost ledger: per-claim USD attribution + per-tenant daily budget cap
- Tamper-evident audit log (integrity_hash + advisory-lock concurrency) for payer dispute defense
- BYOK provider keys: routes through Vault-stored credentials, never logged
- Multi-model routing with quality-cost strategy — cheapest model meeting accuracy threshold
Voice telemedicine guardrails
Live voice consult between clinician + patient is transcribed + summarized in real-time. Need voice-clone detection, barge-in latency under 250ms, deepfake guard on patient identity verification.
EvalGuard features
- Voice-clone + deepfake guardrails on the realtime voice control plane
- Per-turn voice DLP at /api/v1/voice/guard-turn — spoken or keypad card numbers blocked before the model sees them
- Barge-in latency budget enforceable with per-chunk stream scanning
- Every verification attempt logged with signals for clinical review
Wire it in 60 seconds
Wrap your OpenAI client. Get PHI guardrails for free.
PHI firewall rules + clinical-faithfulness scorers + tamper-evident audit retention are configured once in the EvalGuard control plane. Your code only wraps the client.
import OpenAI from "openai";
import { wrapOpenAI, EvalGuardViolationError } from "@evalguard/openai";
const openai = wrapOpenAI(new OpenAI(), {
apiKey: process.env.EVALGUARD_API_KEY!,
projectId: "phi-chart-summary",
metadata: { vertical: "healthcare", hipaa: true },
blockOnViolation: true, // refuse PHI-leaking prompts
evalOnResponse: { failOnScore: 0.7 }, // clinical-faithfulness gate
onViolation: (r) => alertSecOps(r.violations),
});
try {
await openai.chat.completions.create({
model: "gpt-4o",
messages: [{ role: "user", content: chartSummaryPrompt }],
});
} catch (err) {
if (err instanceof EvalGuardViolationError) {
// Block landed in the tamper-evident audit trail. Replay via audit ID.
}
}wrapOpenAI for wrapAnthropic.Stack
Six surfaces, one platform
Eval, firewall, red-team, audit, BYOK, dashboard — every surface ships out of the box. No bolt-on vendors, no procurement cycle per capability.
Ready to ship clinical AI you can defend?
The Free plan includes the PHI firewall; the full HIPAA control mapping and audit log are on Team. BAA available after our HIPAA attestation (targeted Q2 2027) — register interest at legal@evalguard.ai.
Apache-2.0 SDKs · SOC 2 evidence engine live · full trust center