Continuous Monitoring

Keep watch as your AI changes.

Your prompts, models, and tools keep changing. WardenBot checks for leaks, wrong answers, unsafe actions, and new access. Cover up to 100 endpoints with Watch; add authenticated agent and MCP monitoring with Sentry.

Concrete failures

Watch the answers, actions, and access that matter.

We exercise the same interfaces your customers and agents use. Alerts include the failing probe, what changed, and enough context for your team to investigate.

Your bot invents a refund policy

Your support widget says refunds last 60 days instead of 30. The business truth set fails and you get an alert before customers rely on it.

A model update weakens refusal behavior

A jailbreak that failed yesterday starts working today. WardenBot shows the before-and-after response and the exact probe.

An MCP tool gains new permissions

A connector update exposes a new write action. Sentry flags the tool and permission change so your team can review the added access.

How it works

Connect. Test. Investigate. Fix.

WardenBot combines browser automation, curated adversarial corpora, canaries, truth assertions, and layered grading so alerts stay specific enough to fix.

  1. 01

    Connect your bot or MCP server

    Share your bot, API, or MCP endpoint. We confirm compatibility, test accounts, tool permissions, and the checks included in your plan.

  2. 02

    Add facts and canaries

    Define the business truth set and place canary phrases where the bot can see them but should never reveal them.

  3. 03

    Run external probes

    WardenBot drives the bot from the outside on the tier schedule: heartbeat, probe packs, multi-turn tests, and journeys.

  4. 04

    Alert and remediate

    You get clear alerts, behavior diffs, trace evidence, and agent-ready remediation when something changes.

Feature set

See what changed and why it matters.

Track leaked canaries, incorrect business facts, prompt injection, and unsafe agent behavior. Sentry extends the checks to MCP tools, permissions, and authenticated journeys.

Test the real customer journey

Browser and API probes check your bot's answers, availability, and response time. Sentry adds authenticated workflows with your test accounts.

Catch leaks and wrong answers

Canary phrases reveal exposure of protected content. Business fact checks catch invented prices, policies, and product claims.

Track behavior changes

Compare responses after model, prompt, and content changes. Alerts show the failing conversation and the earlier baseline.

Watch MCP tools and access

Sentry tracks tool inventories, schema changes, and permission drift on approved MCP servers, with recurring authorization and poisoning probes.

Exercise agent attack paths

Multi-turn tests probe how retrieved content, tool responses, and memory influence agent actions. Sentry adapts attacks to observed behavior.

Turn alerts into fixes

Evidence, affected components, fix objectives, and validation steps arrive together. Your engineers or coding agents can start from a concrete task.

Plans

From your first bot to hundreds of endpoints.

Watch covers up to 100 endpoints at $299/month. Patrol adds deeper testing across up to 500 endpoints at $499/month. Sentry covers unlimited bot, agent, or MCP endpoints at $999/month.

For everyday monitoring

Watch

$299/mo

Know when your chatbots leak information, give the wrong answers, or stop working. Daily checks keep the basics under watch.

View Watch
  • Up to 100 chatbot or AI application endpoints
  • Daily availability, latency, prompt leak, and safety checks
  • Weekly jailbreak and prompt injection probe pack
  • 3 canary phrases and 15 business facts checked for leaks and accuracy
For growing AI products

Patrol

$499/mo

Track security and answer quality across your bots. Catch regressions after prompt, model, retrieval, and vendor changes.

View Patrol
  • Everything in Watch, across up to 500 bot or AI endpoints
  • Daily prompt injection, jailbreak, and sensitive data probes
  • Weekly multi-turn attacks and retrieval poisoning scenarios
  • 10 canary phrases and 50 business facts across the plan
Browser, API, and MCP access

Connect the interfaces you already run.

Browser probes work with common chatbot widgets and custom selectors. API and MCP checks use approved endpoints and test credentials. We confirm compatibility before monitoring begins.

VoiceflowIntercom FinCrispChatBaseTidioSierraDriftHubSpot ChatCustom widgets
From alert to action

Make every alert useful to the team fixing it.

Monitoring findings carry the conversation, affected surface, and suggested fix. Use a scoped penetration test when a failure needs a deeper investigation across your application and infrastructure.

  • Reproduce the failure with the exact probe and response.
  • Review the affected bot, tool, role, or permission boundary.
  • Compare behavior against the last known baseline.
  • Turn the finding into a fix task and a recurring regression check.
Ready for proof

Put your next model or tool change under watch.

Share your bot, agent, or MCP endpoint and the facts, data, and permissions that matter. We will confirm compatibility and a testing schedule.