incident-to-eval
Turns a production AI-agent incident into a portable, validated regression case.
Turns a production AI-agent incident into a portable, validated regression case.
incident-to-eval reconstructs what happened in a production agent incident, classifies the failure, and writes a portable JSON case with a minimal reproducer, closed assertions, and a guard condition. A deterministic validator checks the format, while any CI job, evaluation platform, or test runner can enforce the resulting case. The skill authors the regression guard; it is not itself an evaluation platform or runner.
Resource types
Use cases
Platforms
Runtime
Test mobile and desktop app navigation without routine screenshots.
Capture and decode logic-analyzer signals through natural-language requests.
Capabilities
Public GitHub facts last synced Jul 10, 2026.
Turn one browser exploration into repeatable end-to-end tests.
Query CloudWatch in natural language and investigate AWS incidents from Claude Code.