#Validation Runbook

Operational runbook for diagnosing and resolving issues with multi-tier fact validation.

Note: Content is pending — this is a stub created from the runbook template.

---

#Overview

This runbook covers the 4-phase validation pipeline: structural checks, internal consistency, cross-model verification, and evidence corroboration.

Owner: validation-engineer

Escalation Path: architect-steward → on-call engineer

---

#Quick Reference

Metric	Healthy	Warning	Critical
Validation queue depth	< 30	30-100	> 100
Validation pass rate	> 70%	50-70%	< 50%
Stuck facts (pending > 24h)	0	1-10	> 10

---

#Diagnostic Decision Tree

Are facts being validated?
├── No → Check worker-validate health endpoint
│   ├── Worker down → Restart worker
│   └── Worker up → Check VALIDATE_FACT queue
│       ├── Queue empty → Check upstream extraction
│       └── Queue has messages → Check AI provider for cross-model phase
└── Yes → Check pass rates
    ├── Low pass rate → Check Phase 3/4 thresholds
    ├── Facts stuck in pending → Check validation-retry cron
    └── Evidence phase failing → Check Wikipedia/Wikidata API access

---

#Common Issues

To be documented as issues are encountered.

---

#Related Documents

• Queue Runbook
• Fact Extraction Runbook
• Architecture Overview