Failure Scenario 002 · Synthetic RAG fixture
Failure Scenario 002: The citation passed. The evidence was stale.
A citation can resolve while its passage is too old for the proposed answer. The published Pharos Production RAG selection method provides the method context; this fixture compares supplied evidence fields and holds the answer when a required check fails.
This is a synthetic comparison. No retrieval, model evaluation or answer release runs here. Citation PASS means only exact reference resolution within the supplied fixture. It does not establish URL reachability, claim entailment or source truth. The 48-hour maximum age is an illustrative fixture policy, not an industry standard.
Fixture facts
Verifying embedded fixture bytes…
- Fixed evaluation time
- Maximum age
- Not loaded
- Dataset revision
- Not loaded
- SHA-256
- Not loaded
- Release boundary
- answer_released=false · release_eligible=false
Raw fixture provenance
Compare supplied evidence
Comparison result
| Check | Result |
|---|---|
| Citation reference | |
| Full evidence comparison | |
| Cited passage age (hours) |
ALLOW_IN_FIXTURE describes supplied fields only. It grants no operational answer-release permission.
Current input, source row and result export
Limits and source review
The documents and recovery values are invented fixtures, not a client incident or a recovery recommendation. Current-source revisions and verification statuses are supplied fields, not authenticated evidence. Editing them creates no real source verification.
Conflict detection compares exact values for matching claim keys among supplied fresh passages. It cannot detect semantic contradictions in prose, false metadata or missing documents. Ask the source owner to resolve an evidence gap before rebuilding a real answer.
Root AI review and deterministic fixture checks establish reproducibility only. They do not establish independent human review or operating effectiveness.