Skip to main content

Validation Agent

Position in pipeline: Agent 2
Phase: 1 — Spec Validation Gate
Min confidence: 0.90
Version: 1.0.0


Role

The Validation Agent is the Spec Validation Gate enforcer. It detects ambiguity, validates domain term usage, and scores each requirement's testability before any human review occurs. Only "Peer-Approved" specs from the Validation Agent reach the human Tech Lead, filtering noise from the review cycle.


What it validates

CheckAutomatedWhat it looks for
Category checkYesRequirement is correctly typed (FEATURE/BUG/IMPROVEMENT)
Slice assignmentYesRequirement is assigned to an active slice
EARS syntax complianceYes (linter)Requirements follow EARS patterns
Domain term resolutionYesEvery noun in the requirement exists in domain-model.md
Testability scoreYesScore ≥ 0.80 — the requirement can generate meaningful tests
Risk score assignmentYesLOW or HIGH risk assigned to every requirement
Actor precisionYesNo "user" — specific actors only
NFR measurabilityYesAll NFRs include numeric targets

Primary output: spec-validation-report.md

# Spec Validation Report

Validation Agent confidence: 0.0–1.0
Slice: [SLICE-NNN]
Date: [ISO date]

## Summary
- Total requirements: N
- Passed: N
- Blocked: N
- Slice status: READY | PARTIAL | BLOCKED

## Requirement Results

### REQ-001: [Name]
- Status: PASSED | BLOCKED
- Testability score: 0.0–1.0
- Risk: LOW | HIGH
- Issues:
- [DOMAIN_TERM_UNDEFINED] "Settlement" not found in domain-model.md
- [ACTOR_UNDEFINED] "user" is not a valid actor — specify "authenticated merchant"
- [NFR_UNMEASURABLE] "fast" is not a measurable target

## Uncertainty Factors (if confidence < 0.95)
- [What the agent is uncertain about and why]

Gate failure behavior

FailureResponse
Individual requirement failsMarked BLOCKED — VALIDATION FAILED
Other requirements in same sliceMay proceed if they pass
Slice statusPARTIAL until all MUST requirements pass
OutputValidation Agent emits structured failure report
Sprint gateNo blocked requirement may enter a sprint

The Validation Agent does not stop the entire pipeline. Only the failing slice is blocked. Other slices continue independently.


Governance

RuleBehavior
Confidence < 0.90Block pipeline for this slice; require TL sign-off
CCS checkIf Discovery + Spec CCS falls below threshold, Validation Agent flags governance block
Dissent noticesChecks dissent log for any open notices against requirements in this slice

Resolution after failure

When a requirement fails the Validation Gate:

  1. Validation Agent emits a structured failure report with specific issues
  2. TL and PO collaborate to re-specify or re-slice the failing requirements
  3. Spec Agent re-generates the corrected requirements
  4. Validation Agent re-runs on the corrected version

For auto-approved slices, the Knowledge Agent monitors Regret Metrics — instances where an auto-approved requirement later caused production issues — to refine future auto-approval thresholds.


Next agents

  • Domain Agent — validates and extends the domain model after spec approval
  • QA Agent — peer-reviews specs before they reach the human TL (QA Agent Mode C)