Files
konstruct/.planning/phases/06-web-chat/06-VALIDATION.md

3.0 KiB

phase, slug, status, nyquist_compliant, wave_0_complete, created
phase slug status nyquist_compliant wave_0_complete created
6 web-chat draft false false 2026-03-25

Phase 6 — Validation Strategy

Per-phase validation contract for feedback sampling during execution.


Test Infrastructure

Property Value
Framework pytest 8.x + pytest-asyncio (existing)
Config file pyproject.toml (existing)
Quick run command pytest tests/unit -x -q
Full suite command pytest tests/ -x
Estimated runtime ~30 seconds

Sampling Rate

  • After every task commit: Run pytest tests/unit -x -q
  • After every plan wave: Run pytest tests/ -x
  • Before /gsd:verify-work: Full suite must be green
  • Max feedback latency: 30 seconds

Per-Task Verification Map

Task ID Plan Wave Requirement Test Type Automated Command File Exists Status
06-xx 01 1 CHAT-01,02 unit pytest tests/unit/test_web_channel.py -x W0 pending
06-xx 01 1 CHAT-03 unit pytest tests/unit/test_web_conversations.py -x W0 pending
06-xx 01 1 CHAT-04 unit pytest tests/unit/test_web_rbac.py -x W0 pending
06-xx 02 2 CHAT-01,05 build cd packages/portal && npx next build pending
06-xx 02 2 CHAT-03 build cd packages/portal && npx next build pending

Status: pending · green · red · ⚠️ flaky


Wave 0 Requirements

  • tests/unit/test_web_channel.py — CHAT-01,02: web normalizer, WebSocket message handling
  • tests/unit/test_web_conversations.py — CHAT-03: conversation CRUD API
  • tests/unit/test_web_rbac.py — CHAT-04: RBAC enforcement on chat endpoints

Manual-Only Verifications

Behavior Requirement Why Manual Test Instructions
WebSocket chat sends message and receives real-time reply CHAT-01,05 Requires live WebSocket + LLM Open /chat, select agent, send message, verify response appears
Conversation history loads on page visit CHAT-03 UI rendering Navigate away and back to /chat, verify previous messages visible
Typing indicator displays during response generation CHAT-05 UI animation Send message, observe animated dots before response
Agent markdown renders correctly CHAT-05 Visual rendering Trigger a response with code blocks / lists / bold
Operator can chat but not see admin nav items CHAT-04 RBAC visual Login as operator, verify /chat accessible but admin-only items hidden

Validation Sign-Off

  • All tasks have <automated> verify or Wave 0 dependencies
  • Sampling continuity: no 3 consecutive tasks without automated verify
  • Wave 0 covers all MISSING references
  • No watch-mode flags
  • Feedback latency < 30s
  • nyquist_compliant: true set in frontmatter

Approval: pending