3.0 KiB
3.0 KiB
phase, slug, status, nyquist_compliant, wave_0_complete, created
| phase | slug | status | nyquist_compliant | wave_0_complete | created |
|---|---|---|---|---|---|
| 6 | web-chat | draft | false | false | 2026-03-25 |
Phase 6 — Validation Strategy
Per-phase validation contract for feedback sampling during execution.
Test Infrastructure
| Property | Value |
|---|---|
| Framework | pytest 8.x + pytest-asyncio (existing) |
| Config file | pyproject.toml (existing) |
| Quick run command | pytest tests/unit -x -q |
| Full suite command | pytest tests/ -x |
| Estimated runtime | ~30 seconds |
Sampling Rate
- After every task commit: Run
pytest tests/unit -x -q - After every plan wave: Run
pytest tests/ -x - Before
/gsd:verify-work: Full suite must be green - Max feedback latency: 30 seconds
Per-Task Verification Map
| Task ID | Plan | Wave | Requirement | Test Type | Automated Command | File Exists | Status |
|---|---|---|---|---|---|---|---|
| 06-xx | 01 | 1 | CHAT-01,02 | unit | pytest tests/unit/test_web_channel.py -x |
❌ W0 | ⬜ pending |
| 06-xx | 01 | 1 | CHAT-03 | unit | pytest tests/unit/test_web_conversations.py -x |
❌ W0 | ⬜ pending |
| 06-xx | 01 | 1 | CHAT-04 | unit | pytest tests/unit/test_web_rbac.py -x |
❌ W0 | ⬜ pending |
| 06-xx | 02 | 2 | CHAT-01,05 | build | cd packages/portal && npx next build |
✅ | ⬜ pending |
| 06-xx | 02 | 2 | CHAT-03 | build | cd packages/portal && npx next build |
✅ | ⬜ pending |
Status: ⬜ pending · ✅ green · ❌ red · ⚠️ flaky
Wave 0 Requirements
tests/unit/test_web_channel.py— CHAT-01,02: web normalizer, WebSocket message handlingtests/unit/test_web_conversations.py— CHAT-03: conversation CRUD APItests/unit/test_web_rbac.py— CHAT-04: RBAC enforcement on chat endpoints
Manual-Only Verifications
| Behavior | Requirement | Why Manual | Test Instructions |
|---|---|---|---|
| WebSocket chat sends message and receives real-time reply | CHAT-01,05 | Requires live WebSocket + LLM | Open /chat, select agent, send message, verify response appears |
| Conversation history loads on page visit | CHAT-03 | UI rendering | Navigate away and back to /chat, verify previous messages visible |
| Typing indicator displays during response generation | CHAT-05 | UI animation | Send message, observe animated dots before response |
| Agent markdown renders correctly | CHAT-05 | Visual rendering | Trigger a response with code blocks / lists / bold |
| Operator can chat but not see admin nav items | CHAT-04 | RBAC visual | Login as operator, verify /chat accessible but admin-only items hidden |
Validation Sign-Off
- All tasks have
<automated>verify or Wave 0 dependencies - Sampling continuity: no 3 consecutive tasks without automated verify
- Wave 0 covers all MISSING references
- No watch-mode flags
- Feedback latency < 30s
nyquist_compliant: trueset in frontmatter
Approval: pending