docs: add Phase 9 — Testing & QA (E2E, Lighthouse, visual regression, a11y, cross-browser)
This commit is contained in:
@@ -90,6 +90,16 @@ Requirements for beta-ready release. Each maps to roadmap phases.
|
||||
- [x] **MOB-05**: Push notifications for new messages when PWA is installed (or service worker caches app shell for instant load)
|
||||
- [x] **MOB-06**: All touch interactions feel native — no hover-dependent UI that breaks on touch devices
|
||||
|
||||
### Testing & QA
|
||||
|
||||
- [ ] **QA-01**: Playwright E2E tests cover all critical user flows (login, tenant CRUD, agent deploy, chat, billing, RBAC)
|
||||
- [ ] **QA-02**: Lighthouse scores >= 90 for performance, accessibility, best practices, and SEO on key pages
|
||||
- [ ] **QA-03**: Visual regression snapshots at desktop (1280px), tablet (768px), and mobile (375px) for all key pages
|
||||
- [ ] **QA-04**: axe-core accessibility audit passes with zero critical violations across all pages
|
||||
- [ ] **QA-05**: E2E tests pass on Chrome, Firefox, and Safari (WebKit) via Playwright
|
||||
- [ ] **QA-06**: Empty states, error states, and loading states tested and rendered correctly
|
||||
- [ ] **QA-07**: CI-ready test suite runnable in GitHub Actions / Gitea Actions pipeline
|
||||
|
||||
## v2 Requirements
|
||||
|
||||
Deferred to future release. Tracked but not in current roadmap.
|
||||
@@ -192,6 +202,13 @@ Which phases cover which requirements. Updated during roadmap creation.
|
||||
| MOB-04 | Phase 8 | Complete |
|
||||
| MOB-05 | Phase 8 | Complete |
|
||||
| MOB-06 | Phase 8 | Complete |
|
||||
| QA-01 | Phase 9 | Pending |
|
||||
| QA-02 | Phase 9 | Pending |
|
||||
| QA-03 | Phase 9 | Pending |
|
||||
| QA-04 | Phase 9 | Pending |
|
||||
| QA-05 | Phase 9 | Pending |
|
||||
| QA-06 | Phase 9 | Pending |
|
||||
| QA-07 | Phase 9 | Pending |
|
||||
|
||||
**Coverage:**
|
||||
- v1 requirements: 25 total (all complete)
|
||||
@@ -199,7 +216,8 @@ Which phases cover which requirements. Updated during roadmap creation.
|
||||
- Employee Design requirements: 5 total (Phase 5, all complete)
|
||||
- Web Chat requirements: 5 total (Phase 6, all complete)
|
||||
- Multilanguage requirements: 6 total (Phase 7, all complete)
|
||||
- Mobile + PWA requirements: 6 total (Phase 8)
|
||||
- Mobile + PWA requirements: 6 total (Phase 8, all complete)
|
||||
- Testing & QA requirements: 7 total (Phase 9)
|
||||
|
||||
---
|
||||
*Requirements defined: 2026-03-23*
|
||||
|
||||
@@ -143,6 +143,7 @@ Phases execute in numeric order: 1 -> 2 -> 3 -> 4 -> 5 -> 6 -> 7 -> 8
|
||||
| 6. Web Chat | 3/3 | Complete | 2026-03-25 |
|
||||
| 7. Multilanguage | 4/4 | Complete | 2026-03-25 |
|
||||
| 8. Mobile + PWA | 4/4 | Complete | 2026-03-26 |
|
||||
| 9. Testing & QA | 0/0 | Not started | - |
|
||||
|
||||
---
|
||||
|
||||
@@ -188,6 +189,23 @@ Plans:
|
||||
- [ ] 08-03-PLAN.md — Push notifications (VAPID, push subscription DB, service worker push handler, offline message queue, install prompt)
|
||||
- [ ] 08-04-PLAN.md — Human verification: mobile responsive layout, PWA install, push notifications, touch interactions
|
||||
|
||||
### Phase 9: Testing & QA
|
||||
**Goal**: Comprehensive automated testing and quality assurance — E2E tests for critical user flows, Lighthouse audits for performance/accessibility, visual regression testing across viewports, and cross-browser validation — ensuring the platform is beta-ready
|
||||
**Depends on**: Phase 8
|
||||
**Requirements**: QA-01, QA-02, QA-03, QA-04, QA-05, QA-06, QA-07
|
||||
**Success Criteria** (what must be TRUE):
|
||||
1. Playwright E2E tests cover all critical flows: login, tenant CRUD, agent deployment (template + wizard), chat with streaming response, billing, RBAC enforcement
|
||||
2. Lighthouse scores >= 90 for performance, accessibility, best practices, and SEO on key pages
|
||||
3. Visual regression snapshots exist for all key pages at desktop (1280px), tablet (768px), and mobile (375px) viewports
|
||||
4. axe-core accessibility audit passes with zero critical violations across all pages
|
||||
5. All E2E tests pass on Chrome, Firefox, and Safari (WebKit)
|
||||
6. Empty states, error states, and loading states are tested and render correctly
|
||||
7. CI-ready test suite that can run in a GitHub Actions / Gitea Actions pipeline
|
||||
**Plans**: 0 plans
|
||||
|
||||
Plans:
|
||||
- [ ] TBD (run /gsd:plan-phase 9 to break down)
|
||||
|
||||
---
|
||||
*Roadmap created: 2026-03-23*
|
||||
*Coverage: 25/25 v1 requirements + 6 RBAC requirements + 5 Employee Design requirements + 5 Web Chat requirements + 6 Multilanguage requirements + 6 Mobile+PWA requirements mapped*
|
||||
|
||||
0
.planning/phases/09-testing-qa/.gitkeep
Normal file
0
.planning/phases/09-testing-qa/.gitkeep
Normal file
Reference in New Issue
Block a user