docs: add Phase 9 — Testing & QA (E2E, Lighthouse, visual regression, a11y, cross-browser)

This commit is contained in:
2026-03-25 22:09:30 -06:00
parent 13dc55d59c
commit df6bce7289
3 changed files with 37 additions and 1 deletions

View File

@@ -90,6 +90,16 @@ Requirements for beta-ready release. Each maps to roadmap phases.
- [x] **MOB-05**: Push notifications for new messages when PWA is installed (or service worker caches app shell for instant load) - [x] **MOB-05**: Push notifications for new messages when PWA is installed (or service worker caches app shell for instant load)
- [x] **MOB-06**: All touch interactions feel native — no hover-dependent UI that breaks on touch devices - [x] **MOB-06**: All touch interactions feel native — no hover-dependent UI that breaks on touch devices
### Testing & QA
- [ ] **QA-01**: Playwright E2E tests cover all critical user flows (login, tenant CRUD, agent deploy, chat, billing, RBAC)
- [ ] **QA-02**: Lighthouse scores >= 90 for performance, accessibility, best practices, and SEO on key pages
- [ ] **QA-03**: Visual regression snapshots at desktop (1280px), tablet (768px), and mobile (375px) for all key pages
- [ ] **QA-04**: axe-core accessibility audit passes with zero critical violations across all pages
- [ ] **QA-05**: E2E tests pass on Chrome, Firefox, and Safari (WebKit) via Playwright
- [ ] **QA-06**: Empty states, error states, and loading states tested and rendered correctly
- [ ] **QA-07**: CI-ready test suite runnable in GitHub Actions / Gitea Actions pipeline
## v2 Requirements ## v2 Requirements
Deferred to future release. Tracked but not in current roadmap. Deferred to future release. Tracked but not in current roadmap.
@@ -192,6 +202,13 @@ Which phases cover which requirements. Updated during roadmap creation.
| MOB-04 | Phase 8 | Complete | | MOB-04 | Phase 8 | Complete |
| MOB-05 | Phase 8 | Complete | | MOB-05 | Phase 8 | Complete |
| MOB-06 | Phase 8 | Complete | | MOB-06 | Phase 8 | Complete |
| QA-01 | Phase 9 | Pending |
| QA-02 | Phase 9 | Pending |
| QA-03 | Phase 9 | Pending |
| QA-04 | Phase 9 | Pending |
| QA-05 | Phase 9 | Pending |
| QA-06 | Phase 9 | Pending |
| QA-07 | Phase 9 | Pending |
**Coverage:** **Coverage:**
- v1 requirements: 25 total (all complete) - v1 requirements: 25 total (all complete)
@@ -199,7 +216,8 @@ Which phases cover which requirements. Updated during roadmap creation.
- Employee Design requirements: 5 total (Phase 5, all complete) - Employee Design requirements: 5 total (Phase 5, all complete)
- Web Chat requirements: 5 total (Phase 6, all complete) - Web Chat requirements: 5 total (Phase 6, all complete)
- Multilanguage requirements: 6 total (Phase 7, all complete) - Multilanguage requirements: 6 total (Phase 7, all complete)
- Mobile + PWA requirements: 6 total (Phase 8) - Mobile + PWA requirements: 6 total (Phase 8, all complete)
- Testing & QA requirements: 7 total (Phase 9)
--- ---
*Requirements defined: 2026-03-23* *Requirements defined: 2026-03-23*

View File

@@ -143,6 +143,7 @@ Phases execute in numeric order: 1 -> 2 -> 3 -> 4 -> 5 -> 6 -> 7 -> 8
| 6. Web Chat | 3/3 | Complete | 2026-03-25 | | 6. Web Chat | 3/3 | Complete | 2026-03-25 |
| 7. Multilanguage | 4/4 | Complete | 2026-03-25 | | 7. Multilanguage | 4/4 | Complete | 2026-03-25 |
| 8. Mobile + PWA | 4/4 | Complete | 2026-03-26 | | 8. Mobile + PWA | 4/4 | Complete | 2026-03-26 |
| 9. Testing & QA | 0/0 | Not started | - |
--- ---
@@ -188,6 +189,23 @@ Plans:
- [ ] 08-03-PLAN.md — Push notifications (VAPID, push subscription DB, service worker push handler, offline message queue, install prompt) - [ ] 08-03-PLAN.md — Push notifications (VAPID, push subscription DB, service worker push handler, offline message queue, install prompt)
- [ ] 08-04-PLAN.md — Human verification: mobile responsive layout, PWA install, push notifications, touch interactions - [ ] 08-04-PLAN.md — Human verification: mobile responsive layout, PWA install, push notifications, touch interactions
### Phase 9: Testing & QA
**Goal**: Comprehensive automated testing and quality assurance — E2E tests for critical user flows, Lighthouse audits for performance/accessibility, visual regression testing across viewports, and cross-browser validation — ensuring the platform is beta-ready
**Depends on**: Phase 8
**Requirements**: QA-01, QA-02, QA-03, QA-04, QA-05, QA-06, QA-07
**Success Criteria** (what must be TRUE):
1. Playwright E2E tests cover all critical flows: login, tenant CRUD, agent deployment (template + wizard), chat with streaming response, billing, RBAC enforcement
2. Lighthouse scores >= 90 for performance, accessibility, best practices, and SEO on key pages
3. Visual regression snapshots exist for all key pages at desktop (1280px), tablet (768px), and mobile (375px) viewports
4. axe-core accessibility audit passes with zero critical violations across all pages
5. All E2E tests pass on Chrome, Firefox, and Safari (WebKit)
6. Empty states, error states, and loading states are tested and render correctly
7. CI-ready test suite that can run in a GitHub Actions / Gitea Actions pipeline
**Plans**: 0 plans
Plans:
- [ ] TBD (run /gsd:plan-phase 9 to break down)
--- ---
*Roadmap created: 2026-03-23* *Roadmap created: 2026-03-23*
*Coverage: 25/25 v1 requirements + 6 RBAC requirements + 5 Employee Design requirements + 5 Web Chat requirements + 6 Multilanguage requirements + 6 Mobile+PWA requirements mapped* *Coverage: 25/25 v1 requirements + 6 RBAC requirements + 5 Employee Design requirements + 5 Web Chat requirements + 6 Multilanguage requirements + 6 Mobile+PWA requirements mapped*

View File