Project-Template/docs/qa/ClaudeQAPlan.md

2.9 KiB

Claude QA Plan —

Status: Current
Owner: <who maintains this>
Last reviewed: <YYYY-MM-DD>
Governs: what a QA round consists of
Review trigger: Any new user-facing surface, or a defect class that got through

The playbook. What a round is, so two rounds are comparable and a gap is visible rather than assumed covered.

Before a round

  • Build from a clean checkout at a known SHA, and record that SHA.
  • Run from a detached worktree if other work is in flight, so uncommitted changes cannot contaminate what is under test.
  • Note the environment: device, OS version, browser, screen size — whatever the product's behaviour actually depends on.

The passes

Each pass gets a letter, so ClaudeQACoverage.md can report per pass and a skipped one is visible.

Pass What it covers
A First run: install or load, cold start, permissions, empty states
B The core flow, end to end, as a real user would do it
C The core flow with things going wrong: no network, denied permission, invalid input
D Persistence: quit and return, background and resume, restart
E The end of the loop — the state that is hardest to reach on purpose
F Accessibility: keyboard only, screen reader labels, contrast, text scaling
G Performance under the load this product will actually see

<Add, remove and rename to fit. A pass that never applies is noise; a pass that is always skipped is a lie.>

What counts as a finding

A finding needs: what was done, what happened, what should have happened, and the build SHA. Without the SHA it cannot be re-tested, and a finding that cannot be re-tested cannot be closed.

Severity

Findings are filed as issues, labelled:

  • P0 — ships broken, or loses data
  • P1 — materially wrong, but shippable
  • P2 — cosmetic or low impact
  • release-blocker — a release built today would be wrong rather than merely incomplete

Exactly these label names: the Command Center queries them by name, and a repository that spells them differently has its defects reported as not adopted rather than counted wrongly.

Severity is what it costs, not how annoying it is to fix.

After a round

File each finding as a labelled issue. Update ClaudeReport.md's run-state block and its overall sentence, and ClaudeQACoverage.md with what each pass actually reached. A pass that could not be run is recorded as blocked, with what blocks it — never quietly left out, which reads identically to "passed".

Then push, and reconcile. The verdict on the project screen at privacyllc.dev is read out of ClaudeReport.md in the pushed repository, so a round whose report is committed but not pushed — or pushed but not reconciled — leaves a stakeholder reading the previous round's judgment with no indication that a newer one exists. The rest of the cycle is in docs/WORK_CYCLE.md.