Skip to content

qa: commit the Lody QA matrix, baseline, runbooks and harness - #188

Open
pythonlearner1025 wants to merge 4 commits into
mainfrom
qa-system
Open

qa: commit the Lody QA matrix, baseline, runbooks and harness#188
pythonlearner1025 wants to merge 4 commits into
mainfrom
qa-system

Conversation

@pythonlearner1025

Copy link
Copy Markdown
Member

Adds the QA system to the repo, so agents can keep it current and run it.

  • qa/MATRIX.md — the 488-row feature matrix (v2, refreshed against main). Row ids are stable; retired rows move to the Retired section.
  • qa/baseline.json — per-row verdicts from the 2026-09-01 sweep campaign. Rows fixed since then carry FIXED-UNVERIFIED with their PR.
  • qa/RUNBOOK.md — how a sweep agent runs: machine-plane API, session minting, container discipline, box facts.
  • qa/REGRESSION.md — the recurring-run design: flips against the baseline only.
  • qa/harness/ — the proven CDP driver template and the lane prompt.
  • CLAUDE.md — a short convention section. No CI gate, per user decision: matrix upkeep is a convention, not a check.

Local gates: typecheck pass, lint:gate pass (74 anti-slop at baseline, 0 blitz-house). The full test gate was not run locally — this box kills long tasks; CI is the check.

🤖 Generated with Claude Code

https://claude.ai/code/session_01F5TaF9Xts6ymwMabzXUKf6

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant