This runbook makes docs-adoption measurement repeatable and ties friction directly to a documentation backlog.
- Confirm
.github/workflows/adoption-metrics.ymlran (or trigger it manually). - Review
docs/adoption-metrics/latest.json. - Update
docs/adoption-metrics/manual-signals.jsonwith maintainer-verified outcomes. - Run page-to-action and cadence checks, then update
docs/adoption-friction-backlog.md. - Prioritize next docs edits using the highest-severity unresolved friction items.
- Log outreach and partnership stage changes in
docs/community-partnership-log.md.
Goal: each key docs page should let a new team complete one concrete action in under 10 minutes.
Track these checks weekly:
- Getting Started -> successful
initrun (eval-dashboards init --preset=agent-quality --write). - CLI page -> successful
lint/check/reportrun on one maintained example. - Publishing page -> successful static publish dry run or target publish run.
- Integrations page -> successful
importconversion for at least one external tool output.
If a check fails, open a new DOC-F### row in docs/adoption-friction-backlog.md before the review ends.
Goal: know which interoperability docs are actually used.
Track these markers:
- Number of distinct integration pages updated in the last 30 days.
- Number of maintained examples validated by the
examplesjob in.github/workflows/ci.yml. - Number of verified external-tool import runs logged by maintainers.
Goal: prevent stale guidance.
Track these cadence checks:
- Days since last docs truth-sync commit touching README/ROADMAP/STATUS/publishing/examples/help snapshots.
- Days since last integration guide refresh.
- Days since last adoption-metrics refresh.
If any cadence check exceeds 30 days, open a new DOC-F### row in the backlog.
- Workflow owner: repository maintainers.
- Metrics refresh owner: repository maintainers.
- Friction triage owner: repository maintainers.
- Every unresolved docs friction item must live in
docs/adoption-friction-backlog.mdwith severity, owner, and next action. - Assign the next sequential
DOC-F###identifier when adding an item. - Include signal source and opened date so priority is based on observed friction, not intuition.
- Friction items are documentation backlog work, not only product backlog work.
All conditions must be true for two consecutive weekly reviews:
- Page-to-action checks pass for Getting Started, CLI, Publishing, and Integrations.
- Friction backlog has no unresolved Critical items older than 14 days.
- At least one external-tool import path is verified during the week.
- Docs cadence checks are green (no key doc stale for >30 days).
- For weekly checks, record pass/fail outcomes in the friction backlog and use
manual-signals.jsonnotesfor a one-line summary. - External adoption outcomes are ongoing KPIs; completion means the loop exists and is actively used.
- Keep this process runner-agnostic and artifact-first: prioritize
eval-report/v1conversion quality over tool-specific UI flows.