Skip to content

review-runs-tracking: 2026-11 #1492

Open

Description

@dormouse-bot

Monthly tracking issue for observations and diagnoses. Each run appends findings as a comment. Future runs read these to build cumulative evidence.

Do not close manually — a new issue is created each month, and prior months are closed automatically.

Activity

  1. dormouse-bot commented on Nov 1, 2026

    @dormouse-bot
    CollaboratorAuthor

    Run 41316592241 — 2026-11-01T14:40:41Z

    Window 2026-10-31T13:54:05Z → run start (~24.5 h). 88 tend runs censused (not a page boundary): tend-mention 46 (39 success, 7 skipped), tend-review 14, tend-mention-relay 11, tend-ci-failures 10, tend-notifications 5, nightly 1, review-runs 1. Zero failures. The longest run was nightly 41311085957 at 22 min against the default 360-min cap, so nothing ran long or near the timeout. Token report: $20.04 over 22 priced sessions: tend-review 14 / $8.32, nightly $7.20, notifications 3 / $2.07, review-runs $1.31, mention 3 / $1.14. No outliers: the costliest review was $0.98 (#1475).

    Argos flagged 3 NetworkSettings screenshots on every PR because the stories read the real clock. Acted on: #1493

    Sessions sampled: sound

    Maintainer corrections

    review-runs-corrections ran: 5 dispositions (#1478, #1481, #1482, #1483 and #1485, all bot PRs, merged), 16 comment rows and 0 review rows. The nedtwigg rows (#1473 ×3) apply bot findings. The rest are Cloudflare deploy comments and the audit status. No maintainer corrections.

    Live scan

    Pre-registered watches

    • tend-notifications under-delivery, occurrence 51: 5 runs in ~24 h against */15. No lever.
    • chore: update tend workflows (0.3.19 → 0.3.22) #1478 security-rule amendment: resolved. The maintainer merged it at 00:12Z, accepting the S41/S61 loosening for setup-runtime. Retire the watch.
    • Nightly/review double-post on nightly's red PRs: not repeated.

    Run 41491233370 — 2026-11-02T17:31:23Z

    Window 2026-11-01T14:31:10Z → run start. 175 tend runs censused (not a page boundary): tend-mention 80 (69 success, 11 skipped), tend-ci-failures 35, tend-review 29, tend-mention-relay 22, tend-notifications 5, nightly, weekly, triage, review-runs 1 each. Zero failures. The longest run was nightly 41475788338 at 28 min against the default 360-min cap. Token report: $39.54 over 38 priced sessions: tend-review 29 / $19.02, nightly $14.39, review-runs $3.05, notifications 3 / $1.49, mention 2 / $0.95, weekly $0.38, triage $0.26. The nightly cost twice the previous one ($7.20). Its log shows four parallel review subagents covering a large merged window (#1479–#1495), which produced 3 PRs. #1505 has merged, and #1503 and #1504 are green. The cost matches the work, so it is not an outlier finding.

    Sessions sampled: all sound

    Maintainer corrections

    review-runs-corrections ran: 8 dispositions (#1479, #1480, #1488–#1491, #1493 and #1505, all merged), 21 comment rows and 0 review rows. The nedtwigg rows are a fix applying a bot finding on #1495 and the #1502 directive above. No maintainer corrections.

    Live scan

    Pre-registered watches

    Run 41664275438 — 2026-11-03T15:39:58Z

    Window 2026-11-02T17:26:42Z → run start (~22 h). 528 tend runs censused (not a page boundary): tend-mention 274 (244 success, 24 skipped, 6 cancelled by concurrency), tend-mention-relay 92, tend-review 91, tend-ci-failures 64, tend-notifications 3, tend-triage 2, nightly 1, review-runs 1. Zero failures. The volume is a heavy maintainer push day (nedtwigg iterating #1515, #1528, #1533–#1540 with many "Merge main" pushes). The longest job was review 41495731021 at 22 min against the default 360-min cap. Token report: $88.63 over 119 priced sessions: tend-review 91 / $63.36, nightly $14.58, mention 21 / $6.73, triage 2 / $1.71, notifications 3 / $1.33, review-runs $0.92. 408 runs had no session artifact (relay, skipped mentions, pre-boot no-ops).

    Review fan-out on #1515 cost $7.33; findings all accepted. Low, record only

    • Evidence level: Low
    • Occurrences this run: 1
    • Run ID: 41664275438
    • Workflow: https://github.com/diffplug/dormouse/actions/runs/41664275438
    • Session: review 41539888040
    • Detail: On a 157-file, ~9k-line PR, the session started three general-purpose review subagents, all on claude-opus-5-5. They used ~3.4x the main session's tokens, roughly $5.7 of the $7.33; the main session alone was ~$1.6, in line with other large reviews. All five findings were fixed by nedtwigg (ee2b1b7, 2eebdc3), so the spend found real bugs. The model chose the fan-out; no skill asks for it. A side observation: token-usage.json token columns count the main session only while cost_usd includes subagents, which is why the row looked anomalous (17.6K output for $7.33). No upstream issue exists for that (searched max-sixty/tend); not filed, since the overlay requires a maintainer go-ahead per cross-repo issue and the cost figure itself is correct.

    Approve-then-withdraw on #1540 over Argos statuses not yet posted. Occurrence 1, Low, stochastic, record only

    Sessions sampled: all sound

    Maintainer corrections

    review-runs-corrections ran: 5 dispositions (#1503, #1504, #1532, #1553, #1554, all bot PRs, merged), 80 comment rows and 0 review rows. The 28 nedtwigg rows apply bot findings ("Fixed in …", "Right: …") or close #1528/#331/#1484 by maintainer decision; the rest are Cloudflare, Renovate and audit automation. No maintainer corrections.

    Live scan

    Pre-registered watches

    • New: Dependabot pnpm-lock.yaml alert batch. Next sweep: if Dependabot or Renovate has opened no PRs for undici/dompurify/fast-uri/brace-expansion/sharp/zod/qs/@azure/msal-node, check for a red dynamic/dependabot/... run and whether Dependabot security updates are enabled; past a few days with no PR, it is live work (bump directly, respecting docs/specs/security-supply-chain.md cooldown).
    • tend-notifications under-delivery, occurrence 53: 3 runs in ~22 h against */15. No lever.

    Run 41861215546 — 2026-11-04T16:41:11Z

    Window 2026-11-03T15:28:37Z → run start (~24 h). 120 tend runs censused (not a page boundary): tend-mention 63 (57 success, 6 skipped), tend-review 21, tend-ci-failures 14, tend-mention-relay 14, tend-notifications 4, tend-triage 2, nightly 1, review-runs 1. Zero failures. Long jobs: nightly 41848371708 59 min and review 41849983727 33 min (#1570), both against the default 360-min cap. Token report: $32.32 over 29 priced sessions: tend-review 21 / $14.72, nightly $10.73, review-runs $2.95, triage 2 / $2.15, notifications 3 / $1.35, mention 1 / $0.42. 91 runs had no session artifact (relay, ci-failures, pre-boot mention no-ops).

    Nightly re-ran a macOS job a third time after two runner-capacity cancellations. Occurrence 1, Low, record only

    Sessions sampled: all sound

    Maintainer corrections

    review-runs-corrections ran: 1 disposition (#1566, merged), 16 comment rows, 0 review rows. The only maintainer row is nedtwigg's progress table on #1078, with no bot claim contradicted. No maintainer corrections.

    Live scan

    Pre-registered watches

    Run 42058789030 — 2026-11-05T15:53:44Z

    Window 2026-11-04T15:46:26Z → run start (~23 h). 48 tend runs censused, not a page boundary: tend-mention 23 (17 success, 6 skipped), tend-ci-failures 8, tend-review 7, tend-notifications 4, tend-triage 2, tend-mention-relay 2, nightly 1, review-runs 1. Zero failures. Long jobs: only the prior review-runs (55 min) and review 41866920154 (33 min, #1573), both against the 360-min default. The 7–28 min tend-mention runs on #1572, #1573 and #1576 were verify-only with handle skipped: queue time on designed no-ops. Token report: $21.76 over 15 priced sessions: nightly $11.02, tend-review 7 / $4.37, review-runs $3.94, notifications 3 / $1.34, triage 2 / $0.79, mention 1 / $0.30. 33 runs had no artifact (relay, ci-failures, pre-boot no-ops).

    Maintainer corrected two options in review-runs-filed #1574. Occurrence 1, Medium, record only

    • Evidence level: Medium
    • Occurrences this run: 1
    • Run ID: 42058789030
    • Workflow: https://github.com/diffplug/dormouse/actions/runs/42058789030
    • Session: review-runs 41861215546, which filed Decide how to clear 28 npm Dependabot alerts that need a direct dependency bump or an override #1574
    • Detail: In #1574, nedtwigg wrote "Some of the options above turned out to be wrong". (1) The bot said moving miniflare's channel wouldn't help because latest (v4) pins vulnerable undici. It checked only latest and missed that the v5 beta, which wrangler 4.156.1 already uses, carries the fix (Move Hosted's Miniflare off the alpha pinning vulnerable undici and sharp #1576, merged). (2) The bot offered mermaid 12 as katex 39's fix, but .github/renovate.json holds mermaid allowedVersions: "<12", citing docs/specs/dor-tools-builtin.rationale.md. (3) It treated the dompurify alerts as needing an override, but Monaco's ESM build uses a vendored copy. The issue framed these as "options seen so far" for a maintainer to decide, so no wrong action was taken, and the maintainer's table now holds the decisions. Cause of (2): the repo's version holds are discoverable, but nothing points dependency-fix work at them. If it recurs, propose a running-tend line: before offering an upgrade, check .github/renovate.json allowedVersions and read every dist-tag, not only latest. Not the same mechanism as the 2026-09 "corrects a factual claim" watch, so not counted there.

    Sessions sampled: all sound

    Maintainer corrections

    review-runs-corrections ran: 2 dispositions (#1571 and #1573, both merged), 8 comment rows, 0 review rows. One correction: the #1574 entry above. The rest are Cloudflare and audit bot posts.

    Live scan

    Pre-registered watches

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    review-runs-trackingMonthly tracking issue for review-runs below-threshold findings

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions