Repository navigation
CI performance dashboard #1182
Description
Maintained by the CI profiler routine, which runs every 4h. Each run replaces this body and carries the history rows over.
Headline (run 2026-10-26 20:16 UTC)
Window: 2026-10-25 20:16 → 2026-10-26 20:16. 300 of 313 workflow runs listed (3-page cap; the 13 oldest, all from before the burst, were not listed). Jobs fetched for all 108 CI runs (47 merge_group, 47 PR, 13 push, 1 nightly). 25 PRs merged (18 in the 15:10–16:17 burst, 7 since).
Since the last run (16:19 → 20:16)
- Merge queue is healthy again: 7 merges at enqueue → merge p50 9.1, p90 10.2 min (n=7, 6.1–10.3), with 0 evictions and 0 failed or cancelled merge_group runs. In the 15:10–16:17 burst, p50 was 43.9.
- The rust-cache cap landed: #1730 merged 18:12. There have been 0
Cache cargohangs since 16:19 (all 1,679 cache steps in 24h: p50 0.02, p99 0.55 min; the only 3 hangs are the 15:24–15:55 ones). Too early to judge: only ~10 runs since the merge. - Slow Depot starts are now the main merge-queue cost. In 53% of mg Depot jobs since 16:19 (114/217), runner start → first step took more than 15 s. Slow starts track load: 0% in every hour with ≤130 jobs, and 31–53% in the 15:00–18:59 hours (439/1414, 169/352, 125/221, 74/197). Over 24h they cost 629 Linux job-min. Merge_group runs with ≤6/31 slow jobs reached
ci-okin 4.48–5.25 min. Runs with 23–31/31 slow jobs took 6.4–12.8 (12.77 PR run is the Gradle redirect leg on 29/31 slow hosts). Tracked in #1512, already commented today, so no second comment. - Filed #1732: 11 e2e legs each run under 20 s of tests on their own runner. That is 701 job-min/day for 125 min of tests. Folding them into 3 legs cuts 8 of 31 runner requests per run (~360 Linux job-min/day), which could also ease the load-driven slow starts.
- Critical path since 16:19: the last job before
ci-okwas the Gradle redirect leg in 4/7 mg runs, thepip::VEX leg in 2, andcoverage (2)in 1.
| metric | 24h |
|---|---|
| PRs merged | 25 (18 in the 15:10–16:17 burst, 7 at 16:58–18:54; 1 eviction #1706 in the burst) |
| Merge queue enqueue → merge | burst 43.9 / 50.0 (n=18, carried); since 16:19 9.1 / 10.2 (n=7) |
merge_group created → ci-ok (success) |
6.55 / 9.14 (n=37, 4.48–22.27) |
PR run created → ci-ok (full runs) |
5.57 / 8.54 (n=27, 4.38–12.77); since 16:19 5.72 / 8.55 (n=11) |
push to main created → ci-ok |
4.22 / 7.35 (n=13, max 16.3 at 16:02 during the burst) |
| Nightly | 10-26 failed (Windows shard 1); fix #1710 merged 10-26 15:14, so the 10-27 nightly is the test |
| Linux queue wait p50 / p90 | Depot 0.02 / 0.02 (n=2,546, max 0.95) |
| Windows queue wait p50 / p90 | 0.03 / 0.06 (n=52) |
| macOS queue wait p50 / p90 | 0.05 / 0.05 (nightly, n=4) |
| Job-min/day (Linux / Windows / macOS) | ~3.8k / 0.17k / 0.03k |
| Depot slow-start (>15 s to first step) | 32% of all Linux jobs (807/2538, p90 47 s, max 282 s), costing 629 job-min |
Top Linux steps by total minutes (24h): e2e Run e2e tests 960 (1,271 jobs, p50 0.27), coverage Run tests with coverage 533 (p50 3.45), e2e Download the e2e binaries 134, hosted-e2e 98, yarn-berry VEX 97, yarn-classic VEX 94, windows-compile-check type-check 85 (Windows), e2e Set up job 84, e2e-build compile 77, e2e Checkout 77.
Slowest PR/mg jobs (p50 / p90): coverage (2) 3.90 / 5.32, coverage (1) 3.81 / 4.79, e2e Gradle redirect 3.07 / 5.26, e2e pip:: VEX 2.88 / 3.51, e2e npm redirect 2.65 / 3.72, windows-compile-check 2.68 / 2.90.
Merge-queue settings (ruleset 24668460, re-read 20:16): build 5 / merge 5, min 1, min wait 5 min, ALLGREEN, timeout 90, SQUASH. No change.
Sample: 300 runs listed (3 pages). Jobs for all 108 CI runs. Timelines for the 7 PRs merged since 16:19; the burst's 18 timelines are carried. 1 job log (the deno VEX leg). About 125 REST requests. GraphQL is blocked here.
History
| run (UTC) | merges/24h | MQ enq→merge p50/p90 (min) | mg CI success p50 | PR push→ci-ok p50/p90 | mac queue p50/p90 | linux queue p50/p90 | job-min/day L/W/M |
|---|---|---|---|---|---|---|---|
| 2026-10-26 20:16 | 25 PRs merged (7 since 16:19: #1722, #1719, #1730, #1715/#1723/#1724 in one group, #1731; queue idle since 18:54) | since 16:19 9.1 / 10.2 (n=7, 6.1–10.3, 0 evictions); 24h n=25, p90 ≈50 (burst carried) | 6.55 / 9.14 24h (n=37); since 16:19 6.57 (n=7, 4.63–9.65) | 24h full runs 5.57 / 8.54 (n=27); since 16:19 5.72 / 8.55 (n=11, max 12.77 on 29/31 slow hosts) | 0.05 / 0.05 (nightly, n=4) | 0.02 / 0.02 (Depot, n=2,546, max 0.95); slow-start 38% of mg jobs 24h (547/1455), 53% since 16:19 (114/217) | ~3.8k / 0.17k / 0.03k (mg 2,339 L / 124 W in 47 runs; PR 1,192 L; push 171 L; nightly 93 / 50 / 30) |
| 2026-10-26 16:19 | 18 PRs merged (all 15:10–16:17, first burst since 10-24 02:54; 1 eviction, #1719 dequeued) | 43.9 / 50.0 (n=18; first 3 entries 5.1–7.7; max 67.1 #1706) | 6.07 / 9.03 (n=30; 2 at 20.5 / 22.3 on hung rust-cache restores) | 24h ≈4.7 / 8.2; since 12:33 6.4 / 8.5 (n=10 full runs during the burst, 4.57–9.68) | 0.05 / 0.05 (nightly, carried) | 0.02 / 0.02 (Depot, n=1,760, max 0.95); slow-start 36% (326/900 mg jobs) | ~3.0k / 0.16k / 0.03k (mg 1,956 L / 106 W in 40 runs, 54% discarded; PR 497 L since 12:33; push 97 L; nightly 93 / 50 / 30) |
| 2026-10-26 12:33 | 0 PRs merged (queue idle 57.6 h) | — (none; last 4: 5.13–6.85 carried) | none since 10-24 02:49; 4.48 with #1704 (carried) | 4.78 (n=1 green full run since 08:18; 24h 4.58 / 4.77, n=12) | — (no macOS jobs in slice; 0.05 carried) | 0.02 / 0.02 (Depot, n=31, max 0.02) | ~0.51k / 0.05k / 0.03k (since 08:18 PR 34.8 L in 1 full run plus 4 stub and 4 audit runs; nightly 10-26 still in window) |
| 2026-10-26 08:18 | 0 PRs merged (queue idle 53.4 h) | — (none; last 4: 5.13–6.85 carried) | none since 10-24 02:49; 4.48 with #1704 (carried) | 4.57 (n=1 green full run since 04:16; 24h 4.58 / 4.75, n=13) | 0.05 / 0.05 (nightly, n=4) | 0.02 / 0.02 (Depot, n=122, max 0.03) | ~0.55k / 0.05k / 0.03k (since 04:16 PR 33.9 L in 1 full run plus 4 stub and 4 audit runs; nightly 10-26 92.5 L / 50.2 W / 30.4 M (failed, Windows shard 1); the 10-25 nightly rolled out) |
| 2026-10-26 04:16 | 0 PRs merged (queue idle 49.4 h) | — (none; last 4: 5.13–6.85 carried) | none since 10-24 02:49; 4.48 with #1704 (carried) | 4.55 (n=3 green full runs since 00:16, 4.53–4.57; 24h 4.58 / 4.77, n=13) | — (no macOS jobs in slice; ≤0.03 carried) | 0.01 / 0.01 (Depot, n=93, max 0.01) | ~0.55k / 0.05k / 0.03k (since 00:16 PR 106.7 L in 3 full runs (34.95, 35.63, 36.15) plus 4 stub and 6 audit runs) |
| 2026-10-26 00:16 | 0 PRs merged (queue idle 45.4 h) | — (none; last 4: 5.13–6.85 carried) | none since 10-24 02:49; 4.48 with #1704 (carried) | 4.65 (n=3 green full runs since 20:15, 4.48–4.73; 24h 4.58 / 4.77, n=11) | — (no macOS jobs in slice; ≤0.03 carried) | 0.02 / 0.02 (Depot, n=93, max 0.02) | ~0.48k / 0.05k / 0.03k (since 20:15 PR 108 L in 3 full runs (35.5, 35.8, 36.7) plus 4 stub and 7 audit runs) |
| 2026-10-25 20:15 | 0 PRs merged (queue idle 41.4 h) | — (none; last 4: 5.13–6.85 carried) | none since 10-24 02:49; 4.48 with #1704 (carried) | 4.58 (n=3 green full runs since 16:15, 4.38–4.77; 24h 4.56 / 4.77, n=10) | — (no macOS jobs in slice; ≤0.03 carried) | 0.02 / 0.02 (Depot, n=93, max 0.03) | ~0.44k / 0.05k / 0.03k (since 16:15, PR 104 L in 3 full runs (34.8, 34.3, 35.0) plus 4 stub and 4 audit runs; the #1716 dispatch rolled out) |
| 2026-10-25 16:15 | 0 PRs merged (queue idle 37.4 h; 19 non-draft PRs open) | — (none; last 4: 5.13–6.85 carried) | none since 10-24 02:49; 4.48 with #1704 (carried) | 4.73 (n=1 green full run since 12:15, #1723; 24h 4.55 / 4.9, n=12) | — (no macOS jobs in slice; ≤0.03 carried) | 0.02 / 0.02 (Depot, n=31, max 0.02) | ~0.65k / 0.10k / 0.07k (recounted over full window; since 12:15 PR 35.6 L in 1 full run + 4 stub + 4 audit runs) |
| 2026-10-25 12:15 | 0 PRs merged (queue idle 33.4 h; 18 non-draft PRs open) | — (none; last 4: 5.13–6.85 carried) | none since 10-24 02:49; 4.48 with #1704 (carried) | 4.48 / 4.58 (n=2 green full runs since 08:15, both #1722; 24h ≈4.5 / 4.9) | — (no macOS jobs in slice; ≤0.03 carried) | 0.02 / 0.02 (Depot, n=62, max 0.02) | ~0.42k / 0.05k / 0.03k (est.; since 08:15 PR 67.6 L in 2 full runs (34.5, 33.1) + 9 stub/audit runs; the 10-24 08:15–12:15 PR slice (~70 L) rolled out) |
| 2026-10-25 08:15 | 0 PRs merged (queue idle 29.4 h; 17 non-draft PRs open) | — (none; last 4: 5.13–6.85 carried) | none since 10-24 02:49; 4.48 with #1704 (carried) | 4.85 (n=1 green full run since 04:16; 24h ≈4.5 / 4.9) | ≤0.03 (nightly macOS jobs) | 0.02 / 0.02 (Depot, n=31 PR + nightly Linux legs, max 0.02; Windows max 0.05) | ~0.42k / 0.08k / 0.05k (est.; since 04:16 PR 35.7 L in 1 full run + 8 stub/audit runs, nightly 88.5 L / 51.0 W / 33.4 M (failed, Windows shard 1); the 10-24 04:16–08:16 nightly + #1710 dispatch slice (~655 L / 148 W / 119 M) rolled out) |
| 2026-10-25 04:16 | 0 PRs merged (queue idle 25.4 h; 16 non-draft PRs open) | — (none; last 4: 5.13–6.85 carried) | none since 10-24 02:49; 4.48 with #1704 (carried) | 4.48 (n=1 green full run since 00:16; 24h ≈4.5 / 4.9) | — (no macOS jobs in slice; 0.05 / 0.05 carried) | 0.02 / 0.02 (Depot, n=31, max 0.02; slow-start 0/31) | ~0.95k / 0.18k / 0.14k (est.; since 00:16 PR 35.0 L in 1 full run + 6 stub/audit runs; the 10-24 00:16–04:16 mg/push slice rolled out) |
| 2026-10-25 00:16 | 4 PRs merged (0 since 02:54; queue idle 21.4 h; the 10-23 22:15–22:56 merges rolled out) | 5.9 / 6.85 (n=4, all 02:38–02:54) | 4.48 with #1704 (n=4 incl. 6.35 pre-#1704) | 4.47 / 4.52 (n=2 green full runs: 4.42, 4.52) | — (no macOS jobs in slice; 0.05 / 0.05 carried) | 0.02 / 0.02 (Depot, n=62, max 0.02; slow-start 0/62) | ~1.55k / 0.20k / 0.16k (est.; since 20:16 PR 68.3 L in 2 full runs (34.1, 34.2) + 7 stub/audit runs; the 10-23 20:16–10-24 00:16 slice (~520 L / 12.6 W) rolled out) |
| 2026-10-24 20:16 | 9 PRs merged (0 since 02:54; queue idle 17.4 h; the 10-23 17:57/18:04 merges rolled out) | none since 04:16; last 4: 5.13–6.85 (carried) | none since 02:49; 4.48 with #1704 (carried) | 4.80 / 5.45 (n=5 green full runs: 4.48, 4.50, 4.80, 4.88, 5.45; 1 run cancelled after a Depot go env hang) |
0.05 / 0.05 (CI dispatch, n=4) | 0.02 / 0.02 (Depot, n=278, max 0.08; slow-start 5/278) | ~2.0k / 0.21k / 0.16k (est.; since 16:16 PR 215.5 L in 6 full runs (34.3, 33.9, 43.2 incl. 12-min hung coverage (1), 34.8, 35.0, 34.3); CI dispatch on #1716 98 L / 51 W / 38 M (failed, Windows shard 1); the 10-23 16:16–20:16 slice (~320 L / 5.5 W) rolled out) |
| 2026-10-24 16:16 | 11 PRs merged (0 since 02:54; queue idle 13.4 h; the 10-23 14:38 burst rolled out) | none since 04:16; last 4: 5.13–6.85 (carried) | none since 02:49; 4.48 with #1704 (carried) | 4.53 / 4.68 (n=3 green full runs: 4.37, 4.53, 4.68; 1 red PR-own hosted-e2e failure at 6.55) |
— (no macOS jobs in slice; 0.05 / 0.07 carried) | 0.02 / 0.02 (Depot, n=123, max 0.02; slow-start 1/123) | ~2.0k / 0.17k / 0.12k (est.; since 12:16 PR 138.5 L in 4 full runs (35.3, 33.2, 34.8, 35.3) + 1 single-job run; the 10-23 12:16–16:16 burst slice (~690 L / 32 W) rolled out) |
| 2026-10-24 12:16 | 24 PRs merged (0 since 08:16; queue idle; agent PRs #1708/#1710 still open) | none since 04:16; last 4: 5.13–6.85 (carried) | none since 04:16; 4.48 with #1704 (carried) | 4.54 / 4.62 (n=2 full runs since 08:16: 4.45, 4.62; 08:16 slice 4.45–4.95) | — (no macOS jobs in slice; 0.05 / 0.07 carried) | 0.02 / 0.02 (Depot, n≈100, max 0.02) | ~2.6k / 0.20k / 0.12k (est.; since 08:16 PR 69.7 L in 2 full runs (35.0, 34.7) + 14 stub/audit runs; the 10-23 08:16–12:18 slice (~130 L) rolled out) |
| 2026-10-24 08:16 | 24 PRs merged (0 since 04:16; queue idle; 4 PRs open from agents) | none since 04:16; last 4: 5.13–6.85 (carried) | none since 04:16; 4.48 with #1704 (carried) | 4.52 / 4.95 (n=3 full first-attempt runs, 4.45–4.95; all with sharded coverage) | 0.05 / 0.07 (nightly + dispatch, n=58) | 0.02 / 0.02 (Depot, n≈520, max 0.03) | ~2.7k / 0.20k / 0.12k (est.; since 04:16 PR 140 L in 4 full runs, nightly 251 / 74 / 64 (failed, Windows shard 1, core --lib), CI dispatch on #1710 264 / 74 / 55 (green)) |
| 2026-10-24 04:16 | 24 PRs merged (4 since 00:16: #1701, #1704, #1703, #1705; 0 evictions, 0 mg failures) | 5.9 / 6.85 since 00:16 (n=4, 5.13–6.85) | 4.48 with #1704 (n=3, 4.47–4.93); 6.35 for the one entry built before it | 6.70 (n=1, pre-#1704); re-run attempt with shards 4.67 | — (no macOS jobs in slice; 0.03 / 0.05 carried) | 0.02 / 0.02 (Depot, n≈230, max 0.03) | ~2.9k / 0.21k / 0.13k (est.; since 00:16 mg 144 L / 7.6 W in 4 runs, push 16 L in 2 runs, PR 90 L; Depot slow-start 0%) |
| 2026-10-24 00:16 | 21 PRs merged (5 since 20:16: #1676, #1697, #1696, #1700, #1699; 0 evictions, 0 mg failures) | 6.98 / 8.1 since 20:16 (n=5, 6.95–8.77) | 6.47 (n=5, 6.18–8.15; 6.18–6.47 with #1697) | 6.37 / 7.03 (n=9 full runs, 4.75–7.03; #1704's coverage-shard runs 4.75 / 6.00) | — (no macOS jobs in slice; 0.03 / 0.05 carried) | 0.02 / 0.02 (Depot, n=460, max 0.15) | ~2.9k / 0.20k / 0.13k (est.; since 20:16 mg 176 L / 12.6 W in 5 runs, push 32 L in 4 runs, PR 314 L in 9 full runs; Depot slow-start 4% (19/460), 14 of them in one PR run) |
Open ci-perf issues by ROI
ROI on one scale: (thousands of job-min/day weighted Linux ×1, Windows ×2, macOS ×3, plus 1 per critical-path or PR-latency minute) × confidence ÷ effort (S=1, M=2, L=3).
| ROI | issue | saving | status |
|---|---|---|---|
| ~14 | #1670 (settings) 90-min check timeout let a stuck check freeze main for 77 min | ~46 min sooner recovery per stuck-check incident | No incident since 16:19. Timeout still 90. Needs a repo admin. |
| ~11 | #1248 (settings) merge-queue build concurrency | slot waits of 10–33 min in the 10-26 burst | No queue backlog since 16:19 (max 3 entries at once, at 18:27). Re-measure on the next burst, now that #1730 is in. Needs a human decision. |
| ~4 | #1512 (settings) slow / lost Depot hosts | ~2 min per merge under load (mg ci-ok 4.5 → 6.4–12.8), 629 job-min/day |
Worse: 53% slow-start since 16:19, and the slow starts clearly follow load (0% in quiet hours). Already commented today. Needs a human to raise it with Depot. |
| ~1 | #1720 (coverage tradeoff) Windows-only regressions reach main | avoids ~0.2–0.3k job-min of fix churn per regression | agent:needs-human; waiting on a maintainer. |
| ~0.2 | #1732 new: 11 e2e legs under 20 s of tests each, 82% overhead | ~360 Linux job-min/day, 8 fewer runners per run (31 → 23) | Filed this run. It may also ease load-driven slow starts (unproven). |
Closed since last run: none. Filed: #1732. Commented: none (#1512 and #1248 already had today's comment at 16:23).
Open ci-perf / ci-janitor PRs: none.
Merged ci-perf / ci-janitor PRs (last 7 days) and measured effect
| PR | merged | before → after |
|---|---|---|
| #1730 cap hung rust-cache restores at 5 min (ci-janitor) | 10-26 18:12 | Too early to call: 0 hangs in ~10 runs since. Before: 3 hangs of 14.2–15.6 min in one 72-min burst (~330 queue entry-min). |
| #1708 stop late draft runs cancelling real PR CI (ci-janitor) | 10-26 15:10 | Holding: 0 draft-run cancels in the 20 PR CI runs after 15:10 (the 1 cancelled PR run was a superseding push on #1730). |
| #1716 Pipenv pylock test follows uv (ci-janitor) | 10-26 15:14 | Robustness; 0 Pipenv leg failures in 30 merge_group runs since. |
| #1710 Windows nightly yarnrc path (#1689) | 10-26 15:14 | Judge from the 10-27 nightly (10-24, 10-25 and 10-26 nightlies failed on Windows shard 1). |
| #1704 shard coverage across two runners (ci-perf, self-picked from dashboard) | 10-24 02:38 | Delivered, beat its estimate. merge_group ci-ok with the shards: 4.47, 4.48, 4.93 (n=3; run, run, run) vs 6.18–6.47 after #1697 and before #1704: about −1.8 min per merge (expected −1.5). Shards take 3.78–4.62 min (was one 5.88–6.17 job). Cost +0.7–1.4 Linux job-min per mg run (35.9–36.6 vs 35.2), less than the +4 expected. Push to main ci-ok 3.03 / 3.08 (was 3.12–3.27). PR push→ci-ok since 04:16: 4.45–4.95 (n=3) vs 6.37 p50 before. |
| #1697 Gradle agent suites in their own e2e leg (self-picked from dashboard) | 10-23 22:18 | Delivered. The Gradle legs now take 2.82–2.98 and 1.77–1.97 min (was 4.58–4.92 combined, 7.40 on a slow host). ci-ok in the 3 merge_group runs that include it: 6.18 / 6.23 / 6.47 vs 6.50–7.58 on fast hosts before (about −0.3 to −1 min). Gradle is off the critical path; coverage now sets it. |
| #1682 start coverage and e2e-build without waiting on clippy (#1681) | 10-23 14:54 | Delivered. In merge_group runs, coverage now starts at 0.20–0.30 min (was 1.43–1.47). ci-ok with #1682: 6.50, 6.73, 7.35, 7.58, 10.03 (n=5; p50 7.35, the 10.03 on 100%-slow hosts) vs 7.53–8.15, p50 7.76 before. On fast hosts ~1.1 min saved against 1.3 expected. |
| #1686 Windows nightly path asserts (ci-janitor) | 10-23 14:38 | Partly delivered. In the 10-24 nightly Windows shard 2 passed, but shard 1 still failed on -p socket-patch-core --lib (job). Follow-up #1710 (#1689) is open and green in dispatch. |
| #1690 gem old-Bundler legs (follow-up to #1687) | 10-23 14:54 | Delivered. No gem leg failures in the 10-24 nightly (its only failure was Windows shard 1). |
| #1692 compatibility workflows off Node 20 pins (ci-janitor) | 10-23 14:47 | Maintenance; no CI-time effect expected. |
| #1673 retry the yarn-classic corepack probe (#1671) | 10-23 00:13 | Before: 2 of 40 tests failed on one DNS timeout and evicted #1653 (~94 job-min). After the merge: 0 yarn-classic failures in 28 jobs (7 full runs through 04:16, then 21/21 green since). Holding. |
| #1663 fix uv settings test on Windows nightly (ci-janitor) | 10-22 19:29 | Did not make the Windows nightly green. The 10-23 nightly failed both Windows shards (cli --test user_patches, core --lib, path-form asserts). Follow-up #1686 passed both shards in its dispatch run. |
| #1652 keep transport cause in registry errors | 10-22 17:38 | Diagnostics; no CI-time effect expected. |
| #1654 retry crates.io in coverage's cargo e2e | 10-22 17:12 | 0 infra coverage failures in 53 merge-group + 19 push runs + 10 PR runs since 04:16. The one 04:16–08:16 failure was a PR's own new test. The 10-22 21:25 PR failure is carried. Holding. |
| #1643 fix update-lock flake | 10-22 17:09 | 0 recurrences since. Too early to call. |
| #1647 pin floating toolchains (#1645) | 10-22 17:03 | No toolchain-drift red main since (7 h). Needs a week to judge. |
| #1659 runner image's PHP in composer e2e | 10-22 17:03 | 0 Setup PHP failures since (was 1 re-run on 10-21). Composer leg p50 unchanged. |
#1666 skip cargo shapes on failed --precise pin |
10-22 17:01 | Robustness; no CI-time effect expected. |
#1620 ci-watch.sh works without GraphQL (ci-janitor) |
10-20 19:02 | Tooling; no CI-time effect expected. |
| #1634 keep reuse self-test notices out of CI logs (ci-janitor) | 10-20 19:02 | Log hygiene; no CI-time effect expected. |
Method notes
- GraphQL and
search/issuesare blocked in this environment. Merge-queue state comes from REST timelines of merged PRs. "Enqueue → merge" uses the PR's firstadded_to_merge_queueevent in the window. "Slot wait" = enqueue → the PR's first merge_groupCIruncreated_at. - Jobs are fetched with
filter=all. Queue wait = jobstarted_at−created_at; skipped jobs are excluded. "Slow start" = jobstarted_at→ first stepstarted_atover 15 s, Depot jobs only. - Critical path = merge_group run
created_at→ci-okcompleted_atof the latest attempt. - "Discarded" merge_group runs are every
CIrun except each merged PR's last one. - Hang cost (~330 entry-min) = for each entry held, its merge time minus when its own group run finished (or, for the Fix Deno global npm tools missed by -g (#444) #1719 hang, minus ~15:30, when the held groups' runs had finished).
- This run (10-26 20:16): 300 of 313 runs listed (3-page cap), and jobs for all 108
CIruns. "PR full runs" leave out 1-job stub runs (ci-okin under 1 min). - The 10-23 20:16 history row rolled off (18-row cap).
Generated by Claude Code
Activity
mikolalysenko commentedon Oct 8, 2026
[agent] There are now two open dashboard issues: this one and #1175, both titled "CI performance dashboard" and labeled
ci-perf-dashboard. The body says it is maintained in place, so the profiler routine should update one issue rather than open a new one each run. I'm not closing either one, because I can't tell which issue the routine will update next. Whoever owns the profiler should close the copy it no longer updates.Generated by Claude Code