Skip to content

chore(ci3): remove the dashboard, the minio harness and the redis tooling - #25430

Closed
ludamad wants to merge 3 commits into
ad/ci3-switch-overfrom
ad/ci3-remove-dashboard
Closed

chore(ci3): remove the dashboard, the minio harness and the redis tooling#25430
ludamad wants to merge 3 commits into
ad/ci3-switch-overfrom
ad/ci3-remove-dashboard

Conversation

@ludamad

@ludamad ludamad commented Sep 9, 2026

Copy link
Copy Markdown
Collaborator

Third of three (on the switch-over PR). With ci3 talking only to the server API, nothing here reads redis any more and the CI dashboard (rkapp) belongs in aztec-node, where the production implementation of ci3/CI3_SERVER_API.md will be built.

Removes ci3/dashboard, ci3/lua, watch_ci and ci.sh dash, the unused cache_delete, the minio test harness (source_test), the bundled redis-cli, and redis-tools/redis from the bootstrap dependencies. Docs (CI.md, the benchmark-chonk skill) describe the server API instead of redis.

@ludamad
ludamad requested a review from charlielye as a code owner September 9, 2026 02:48
@ludamad
ludamad force-pushed the ad/ci3-remove-dashboard branch 2 times, most recently from 7f70999 to 8062322 Compare September 9, 2026 03:36
@ludamad
ludamad added this pull request to stack #25431 September 9, 2026 04:14
@ludamad
ludamad force-pushed the ad/ci3-remove-dashboard branch from 8062322 to 8d9229b Compare September 9, 2026 15:47
@ludamad
ludamad force-pushed the ad/ci3-remove-dashboard branch from 8d9229b to 9d67a4b Compare September 9, 2026 18:58
@ludamad
ludamad force-pushed the ad/ci3-remove-dashboard branch from 9d67a4b to 48f5164 Compare September 9, 2026 18:59
Adam Domurad added 3 commits September 9, 2026 17:51
Adds ci3/CI3_SERVER_API.md, the small HTTP API ci3 will use for logs, the test cache, run
metadata, events and build-cache artifacts, together with:

- ci3/ci3_client_*: the only way ci3 will talk to a server. No-ops when there is none.
- ci3/source_ci3_client: discovery, configured by CI3_SERVER_URL (a URL, or `compat`),
  CI3_SERVER_TOKEN and CI3_PUBLIC_URL. A local run starts the file-backed server on demand.
- ci3/ci3_server: two reference implementations. The file backend keeps everything under
  /tmp/ci3. The transitional compat backend forwards to the redis/S3 stores the current ci3
  writes to directly, with the key shapes the labs dashboard reads, so CI keeps its logs and
  test cache until that dashboard serves the API itself.
- tests for both backends (the compat one against a throwaway redis and a fake aws CLI).

Nothing in ci3 uses any of this yet; the switch-over is the next PR.
Every ci3 script now reaches its stores only through the ci3_client_* scripts: cache_log,
denoise, run_test_cmd, filter_cached_test_cmd, exec_test (per-test timings), log_ci_run, the
Slack notifiers, ci.sh log/test-timings, and cache_upload/download/exists/ls (artifact reads
fall back to the public build cache). source_redis and source_cache are gone; ci3 no longer
writes to S3 itself.

bootstrap_ec2 hands the instance CI3_SERVER_URL as configured, or `compat` with none, so the
instance runs the compat server and CI behaves as before; a developer's on-demand local server
is never forwarded. Workflows forward CI3_SERVER_URL/CI3_SERVER_TOKEN; Post-Actions runs the
compat server so the whole-run success marker still lands in the build cache; the release job
downloads the packed release with aws directly.

Also fixed on the way, found by running this in CI: the bb benchmark scripts sourced
source_redis/source_cache, and make labs-use-local ran labs' bootstrap with the foundation's
ci3 root exported.
…ling

The CI dashboard (rkapp) lives in aztec-node, which is where the production implementation of
ci3/CI3_SERVER_API.md will be built; nothing here reads redis any more. Removes ci3/dashboard,
ci3/lua, watch_ci and ci.sh dash, the unused cache_delete and minio test harness, the bundled
redis-cli, and the redis packages from the bootstrap dependencies. Docs describe the server
API instead of redis.
@ludamad

ludamad commented Sep 9, 2026

Copy link
Copy Markdown
Collaborator Author

Folded into #25429: the stack is now two PRs (tooling + switch-over in #25427, the deletions in #25429).

@ludamad ludamad closed this Sep 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant