Skip to content

windows: CUDA serving build — cuda-guard + cmake/llvm runtime paths (rescued from #2056) - #2249

Merged
joelteply merged 1 commit into
canaryfrom
fix/windows-cuda-build-rescue
Aug 15, 2026
Merged

windows: CUDA serving build — cuda-guard + cmake/llvm runtime paths (rescued from #2056)#2249
joelteply merged 1 commit into
canaryfrom
fix/windows-cuda-build-rescue

Conversation

@joelteply

Copy link
Copy Markdown
Contributor

Third rescue from the stalled queue, same method as #2244 and #2246.

#2056 is a 56-commit superset branch. git cherry reports 55 unique by patch-id, but patch identity is not semantic supersession — the branch contains #2053's commits verbatim (97011f4f8, 0ea9538a1, 175cd6d51, 10fed2798), several of which target a demand API canary has already replaced. Rebasing the whole thing means re-litigating a superseded feature 20 commits deep.

So it gets taken apart into coherent units instead. This is the Windows-CUDA build unit — 4 files, +21/−4, touching install-manifest.toml, cargo-features.sh, and the generated Windows manifest. Cherry-picked onto canary, applied clean.

Scoped deliberately to the build plumbing, which is self-contained and platform-critical: it is the difference between the Windows/5090 node building a CUDA serving binary and not.

Still to rescue from #2056 (each verified against canary first, then its own PR):

  • the grid-overflow / residency stack (98a6a16c8b7b526455): ModelResidencyView, ResidencyBeacon/ResidencyLedger, GridResidencyModule, route_grid_overflow, and the persona effector closure
  • expert_observe harness (315298940, e47661aaf)
  • the loud-failure fixes (afef13294 ChatModule per-request, 9d4509bce airc room-route echo)

#2056 itself closes once its unique content is landed in reviewable pieces — it is not going to rebase as one branch, and pretending otherwise is what nearly destroyed it earlier tonight (blind rebase --skip dropped commits that CREATE files; restored from origin only because nothing had been force-pushed).

…ime_path

Three real fixes that get continuum-core to build+detect CUDA on native
windows-msvc (validated: features cuda,directml -> detect_cuda -> 27 GiB on a
5090, was a bogus 4GB under directml-only):

- cargo-features.sh: only add `cuda` on Windows+Nvidia when cl.exe is actually
  reachable, else directml-only. candle affine.cu needs nvcc->cl.exe; without it
  the whole build hard-failed instead of degrading.
- install-manifest.toml: cmake + llvm-libclang had no [module.runtime_path], so
  start-server.sh installed them to ~/.continuum/tools but never put them on PATH
  -> every 'cmake not found' / bindgen libclang failure. Added windows runtime_path,
  regenerated manifests.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01Q4NU4VNiELPQfBpCacDZGc
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant