Skip to content

fix(distserve): coalesce PD connection warmup to prevent Proxy OOM - #4980

Draft
gokay-ai wants to merge 2 commits into
InternLM:mainfrom
gokay-ai:cursor/pd-warmup-conn-coalesce-96e8
Draft

fix(distserve): coalesce PD connection warmup to prevent Proxy OOM#4980
gokay-ai wants to merge 2 commits into
InternLM:mainfrom
gokay-ai:cursor/pd-warmup-conn-coalesce-96e8

fix(distserve): register PD conn wait timeout in pytorch envs

c2fee77
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs