Skip to content

[Feature] Decouple expert parallelism from FSDP sharding (dp2ep layout) - #2093

Open
silencelamb wants to merge 14 commits into
InternLM:mainfrom
silencelamb:pr/decouple-ep-fsdp
Open

[Feature] Decouple expert parallelism from FSDP sharding (dp2ep layout)#2093
silencelamb wants to merge 14 commits into
InternLM:mainfrom
silencelamb:pr/decouple-ep-fsdp

[Docs] Describe the decoupled expert groups' reshard timing and backw…

7c53b7d
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs