[Feature] Decouple expert parallelism from FSDP sharding (dp2ep layout) - #2093

Open

silencelamb wants to merge 14 commits into

InternLM:mainfrom

silencelamb:pr/decouple-ep-fsdp

Commits on Sep 17, 2026

[Test] Add fake-PG L0 placement tests pinning the legacy MoE EP/FSDP layout
silencelamb
committed
1f919be
[Feature] Decouple expert parallel from FSDP sharding (dp2ep layout)
silencelamb
committed
da66126
[Feature] Float8, HF/DCP and RL weight-sync support for the decoupled EP/FSDP layout
silencelamb
committed
f101de1
[Fix] Gather RL layer-wise weights with the submodule that owns them
silencelamb
committed
d521615
[Docs] Add the decoupled EP/FSDP design note for maintainers
silencelamb
committed
7df5a7d
[Docs] Expand the decoupled EP/FSDP design note: code map, evidence links, limitation details
silencelamb
committed
9f5eefa
[Docs] Drop the per-file code map from the decoupled EP/FSDP design note
silencelamb
committed
23751f4
[Fix] Validate the decoupled EP/FSDP topology with a Pydantic validator
silencelamb
committed
de4cc89
[Test] Gate the decoupled EP/FSDP L1-L3 checks in pytest
silencelamb
committed
cc13362
[Docs] Record the topology validator and the pytest gates in the decoupled EP/FSDP design note
silencelamb
committed
212c05e

Commits on Sep 27, 2026