feat: extend DCP to GQA and optimize query communication - #4995

Draft

CUHKSZzxy wants to merge 43 commits into

InternLM:mainfrom

CUHKSZzxy:feat/dcp-optimizations

Commits on Sep 3, 2026

feat: support decode context parallelism
CUHKSZzxy
committed
d7b39d3
test: streamline dcp coverage
CUHKSZzxy
committed
54b2811
refactor: isolate sparse index dcp top-k
CUHKSZzxy
committed
73ffcd6

Commits on Sep 4, 2026

Commits on Sep 8, 2026

chore: merge main into dcp branch
CUHKSZzxy
committed
c670be9
refactor: simplify dcp plumbing
CUHKSZzxy
committed
d7f987f
fix: bound dcp prefill workspace and retain fp32 merges
CUHKSZzxy
committed
56c612a

Commits on Sep 9, 2026

feat: support dcp with dense and sparse mla mtp
CUHKSZzxy
committed
cbc35be

Commits on Sep 10, 2026

Commits on Sep 14, 2026

perf: fuse dcp metadata preparation and cached-prefix index mapping
CUHKSZzxy
committed
c2de662
refactor: simplify dcp validation and regression tests
CUHKSZzxy
committed
45dbb2d
refactor: reuse shared sparse top-k for dcp
CUHKSZzxy
committed
c072446
refactor: remove dcp validator and simplify usage docs
CUHKSZzxy
committed
9542901
refactor: share dcp attention gather and merge helpers
CUHKSZzxy
committed
6553efc
merge: sync upstream main into feat/dcp
CUHKSZzxy
committed
6249f8c
refactor: simplify dcp kernels and unify constexpr names
CUHKSZzxy
committed
84ad2a2

Commits on Sep 15, 2026

Commits on Sep 16, 2026

chore: merge upstream main into DCP branch
CUHKSZzxy
committed
27d4dcb
perf: reduce DCP attention outputs in model dtype
CUHKSZzxy
committed
856e303
perf: optimize sparse DCP global top-k selection
CUHKSZzxy
committed
15865bc

Commits on Sep 17, 2026

Commits on Sep 18, 2026

perf: optimize DCP query communication
CUHKSZzxy
committed
6dd080a

Commits on Sep 21, 2026

feat: support GQA DCP with FP8 KV cache
CUHKSZzxy
committed
2718b1a
test: remove standalone GQA DCP tests
CUHKSZzxy
committed
71d10c4
fix: propagate KV quantization policy to draft attention
CUHKSZzxy
committed
fc84652

Commits on Sep 23, 2026

refactor: simplify CUDA communicator routing
CUHKSZzxy
committed
1351cfe