Skip to content

[PyTorch] Fix NaN expert weight gradients at num_groups == 1 with SReLU - #3485

Open
GarlGuo wants to merge 1 commit into
NVIDIA:mainfrom
GarlGuo:srelu-num-group-1
Open

[PyTorch] Fix NaN expert weight gradients at num_groups == 1 with SReLU#3485
GarlGuo wants to merge 1 commit into
NVIDIA:mainfrom
GarlGuo:srelu-num-group-1

Commits

Commits on Sep 4, 2026