Skip to content

[PyTorch] Fix NaN expert weight gradients at num_groups == 1 with SReLU - #3485

Open
GarlGuo wants to merge 1 commit into
NVIDIA:mainfrom
GarlGuo:srelu-num-group-1
Open

[PyTorch] Fix NaN expert weight gradients at num_groups == 1 with SReLU#3485
GarlGuo wants to merge 1 commit into
NVIDIA:mainfrom
GarlGuo:srelu-num-group-1

[PyTorch] Take the num_groups == 1 dense shortcuts only when the kern…

068e111
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Sep 8, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO