Repository navigation

[PyTorch] Preserve CUDA RNG state during checkpoint recompute - #3835

Open

losewayy wants to merge 24 commits into

NVIDIA:mainfrom

losewayy:fix/cudarngstates-tracker-checkpoint-dropout

Open

[PyTorch] Preserve CUDA RNG state during checkpoint recompute#3835
losewayy wants to merge 24 commits into
NVIDIA:mainfrom
losewayy:fix/cudarngstates-tracker-checkpoint-dropout

Commits on Nov 8, 2026
- [PyTorch] Preserve CUDA RNG state during checkpoint recompute
  losewayy
  committed
  3816a26
- [PyTorch] Test CUDA RNG restoration after checkpoint backward
  losewayy
  committed
  613a449
Commits on Nov 10, 2026
- [PyTorch] Restore captured checkpoint RNG state on device
  pggPL
  committed
  26a46cc
- [PyTorch] Use public Philox API for captured checkpoint RNG
  pggPL
  committed
  e5d2d08
- [PyTorch] Guard captured stochastic NVFP4 quantization
  pggPL
  committed
  1149f52
- Trim redundant checkpoint RNG test coverage
  pggPL
  committed
  24f7ce5
- Expose custom op tags to checkpoint RNG guards
  pggPL
  committed
  8afc77a
- Clarify the missing Philox state sentinel
  pggPL
  committed
  5fa09af
- Restore captured RNG bases and CPU offsets separately
  pggPL
  committed
  41a4afc
- Remove the RNG tracker snapshot note
  pggPL
  committed
  52f1895
- Remove the custom op RNG tag test
  pggPL
  committed
  6dab9c7
- Restore the unrelated NVFP4 guard change
  pggPL
  committed
  65ab410
- Remove the NVFP4 stochastic rounding property guard
  pggPL
  committed
  82c6e72
- Integrate checkpoint RNG guard and snapshot simplifications
  pggPL
  committed
  1e8baf3
- Remove the missing Philox API checkpoint tests
  pggPL
  committed
  9a72905
Commits on Nov 13, 2026
- Merge main into checkpoint RNG fixes
  pggPL
  committed
  d0192ef
- Remove unused custom op tags parameter
  pggPL
  committed
  f4c9a29
- Keep deprecated graph-safe RNG helpers
  
  pggPL
  and
  claude
  committed
  4ecc533
- Keep dropout implementation selection for p=0
  
  pggPL
  and
  claude
  committed
  369376b
- Accept preserve_rng_state in checkpoint during capture
  
  pggPL
  and
  claude
  committed
  2a3d1d3
- Drop cosmetic edits unrelated to checkpoint RNG
  
  pggPL
  and
  claude
  committed
  b34da49
- Restore checkpoint RNG handles after a failed value restore
  
  pggPL
  and
  claude
  committed
  cd2fa8b
- Test the checkpoint RNG guard without Philox state access
  
  pggPL
  and
  claude
  committed
  26645f8
- Revert "Test the checkpoint RNG guard without Philox state access"
  pggPL
  committed
  5ea84ec

Commits

Commits on Nov 8, 2026

Commits on Nov 10, 2026

Commits on Nov 13, 2026