Skip to content

Fix gradient accumulation under FSDP2: defer cross-replica all-reduce - #162

Open
Sullivan07043 wants to merge 1 commit into
NVIDIA:mainfrom
Sullivan07043:fix-fsdp2-accum
Open

Fix gradient accumulation under FSDP2: defer cross-replica all-reduce#162
Sullivan07043 wants to merge 1 commit into
NVIDIA:mainfrom
Sullivan07043:fix-fsdp2-accum

Commits

Commits on Aug 5, 2026