Fix gradient accumulation under FSDP2: defer cross-replica all-reduce - #162
Open
Sullivan07043 wants to merge 1 commit into
Open
Fix gradient accumulation under FSDP2: defer cross-replica all-reduce#162Sullivan07043 wants to merge 1 commit into
Sullivan07043 wants to merge 1 commit into