Skip to content

Allow fake process groups to simulate any rank - #4018

Open
ezyang wants to merge 1 commit into
mainfrom
gh/ezyang/9/head
Open

Allow fake process groups to simulate any rank#4018
ezyang wants to merge 1 commit into
mainfrom
gh/ezyang/9/head

Conversation

@ezyang

@ezyang ezyang commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Fake mode always initialized global rank zero, which prevents exercising
MPMD code paths such as nonzero pipeline stages. Read RANK in fake mode
and validate it against the simulated world size while preserving rank
zero as the default.

[ghstack-poisoned]
@ezyang

ezyang commented Jul 29, 2026

Copy link
Copy Markdown
Contributor Author

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Meta Open Source bot. label Jul 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants