tree aafe76900dc24c6a4413531888649f1a43b51a97
parent b91f83f18139a6ed2626c30979a38e533d4c7d7c
author Wanchao Liang <wanchaol@users.noreply.github.com> 1713913234 -0700
committer PyTorch MergeBot <pytorchmergebot@users.noreply.github.com> 1713933118 +0000

[device_mesh] add a private init backend option (#124780)

This PR adds a private init backend option, to tackle the issues sub
mesh creation:

in device mesh slicing we don't want to create process groups again,
so explicitly turn the group creation off it's useful

Also I think there might be more submesh creation functionality so
having this flag would ensure that there's no new group created

Differential Revision: [D56497780](https://our.internmc.facebook.com/intern/diff/D56497780)
Pull Request resolved: https://github.com/pytorch/pytorch/pull/124780
Approved by: https://github.com/awgu