Commit fc540ce
set pg name based on ranks (pytorch#166182)
Summary:
- in torchft we have multiple default pg's, 1 for each task group
- for flight recorder to work, each of these need to have a different name, so entries can be matched
- change the `init_process_group` api to optionally take a list of ranks. if provided, we use the hash of the ranks as the name of the pg. for torchft, we'll pass global ranks here so the default pg have a different name on each task group
Pull Request resolved: pytorch#166182
Approved by: https://github.com/fduwjj1 parent d1a6e00 commit fc540ce
1 file changed
+7
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1583 | 1583 | | |
1584 | 1584 | | |
1585 | 1585 | | |
| 1586 | + | |
1586 | 1587 | | |
1587 | 1588 | | |
1588 | 1589 | | |
| |||
1657 | 1658 | | |
1658 | 1659 | | |
1659 | 1660 | | |
| 1661 | + | |
| 1662 | + | |
1660 | 1663 | | |
1661 | 1664 | | |
1662 | 1665 | | |
| |||
1761 | 1764 | | |
1762 | 1765 | | |
1763 | 1766 | | |
1764 | | - | |
| 1767 | + | |
| 1768 | + | |
| 1769 | + | |
| 1770 | + | |
1765 | 1771 | | |
1766 | 1772 | | |
1767 | 1773 | | |
| |||
0 commit comments