mindspore-Ecosystem
/
mindspore
21
0
Fork 27
Code Issues Pull Requests 6 Projects Releases Wiki Activity

!18995 Update docs about hccl_tools. 

Merge pull request !18995 from chenhaozhe/add-help-hccl-tools
This commit is contained in:
i-robot 2021-06-28 12:50:53 +00:00 committed by Gitee
parent 6788a45bd5 d47e45e6d2
commit bb3b173db9
2 changed files with 18 additions and 12 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
model_zoo/utils/hccl_tools/README.md
View File

@ -17,3 +17,5 @@ hccl_[device_num]p_[which device]_[server_ip].json
## Note
Please note that the Ascend accelerators used must be continuous, such [0,4) means to use four chips 0，1，2，3; [0,1) means to use chip 0; The first four chips are a group, and the last four chips are a group. In addition to the [0,8) chips are allowed, other cross-group such as [3,6) are prohibited.
`--visible_devices` means the visible devices according to the software system. Usually used in the virtual system or docker container that makes the device_id dismatch logic_id. `--device_num` uses logic_id. For example "4,5,6,7" means the system has 4 logic chips which are actually the last 4 chips in hardware while `--device_num` could only be set to "[0, 4)" instead of "[4, 8)"

28
model_zoo/utils/hccl_tools/hccl_tools.py
View File

@ -38,15 +38,20 @@ def parse_args():
" config file")
parser.add_argument("--device_num", type=str, default="[0,8)",
help="The number of the Ascend accelerators used. please note that the Ascend accelerators"
"used must be continuous, such [0,4) means to use four chips "
"0，1，2，3; [0,1) means to use chip 0; The first four chips are"
"a group, and the last four chips are a group. In addition to"
"the [0,8) chips are allowed, other cross-group such as [3,6)"
"used must be continuous, such [0,4) means using four chips "
"0，1，2，3; [0,1) means using chip 0; In the most Ascend system, "
"the first four chips belong to one group, and the last four chips belong to another one."
"Only full chips are allowed to cross-group such as [0,8), other cross-group such as [3,6)"
"are prohibited.")
parser.add_argument("--visible_devices", type=str, default="0,1,2,3,4,5,6,7",
help="will use the visible devices sequentially")
help="The visible devices according to the software system. "
"Usually used in the virtual system or docker container "
"that makes the device_id dismatch logic_id. --device_num uses logic_id. "
"For example \"4,5,6,7\" means the system has 4 logic chips "
"which are actually the last 4 chips in hardware "
"while `--device_num` could only be set to \"[0, 4)\" instead of \"[4, 8)\"")
parser.add_argument("--server_ip", type=str, default="",
help="server ip")
help="Set the server_ip manually, to avoid errors in auto detection.")
args = parser.parse_args()
return args
@ -92,12 +97,11 @@ def main():
if first_num > last_num:
raise ValueError("First num {} of device num {} must less than last num {} !".format(first_num, args.device_num,
last_num))
if first_num < 4:
if last_num > 4:
if first_num == 0 and last_num == 8:
pass
else:
raise ValueError("device num {} must be in the same group of [0,4] or [4,8] !".format(args.device_num))
if first_num < 4 < last_num:
if first_num == 0 and last_num == 8:
pass
else:
raise ValueError("device num {} must be in the same group of [0,4] or [4,8] !".format(args.device_num))
device_num_list = list(range(first_num, last_num))
print("device_num_list:", device_num_list)