提交 dcccb825 编写于 作者: littletomatodonkey's avatar littletomatodonkey

fix reader hang for mulit-cards training

上级 7618526f
......@@ -140,7 +140,8 @@ def get_file_list(params):
full_lines = shuffle_lines(full_lines, params["shuffle_seed"])
# use only partial data for each trainer in distributed training
full_lines = full_lines[trainer_id::trainers_num]
img_per_trainer = len(full_lines) // trainers_num
full_lines = full_lines[trainer_id::trainers_num][:img_per_trainer]
return full_lines
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册