local_cluster本地模拟分布式训练,不兼容py3
Created by: gentelyang
server端正常启动,worker端爆粗如下:
I0612 09:03:26.418155 3451 communicator.h:252] AsyncCommunicator Initialized Traceback (most recent call last): File "/opt/_internal/cpython-3.6.0/lib/python3.6/site-packages/paddle_rec-0.0.2-py3.6.egg/paddlerec/core/trainer.py", line 246, in run self.context_process(self._context) File "/opt/_internal/cpython-3.6.0/lib/python3.6/site-packages/paddle_rec-0.0.2-py3.6.egg/paddlerec/core/trainer.py", line 207, in context_process self._status_processorcontext['status'] File "/opt/_internal/cpython-3.6.0/lib/python3.6/site-packages/paddle_rec-0.0.2-py3.6.egg/paddlerec/core/trainers/general_trainer.py", line 95, in network network_class.build_network(context) File "/opt/_internal/cpython-3.6.0/lib/python3.6/site-packages/paddle_rec-0.0.2-py3.6.egg/paddlerec/core/trainers/framework/network.py", line 165, in build_network dataset["name"], context) File "/opt/_internal/cpython-3.6.0/lib/python3.6/site-packages/paddle_rec-0.0.2-py3.6.egg/paddlerec/core/trainers/framework/dataset.py", line 90, in create_dataset return self._get_dataset(dataset_name, context) File "/opt/_internal/cpython-3.6.0/lib/python3.6/site-packages/paddle_rec-0.0.2-py3.6.egg/paddlerec/core/trainers/framework/dataset.py", line 126, in _get_dataset file_list = context["fleet"].split_files(file_list) File "/opt/_internal/cpython-3.6.0/lib/python3.6/site-packages/paddle/fluid/incubate/fleet/base/fleet_base.py", line 179, in split_files trainer_files[i] = files[begin:begin + blocks[i]] TypeError: slice indices must be integers or None or have an index method Catch Exception:slice indices must be integers or None or have an index method
PaddleRec Error Message Summary:
Exit PaddleRec. catch exception in precoss status: [network_pass], except: slice indices must be integers or None or have an index method TypeError