call master.next_record() get no task when running twice
Created by: typhoonzero
The code is:
def cloud_reader():
print "connecting to master, etcd endpoints: ", etcd_endpoint
master_client = master.client(etcd_endpoint, 5, 64)
master_client.set_dataset(
["/pfs/dlnel/public/dataset/uci_housing/uci_housing-*-of-*"])
while 1:
r, e = master_client.next_record()
if not r:
break
print r
yield pickle.loads(r)
when run for the second time, it reports:
connecting to master, etcd endpoints: http://10.1.3.2:2379
['/pfs/dlnel/public/dataset/uci_housing/uci_housing-*-of-*']
ERRO[0000] Get task failed, sleep 3 seconds and continue, no more available task
ERRO[0003] Get task failed, sleep 3 seconds and continue, no more available task
...