Pantheon student memory leak
Created by: Dabulv
环境
python 3.6.8 paddlepaddle 1.8.3.post97 paddleslim 1.1.1
程序
student = Student(merge_strategy=None)
student.register_teacher(in_address="{}:{}".format(in_address, t0_out_port), in_path=t0_out_path)
student.register_teacher(in_address="{}:{}".format(in_address, t1_out_port), in_path=t1_out_path)
student.start()
knowledge_desc = student.get_knowledge_desc()
generator = student.get_knowledge_generator(batch_size)
for step, batch in tqdm.tqdm(enumerate(generator())):
time.sleep(3)
运行之后内存一直上涨,达到 200GB 之后就被系统kill掉了。