1. finetune/ pretrian fp16 amp 2. finetune/ pretrain multi processing 3. ner infer 4. py3 compat
ERNIE 2.0 is a continual pre-training framework for language understanding in which pre-training tasks can be incrementally built and learned through multi-task learning