Created by: drunkinlove

Is English data ERNIE 2.0 was pretrained on available (Encyclopedia, BookCorpus, Reddit)? I'm particularly interested in building a frequency dictionary for the training data.