Created by: lcy-seso

• In this example, we would like to show how to use NCE in PaddlePaddle, which is useful when training language model with a large vocabulary.

• The example must include a training and a predicting process.

• Please consider to use the following data for training and add these datasets into paddle.dataset package.

  1. 1billionword-training, 1 billionword-test
  2. ptb

• Note that the dataset is also used in this task, please consider to share the data processing work.

• Please pull your codes and docs into the nce_cost directory.