Created by: lcy-seso

• In this example, we would like to show how to train:

  1. a n-gram language model (please refer to this configuration file written in old PaddlePaddle API）
  2. a rnn/lstm language model (please refer to this configuration file written in old PaddlePaddle API)

• Besides, we would like to show how to generate sequence from:

  1. a N-gram language
  2. a rnn language model

• In the generation process, please consider the following two situations:

  1. generate a sequence by using paddle.infer API, in which you need to implement one-way search or beam search (beam search is more complicated, I suggest to implement one-way search first.)
  2. generate a sequence by using recurrent_layer_group

• Please consider to use the following data for training and add these datasets into paddle.dataset package.

  1. 1billionword-training, 1 billionword-test
  2. ptb

• Please pull your codes and docs into the language_model directory.