* fix translation.py bugs

* delete useless comments

* set couplet download root None

* add paddle.models api reference docs

* update docs

* update docs

* update docs

* tmp

* update docs

* update docs

* update docs

* update docs

* update transformer doc

* Update transformers.md

* Update transformers.md

* update transformer doc

* Update transformers.md

* update couplet readme

* update generation example

* add metric readme doc

* add "`" for APIs in doc

* Update README.md

Add "`" for APIs in doc

* Update metrics.md

* Update README.md

* update metric readme

* update lrscheduler

* minor fix

* add pre-commit

* minor fix

* Add __len__ to squad dataset

* minor fix

* Add dureader robust prototype

* dataset implement

* minor fix

* fix var name

* add dureader-yesno train script and dataset

* add readme and fix md5sum

* integrete dureader datasets

* change var names: segment to mode, root to data_file

* minor fix

* update var name

* Fix api bugs

* add dataset readme

* add express ner

* update readme format

* fix format bug

* change readme path

* fix format bug

* fix dataset bug

* add couplet

* simplify model code

* simplify code

* update couplet README

* add pad_token to TranslationDataset, update CoupletDataset

* update couplet url, add couplet generation example

* update TranslationDataset

* upadte classname to self in __init__

* update README.md

* update lrscheduler

* minor fix

* add pre-commit

* minor fix

* Add __len__ to squad dataset

* minor fix

* Add dureader robust prototype

* dataset implement

* minor fix

* fix var name

* add dureader-yesno train script and dataset

* add readme and fix md5sum

* integrete dureader datasets

* change var names: segment to mode, root to data_file

* minor fix

* update var name

* Fix api bugs

* add dataset readme

* add express ner

* update readme format

* fix format bug

* change readme path

* fix format bug

* update lrscheduler

* minor fix

* add pre-commit

* minor fix

* Add __len__ to squad dataset

* minor fix

* Add dureader robust prototype

* dataset implement

* minor fix

* fix var name

* add dureader-yesno train script and dataset

* add readme and fix md5sum

* integrete dureader datasets

* change var names: segment to mode, root to data_file

* minor fix

* update var name

* Fix api bugs

* add dataset readme

* add express ner

* update readme format

* add paddle.models api reference docs

* update docs

* update docs

* update docs

* 1. move PAD to the end
2. Add Readme.md

* optimize readme doc

Co-authored-by: Nwawltor <fanzeyang0904@hotmail.com>

* add paddle.models api reference docs

* update docs

* update docs

* update transformer doc

* Update transformers.md

* Update transformers.md

* update SamplerHelper.batch

* update batch_size, delete a useless log

* update SamplerHelper.batch

* update SamplerHelper.batch, change cmp_fn arg to key

* Update TranslationDataset and IWSLT

* fix doc error

* update rouge-l, move default_trans_func to utils

* fix error info bugs

* add score method for metric bleu and rouge-l

* update bleu doc

* Add Express Example

* Add Express Data

* Add Ernie for Express Example

* add the express for the paddlenlp

* remove the ernie_crf file
Co-authored-by: Nwanghuijuan03 <wanghuijuan03@baidu.com>

* Add Express Example

* Add Express Data

* Add Ernie for Express Example

* add the express for the paddlenlp
Co-authored-by: Nwanghuijuan03 <wanghuijuan03@baidu.com>

Co-authored-by: Nwawltor <fanzeyang0904@hotmail.com>

* update docs

* add sbert

* add readme

* update readme

* update codes

* update lrscheduler

* minor fix

* add pre-commit

* minor fix

* Add __len__ to squad dataset

* minor fix

* Add dureader robust prototype

* dataset implement

* minor fix

* fix var name

* add dureader-yesno train script and dataset

* add readme and fix md5sum

* integrete dureader datasets

* change var names: segment to mode, root to data_file

* minor fix

* update var name

* Fix api bugs

* update the readme for the benchmark

* udpate README file for the bert benchmark

* uddate the readme format for the benchmark bert
Co-authored-by: Nwawltor <fanzeyang0904@hotmail.com>
Co-authored-by: Nfangzeyang <fangzeyang@baidu.com>

* optimize lac

* formatted

* optimize lac

* optimize lac

* update lrscheduler

* minor fix

* add pre-commit

* minor fix

* Add __len__ to squad dataset

* minor fix

* Add dureader robust prototype

* dataset implement

* minor fix

* fix var name

* add dureader-yesno train script and dataset

* add readme and fix md5sum

* integrete dureader datasets

* change var names: segment to mode, root to data_file

* minor fix

* update var name

* update lrscheduler

* minor fix

* add pre-commit

* minor fix

* Add __len__ to squad dataset

* minor fix

* Add dureader robust prototype

* dataset implement

* minor fix

* fix var name

* add dureader-yesno train script and dataset

* add readme and fix md5sum

* integrete dureader datasets

* Unified the task name with paddle1.8

* fixed bug.

* update ppl, inherited from Metric, suitable for common mt and lm task.

* fix ppl bugs, delete useless argument

* fix ppl bugs, return a num not a numpy array.

* Add TokenEmbedding

* download corpus embedding data
* load embedding data by specifying corpus name
* extend the vocab of tokenizer from corpus embedding data

* add unk token setting

* modify tokenizer

* add extend voacb

* move jieba tokenizer and rename corpus_name->embedding_name

* use bos url instead of localhost

* add log when loading data

* add token dot computation; add __repr__ of TokenEmbedding

* add color logging

* use paddlenlp.utils.log

* adjust repr

* update pretrained embedding table

* fix padding idx