From 8a5ba3027124dd0d7a49594cf071998d309e6896 Mon Sep 17 00:00:00 2001 From: Meiyim Date: Sat, 6 Jun 2020 23:35:33 +0800 Subject: [PATCH] update seq2seq readme (#485) * update seq2seq readme * update readme * Update README.zh.md --- README.en.md | 2 +- README.zh.md | 9 ++++++--- demo/seq2seq/README.md | 4 ++-- experimental/seq2seq | 1 - experimental/seq2seq/README.md | 1 + 5 files changed, 10 insertions(+), 7 deletions(-) delete mode 120000 experimental/seq2seq create mode 120000 experimental/seq2seq/README.md diff --git a/README.en.md b/README.en.md index e89704d..7336d8d 100644 --- a/README.en.md +++ b/README.en.md @@ -179,7 +179,7 @@ many other demo python scripts: 1. [Semantic Similarity](./demo/finetune_classifier_dygraph.py) 1. [Name Entity Recognition(NER)](./demo/finetune_ner_dygraph.py) 1. [Machine Reading Comprehension](./demo/finetune_mrc_dygraph.py) -1. [Text generation](./experimental/seq2seq/README.md) +1. [Text generation](./demo/seq2seq/README.md) diff --git a/README.zh.md b/README.zh.md index 25f2930..46afec4 100644 --- a/README.zh.md +++ b/README.zh.md @@ -80,7 +80,7 @@ print(pooled.numpy()) # convert results to numpy 本项目依赖PaddlePaddle 1.7.0+, 请参考[这里](https://www.paddlepaddle.org.cn/install/quick)安装 PaddlePaddle。 -##### 2. 安装 ERNIE +##### 2. 安装 ERNIE 套件 ```script @@ -94,7 +94,10 @@ git clone https://github.com/PaddlePaddle/ERNIE.git --depth 1 cd ERNIE pip install -r requirements.txt pip install -e . - +``` +`propeller`是辅助模型训练的高级框架,包含NLP常用的前、后处理流程。你可以通过将本repo根目录放入`PYTHONPATH`的方式导入`propeller`: +```shell +export PYTHONPATH=$PWD:$PYTHONPATH ``` ##### 3. 下载预训练模型(可选) @@ -179,7 +182,7 @@ python3 -m paddle.distributed.launch \ 1. [语义匹配](./demo/finetune_classifier_dygraph.py) 1. [命名实体识别(NER)](./demo/finetune_ner_dygraph.py) 1. [机器阅读理解](./demo/finetune_mrc_dygraph.py) (需要多卡环境运行;参见上面"分布式 finetune"一节) -1. [文本摘要生成](./experimental/seq2seq/README.md) +1. [文本摘要生成](./demo/seq2seq/README.md) **推荐超参数设置:** diff --git a/demo/seq2seq/README.md b/demo/seq2seq/README.md index dc75330..87f0b49 100644 --- a/demo/seq2seq/README.md +++ b/demo/seq2seq/README.md @@ -12,7 +12,7 @@ To starts finetuning ERNIE-GEN, run: ```script python3 -m paddle.distributed.launch \ --log_dir ./log \ - ./ernie_d/experimental/finetune_seq2seq_dygraph.py \ + ./demo/seq2seq/finetune_seq2seq_dygraph.py \ --from_pretrained ernie-gen-base-en \ --data_dir ./data/cnndm \ --save_dir ./model_cnndm \ @@ -52,7 +52,7 @@ To run beam serach decode after you got a finetuned model. try: ```shell -cat one_column_source_text| python3 ernie_d/experimental/seq2seq/decode.py \ +cat one_column_source_text| python3 demo/seq2seq/decode.py \ --from_pretrained ./ernie_gen_large \ --save_dir ./model_cnndm \ --bsz 8 diff --git a/experimental/seq2seq b/experimental/seq2seq deleted file mode 120000 index 390e351..0000000 --- a/experimental/seq2seq +++ /dev/null @@ -1 +0,0 @@ -../demo/seq2seq \ No newline at end of file diff --git a/experimental/seq2seq/README.md b/experimental/seq2seq/README.md new file mode 120000 index 0000000..a04e908 --- /dev/null +++ b/experimental/seq2seq/README.md @@ -0,0 +1 @@ +../../demo/seq2seq/README.md \ No newline at end of file -- GitLab