未验证 提交 b1837db3 编写于 作者: G guochaorong 提交者: GitHub

Merge pull request #1136 from guoshengCS/fix-ce-transformer-data

Fix ce data in transformer
#!/bin/bash #!/bin/bash
DATA_PATH=$HOME/.cache/paddle/dataset/wmt16 DATA_PATH=$HOME/.cache/paddle/dataset/wmt16
if [ ! -d $DATA_PATH ] ; then if [ ! -d $DATA_PATH/en_10000.dict ] ; then
python -c 'import paddle;paddle.dataset.wmt16.train(10000, 10000, "en")'\ python -c 'import paddle;paddle.dataset.wmt16.train(10000, 10000, "en")().next()'
'().next()'
tar -zxf $DATA_PATH/wmt16.tar.gz -C $DATA_PATH tar -zxf $DATA_PATH/wmt16.tar.gz -C $DATA_PATH
fi fi
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册