@@ -54,7 +54,22 @@ PaddlePALM support both python2 and python3, linux and windows, CPU and GPU. The
pip install paddlepalm
```
We incorporate many pretrained models to initialize model backbone parameters. Training big NLP model, e.g., 12-layer transformers, with pretrained models is practically much more superior than that with randomly initialized parameters. To see all the available pretrained models and download, run following code in python interpreter (input command `python` in shell):
We incorporate many pretrained models to initialize model backbone parameters. Training big NLP model, e.g., 12-layer transformers, with pretrained models is practically much more effective than that with randomly initialized parameters. To see all the available pretrained models and download, run following code in python interpreter (input command `python` in shell):
```python
>>>frompaddlepalmimportdownloader
...
...
@@ -76,7 +91,6 @@ Available pretrain items:
...
```
Then
## Usage
...
...
@@ -108,37 +122,13 @@ To run with multi-task learning mode:
The save/load and predict operations of a multi_head_trainer is the same as a trainer.
"""Set the task in this trainer as auxilary task. \nCAUSIOUS: This API only works on multi-task learning mode. Each task is set as target task by default. """