# Download | model | model arc | Number of parameters | Model Size | download | |-----------------|--------------------------------------|----------------------|------------------|---------------------------------------------------| |ERNIE 3.0-Base | 12-layer, 768-hidden, 12-heads | 117.9 M | 452.4MB |[Pretrained Model](https://bj.bcebos.com/paddlenlp/models/transformers/ernie_3.0/ernie_3.0_base_zh.pdparams)| |ERNIE 3.0-Medium | 6-layer, 768-hidden, 12-heads | 75.4 M | 312.5MB |[Pretrained Model](https://bj.bcebos.com/paddlenlp/models/transformers/ernie_3.0/ernie_3.0_medium.pdparams)| |ERNIE 3.0-Mini | 6-layer, 384-hidden, 12-heads | 26.9 M | 109.0MB |[Pretrained Model](https://bj.bcebos.com/paddlenlp/models/transformers/ernie_3.0/ernie_3.0_mini_zh.pdparams)| |ERNIE 3.0-Micro | 4-layer, 384-hidden, 12-heads | 23.4 M | 95.48MB |[Pretrained Model](https://bj.bcebos.com/paddlenlp/models/transformers/ernie_3.0/ernie_3.0_micro_zh.pdparams)| |ERNIE 3.0-Nano | 4-layer, 312-hidden, 12-heads | 17.9 M | 72.4MB |[Pretrained Model](https://bj.bcebos.com/paddlenlp/models/transformers/ernie_3.0/ernie_3.0_nano_zh.pdparams)|