diff --git a/README.en.md b/README.en.md
index 3edeb53bf03aef2dc546c428945eddaf3dd2218f..48f3afc53c73b3c2d48588fd687ed0cf8b1ab337 100644
--- a/README.en.md
+++ b/README.en.md
@@ -13,7 +13,8 @@ ERNIE 2.0 builds a strong basic for nearly every NLP tasks: Text Classification,
 # News
 
 - May.20.2021:
-    - ERNIE-Doc, ERNIE-Gram, [`ERNIE-ViL`](https://github.com/PaddlePaddle/ERNIE/tree/repro/ernie-vil), ERNIE-UNIMO are **avaliable** now!
+    - [`ERNIE-Doc`](https://github.com/PaddlePaddle/ERNIE/tree/repro/ernie-doc), [`ERNIE-Gram`](./ernie_gram/), [`ERNIE-ViL`](https://github.com/PaddlePaddle/ERNIE/tree/repro/ernie-vil) models are **avaliable** now!
+    - `ERNIE-UNIMO` will be released soon.
 
 - Dec.29.2020:
  	- Pretrain and finetune ERNIE with [PaddlePaddle v2.0](https://github.com/PaddlePaddle/Paddle/tree/release/2.0-rc).
@@ -21,7 +22,7 @@ ERNIE 2.0 builds a strong basic for nearly every NLP tasks: Text Classification,
     - Introducing `Gradient accumulation`, run `ERNIE-large` with only 8G memory.
 
 - Sept.24.2020:
-    - [`ERNIE-ViL`](https://github.com/PaddlePaddle/ERNIE/tree/repro/ernie-vil) is **avaliable** now!
+    - We have announced the [`ERNIE-ViL`](https://github.com/PaddlePaddle/ERNIE/tree/repro/ernie-vil)!
         - A **knowledge-enhanced** joint representations for vision-language tasks.
             - Constructing three **Scene Graph Prediction** tasks utilizing structured knowledge.
 	    - The state-of-the-art performance on 5 downstream tasks, 1st place on [VCR leaderboad](https://visualcommonsense.com/leaderboard/).
diff --git a/README.zh.md b/README.zh.md
index f7f24a10386f5f6f456949c4729ca8d1e1c6e723..b2c6c7a297244c81380031631cb7d282488bdb55 100644
--- a/README.zh.md
+++ b/README.zh.md
@@ -12,10 +12,10 @@ ERNIE是百度开创性提出的基于知识增强的持续学习语义理解框
 
 - 2021.5.20:
    - ERNIE 开源家族又添生力军!
-      - 显式多粒度语言知识模型[ERNIE-Gram]()
-      - 超长文本双向建模预训练模型[ERNIE-Doc]()
-      - 融合场景图知识的跨模态预训练模型[ERNIE-ViL](https://github.com/PaddlePaddle/ERNIE/tree/repro/ernie-vil)
-      - 语言与视觉一体的预训练模型[ERNIE-UNIMO]()
+      - 显式多粒度语言知识模型`ERNIE-Gram` [正式开源](./ernie_gram/)
+      - 超长文本双向建模预训练模型`ERNIE-Doc` [正式开源](https://github.com/PaddlePaddle/ERNIE/tree/repro/ernie-doc)
+      - 融合场景图知识的跨模态预训练模型`ERNIE-ViL` [正式开源](https://github.com/PaddlePaddle/ERNIE/tree/repro/ernie-vil)
+      - 语言与视觉一体的预训练模型`ERNIE-UNIMO` 将近期开源
 
 - 2020.12.29:
    - `ERNIE`开源工具套件全面升级 [PaddlePaddle v2.0](https://github.com/PaddlePaddle/Paddle/tree/release/2.0-rc)
@@ -23,7 +23,7 @@ ERNIE是百度开创性提出的基于知识增强的持续学习语义理解框
    - 引入`Gradient accumulation`, 8G显存也可运行`ERNIE-large`模型。
 
 - 2020.9.24:
-   - `ERNIE-ViL` 模型正式开源! ([点击进入](https://github.com/PaddlePaddle/ERNIE/tree/repro/ernie-vil))
+   - `ERNIE-ViL` 技术发布! ([点击进入](https://github.com/PaddlePaddle/ERNIE/tree/repro/ernie-vil))
        - 面向视觉-语言知识增强的预训练框架，首次在视觉-语言预训练引入结构化的知识。
            - 利用场景图中的知识，构建了物体、属性和关系预测任务，精细刻画模态间细粒度语义对齐。
        - 五项视觉-语言下游任务取得最好效果，[视觉常识推理榜单](https://visualcommonsense.com/)取得第一。