diff --git a/README.md b/README.md
index e8fc4466f706a2e91f4fd77ea89d83d916ce6de7..14fbfae27268912ff40b2e710b89caea206c5eb1 100644
--- a/README.md
+++ b/README.md
@@ -36,6 +36,8 @@ We construct several tasks to capture different aspects of information in the tr
 - **Structure-aware Tasks**:  to capture the syntactic information
 - **Semantic-aware Tasks**:  in charge of semantic signals
 
+At the same time, ERINE 2.0 feeds task embedding to model the characteristic of different tasks. We represent different tasks with an ID ranging from 0 to N. Each task ID is assigned to one unique task embedding.
+
 ![ernie2.0_model](.metas/ernie2.0_model.png)
 
 
diff --git a/README.zh.md b/README.zh.md
index 7697c94c3dd9c3cd2a3b1ab7cd598d890de9720e..269f408df3ff99d4276d4378b7c54c6f7bbc6c0d 100644
--- a/README.zh.md
+++ b/README.zh.md
@@ -36,6 +36,8 @@
 - **Structure-aware Tasks**: 语法 (syntactic) 级别信息的学习
 - **Semantic-aware Tasks**:  语义 (semantic) 级别信息的学习
 
+同时，针对不同的 pre-training 任务，ERNIE 2.0 引入了 Task Embedding 来精细化地建模不同类型的任务。不同的任务用从 0 到 N 的 ID 表示，每个 ID 代表了不同的预训练任务。
+
 ![ernie2.0_model](.metas/ernie2.0_model.png)