diff --git a/RELEASE.md b/RELEASE.md
index a8a245ab442ba0fc63d1f1fda932e7590a6fe4ca..11b40cf7a8b0b454fd9341169f00180e38f39888 100644
--- a/RELEASE.md
+++ b/RELEASE.md
@@ -1,3 +1,27 @@
+# Release v0.10.0
+
+## New Features
+
+* Support rectangle input for CNN.
+* Support stride pooling for seqlastin and seqfirstin.
+* Expose seq_concat_layer/seq_reshape_layer in `trainer_config_helpers`.
+
+## Improvements
+
+* Speedup the backward of average layer on GPU.
+* Reorganize the catalog of doc/ and refine several docs.
+* Add Travis-CI for checking dead links.
+* Add a example for explaining sparse_vector.
+* Add Relu in layer_math.py
+
+## Bug Fixes
+
+* Add layer check for recurrent_group.
+* Clang-format off on some cuda .cc files.
+* Fix LogActivation which is not defined.
+* Fix bug when run test_layerHelpers multiple times.
+* Fix protobuf size limit on seq2seq demo.
+
 # Release v0.9.0
 
 ## New Features: