提交 11c298b7 编写于 作者: M mindspore-ci-bot 提交者: Gitee

!118 fix bug of format error of the file guide of checkpoint for hybrid parallel

Merge pull request !118 from WeibiaoYu/master
...@@ -248,10 +248,11 @@ param_dict = load_checkpoint("./CKP-Integrated_1-4_32.ckpt") ...@@ -248,10 +248,11 @@ param_dict = load_checkpoint("./CKP-Integrated_1-4_32.ckpt")
### 步骤2:对模型并行参数做切分处理 ### 步骤2:对模型并行参数做切分处理
下面以一个具体的模型参数为例,参数名称为“model_parallel_weight", 数据值为Tensor [[1, 2, 3, 4], [5, 6, 7, 8]],切分逻辑为2卡场景,按[2, 1]切分。 下面以一个具体的模型参数为例,参数名称为“model_parallel_weight", 数据值为Tensor [[1, 2, 3, 4], [5, 6, 7, 8]],切分逻辑为2卡场景,按[2, 1]切分。
​切分后数据分布情况如下: 切分后数据分布情况如下:
| Device0 | Device1 | | Device0 | Device1 |
| ------------------- | -------------------- | | ------------------- | -------------------- |
| Value [1, 2, 3, 4] | Value [5, 6, 7, 8] | | Value [1, 2, 3, 4] | Value [5, 6, 7, 8] |
1. 对模型参数数据做切分。 1. 对模型参数数据做切分。
......
...@@ -30,7 +30,6 @@ MindSpore教程 ...@@ -30,7 +30,6 @@ MindSpore教程
advanced_use/visualization_tutorials advanced_use/visualization_tutorials
advanced_use/mixed_precision advanced_use/mixed_precision
advanced_use/distributed_training advanced_use/distributed_training
advanced_use/checkpoint_for_hybrid_parallel
advanced_use/computer_vision_application advanced_use/computer_vision_application
advanced_use/nlp_application advanced_use/nlp_application
advanced_use/customized_debugging_information advanced_use/customized_debugging_information
...@@ -38,5 +37,6 @@ MindSpore教程 ...@@ -38,5 +37,6 @@ MindSpore教程
advanced_use/on_device_inference advanced_use/on_device_inference
advanced_use/model_security advanced_use/model_security
advanced_use/network_migration advanced_use/network_migration
advanced_use/checkpoint_for_hybrid_parallel
advanced_use/mindspore_cpu_win_install advanced_use/mindspore_cpu_win_install
advanced_use/community advanced_use/community
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册