提交 ac199cfa 编写于 作者: T Ting Wang

update image

Signed-off-by: NTing Wang <kathy.wangting@huawei.com>
上级 dc0a5a2d
# Saving and Loading Model Parameters in the Hybrid Parallel Scenario # Saving and Loading Model Parameters in the Hybrid Parallel Scenario
<!-- TOC --> <!-- TOC -->
- [Saving and Loading Model Parameters in the Hybrid Parallel Scenario](#saving-and-loading-model-parameters-in-the-hybrid-parallel-scenario) - [Saving and Loading Model Parameters in the Hybrid Parallel Scenario](#saving-and-loading-model-parameters-in-the-hybrid-parallel-scenario)
- [Overview](#overview) - [Overview](#overview)
- [Background](#background) - [Background](#background)
- [Application Scenario](#application-scenario) - [Application Scenario](#application-scenario)
- [Integrating the Saved Checkpoint Files](#integrating-the-saved-checkpoint-files) - [Integrating the Saved Checkpoint Files](#integrating-the-saved-checkpoint-files)
- [Overall Process](#overall-process) - [Overall Process](#overall-process)
- [Preparations](#preparations) - [Preparations](#preparations)
- [Importing the Checkpoint Files to the Network](#importing-the-checkpoint-files-to-the-network) - [Importing the Checkpoint Files to the Network](#importing-the-checkpoint-files-to-the-network)
- [Obtaining a List of All Parameters on the Network](#obtaining-a-list-of-all-parameters-on-the-network) - [Obtaining a List of All Parameters on the Network](#obtaining-a-list-of-all-parameters-on-the-network)
- [Integrate the Model Parallel Parameters](#integrate-the-model-parallel-parameters) - [Integrate the Model Parallel Parameters](#integrate-the-model-parallel-parameters)
- [Saving the Data and Generating a New Checkpoint File](#saving-the-data-and-generating-a-new-checkpoint-file) - [Saving the Data and Generating a New Checkpoint File](#saving-the-data-and-generating-a-new-checkpoint-file)
- [Loading the Integrated and Saved Checkpoint File](#loading-the-integrated-and-saved-checkpoint-file) - [Loading the Integrated and Saved Checkpoint File](#loading-the-integrated-and-saved-checkpoint-file)
- [Overall Process](#overall-process-1) - [Overall Process](#overall-process-1)
- [Step 1: Loading the Checkpoint File](#step-1-loading-the-checkpoint-file) - [Step 1: Loading the Checkpoint File](#step-1-loading-the-checkpoint-file)
- [Step 2: Dividing a Model Parallel Parameter](#step-2-dividing-a-model-parallel-parameter) - [Step 2: Dividing a Model Parallel Parameter](#step-2-dividing-a-model-parallel-parameter)
- [Step 3: Loading the Modified Parameter Data to the Network](#step-3-loading-the-modified-parameter-data-to-the-network) - [Step 3: Loading the Modified Parameter Data to the Network](#step-3-loading-the-modified-parameter-data-to-the-network)
- [Example](#example) - [Example](#example)
- [Scenario Description](#scenario-description) - [Scenario Description](#scenario-description)
- [Example Code](#example-code) - [Example Code](#example-code)
<!-- /TOC --> <!-- /TOC -->
## Overview ## Overview
...@@ -76,7 +77,7 @@ Then, update the parameter list and integrate the model parallel parameters. See ...@@ -76,7 +77,7 @@ Then, update the parameter list and integrate the model parallel parameters. See
Finally, save the updated parameter list to a file through the API provided by MindSpore to generate a new checkpoint file. See step 4 in the following figure. Finally, save the updated parameter list to a file through the API provided by MindSpore to generate a new checkpoint file. See step 4 in the following figure.
![img](./images/checkpoint_integration_process.png) ![img](./images/checkpoint_integration_process.jpg)
### Preparations ### Preparations
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册