diff --git a/docs/source_zh_cn/design/mindspore/distributed_training_design.md b/docs/source_zh_cn/design/mindspore/distributed_training_design.md index b8e65d144f3cf86e1e0f568a8333b157d90f6a9d..ab026a6526ac6fc4d4d113e102e24e0fa945eb68 100644 --- a/docs/source_zh_cn/design/mindspore/distributed_training_design.md +++ b/docs/source_zh_cn/design/mindspore/distributed_training_design.md @@ -81,7 +81,7 @@ ### è‡ªåŠ¨å¹¶è¡ŒåŽŸç† -![自动并行图解](./images/auto_parallel.png) +![自动并行图解](./images/auto_parallel_design.png) 1. é€šç”¨çš„å¼ é‡æŽ’布模型 @@ -98,7 +98,7 @@ 2. 高效的并行ç–ç•¥æœç´¢ç®—法 - 当用户熟悉了算å的切分表达,并手动对算åé…置切分ç–略,这就是`SEMI_AUTO_PARALLEL`åŠè‡ªåŠ¨å¹¶è¡Œæ¨¡å¼ã€‚è¿™ç§æ–¹å¼å¯¹æ‰‹åŠ¨è°ƒä¼˜æœ‰å¸®åŠ©ï¼Œä½†è¿˜æ˜¯å…·æœ‰ä¸€å®šçš„调试难度,用户需è¦æŽŒæ¡å¹¶è¡ŒåŽŸç†ï¼Œå¹¶æ ¹æ®ç½‘络结构ã€é›†ç¾¤æ‹“扑ç‰è®¡ç®—分æžå¾—到高性能的并行方案。为了进一æ¥å¸®åŠ©ç”¨æˆ·åŠ 速并行网络è®ç»ƒè¿‡ç¨‹ï¼Œåœ¨åŠè‡ªåŠ¨å¹¶è¡Œæ¨¡å¼çš„基础上,`AUTO_PARALLEL`自动并行模å¼å¼•å…¥äº†å¹¶è¡Œåˆ‡åˆ†ç–略自动æœç´¢çš„特性。自动并行围绕硬件平å°æž„建相应的代价函数模型(Cost Model),计算出一定数æ®é‡ã€ä¸€å®šç®—å在ä¸åŒåˆ‡åˆ†ç–略下的计算开销(Computation Cost),内å˜å¼€é”€ï¼ˆMemory Cost)åŠé€šä¿¡å¼€é”€ï¼ˆCommunication Cost)。然åŽé€šè¿‡åŠ¨æ€è§„划算法(Dynamic Programming),以å•å¡çš„内å˜ä¸Šé™ä¸ºçº¦æŸæ¡ä»¶ï¼Œé«˜æ•ˆåœ°æœç´¢å‡ºæ€§èƒ½è¾ƒä¼˜çš„切分ç–略。 + 当用户熟悉了算å的切分表达,并手动对算åé…置切分ç–略,这就是`SEMI_AUTO_PARALLEL`åŠè‡ªåŠ¨å¹¶è¡Œæ¨¡å¼ã€‚è¿™ç§æ–¹å¼å¯¹æ‰‹åŠ¨è°ƒä¼˜æœ‰å¸®åŠ©ï¼Œä½†è¿˜æ˜¯å…·æœ‰ä¸€å®šçš„调试难度,用户需è¦æŽŒæ¡å¹¶è¡ŒåŽŸç†ï¼Œå¹¶æ ¹æ®ç½‘络结构ã€é›†ç¾¤æ‹“扑ç‰è®¡ç®—分æžå¾—到高性能的并行方案。为了进一æ¥å¸®åŠ©ç”¨æˆ·åŠ 速并行网络è®ç»ƒè¿‡ç¨‹ï¼Œåœ¨åŠè‡ªåŠ¨å¹¶è¡Œæ¨¡å¼çš„基础上,`AUTO_PARALLEL`自动并行模å¼å¼•å…¥äº†å¹¶è¡Œåˆ‡åˆ†ç–略自动æœç´¢çš„特性。自动并行围绕硬件平å°æž„建相应的代价函数模型(Cost Model),计算出一定数æ®é‡ã€ä¸€å®šç®—å在ä¸åŒåˆ‡åˆ†ç–略下的计算开销(Computation Cost),内å˜å¼€é”€ï¼ˆMemory Cost)åŠé€šä¿¡å¼€é”€ï¼ˆCommunication Cost)。然åŽé€šè¿‡åŠ¨æ€è§„划算法(Dynamic Programming)或者递归规划算法(Recursive Programming),以å•å¡çš„内å˜ä¸Šé™ä¸ºçº¦æŸæ¡ä»¶ï¼Œé«˜æ•ˆåœ°æœç´¢å‡ºæ€§èƒ½è¾ƒä¼˜çš„切分ç–略。 ç–ç•¥æœç´¢è¿™ä¸€æ¥éª¤ä»£æ›¿äº†ç”¨æˆ·æ‰‹åŠ¨æŒ‡å®šæ¨¡åž‹åˆ‡åˆ†ï¼Œåœ¨çŸæ—¶é—´å†…å¯ä»¥å¾—到较高性能的切分方案,æžå¤§é™ä½Žäº†å¹¶è¡Œè®ç»ƒçš„使用门槛。 diff --git a/docs/source_zh_cn/design/mindspore/images/auto_parallel.png b/docs/source_zh_cn/design/mindspore/images/auto_parallel.png deleted file mode 100644 index 7dbd35d28b7f1a719961c0741d2d9a203b509242..0000000000000000000000000000000000000000 Binary files a/docs/source_zh_cn/design/mindspore/images/auto_parallel.png and /dev/null differ diff --git a/docs/source_zh_cn/design/mindspore/images/auto_parallel_design.png b/docs/source_zh_cn/design/mindspore/images/auto_parallel_design.png new file mode 100644 index 0000000000000000000000000000000000000000..7f1006775ed0006208ae1086b8cd062b463237d6 Binary files /dev/null and b/docs/source_zh_cn/design/mindspore/images/auto_parallel_design.png differ