“56a0a02452bb17204cbd5e126200ea2e02fb0be5”上不存在“runtime/engine/asr/server/websocket/websocket_server.h”
Add document to describe the strategy of splitting parameter in distributed transpiler
Created by: velconia
Including three levels of details:
Why should we split parameters
- the benefits of splitting parameters
How we do split of parameters
- How to slice variables into blocks.
- How to split blocks into parameter servers.
A use case of training
- distributed training case with parameters split up