未验证 提交 7837e10d 编写于 作者: G guru4elephant 提交者: GitHub

Update async_executor.md

上级 cba90c59
...@@ -42,18 +42,24 @@ for i, (slots, label) in enumerate(train_loader): ...@@ -42,18 +42,24 @@ for i, (slots, label) in enumerate(train_loader):
``` ```
## Difference between async_executor and other executors
async_executor is mainly designed for cpu training scenarios where data throughputs are high and the computation part of training is not intensive compared with GPU trained models such as resnet-50. Since data throughputs ability is very important in async_executor, we have to design very fast data IO modules to handle very large scale data reading. Another different key aspect is that memory is not a problem in cpu training scenarios given 128G or 256G RAW in modern server.
executor and parallel_executor are designed for geneneral training cases in particular for gpu training. Executor is a single thread implementation for model training and it is mostly used for startup_program running currently. Another application scenario of executor is reinforcement learning where input data and main_program may change through training. Parallel_executor is mainly designed for synchronous training on high performance devices such as gpu. Operators are executed concurrently following topological orders on different graphs and model parameter gradients are synchrounized iteratively.
## Data Feeding Approach ## Data Feeding Approach
TBA to be discussed.
## Inside Structure of Async Executor ## Inside Structure of Async Executor
TBA will be added.
## How to print variable information during execution ## How to print variable information during execution
TBA Inside async_executor, no information is printed. Variable can be fetched through an execution of async_executor. The fetched variables can be printed through python.
## How to save models ## How to save models
TBA Models can be saved between execution of async_executor through io.save method.
## references ## references
1. [Sentiment Analysis](https://arxiv.org/pdf/1801.07883.pdf) 1. [Sentiment Analysis](https://arxiv.org/pdf/1801.07883.pdf)
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册