Created by: JiayiFeng

In our design of parallel executor, each device will have its own decorated readers. To make sure all decorated readers are distributed to devices correctly, decorated reader creation ops must be in the main_program as well as their output readers.