Created by: tonyyang-svail

As part of the design https://github.com/PaddlePaddle/Paddle/pull/7814, this PR would allow us to create multiple device contexts on one GPU.