Created by: typhoonzero

…ce by 20% (#14661)

• wip multi process multi gpu dist training

• workable for p2p

• update test=develop

• change back env name test=develop

• fix alloc init

• fix cpu build test=devlop

• fix mac tests test=develop

• refine code

• refine test=develop