MPI 3.x support via mpi4py (#107)
* add mpirun support for openmpi 4.0 * add master addr support from args * switch mpi detection to use mpi4py * set constant for default distributed port * Make sure deepspeed_mpi exits in args
Showing
deepspeed/pt/deepspeed_launch.py
100644 → 100755
deepspeed/pt/deepspeed_light.py
100644 → 100755
想要评论请 注册 或 登录