New features
Software improvements
- Refactor codebase to make cleaner distinction between ops/runtime/zero/etc.
- Conditional Op builds
- Not all users should have to spend time building transformer kernels if they don't want to use them.
- To ensure DeepSpeed is portable in multiple environments some features require unique dependencies that not everyone will be able to or want to install.
- DeepSpeed launcher supports different backends in additional to pdsh such as Open MPI and MVAPICH.