support sharding stage2 + mp hybrid_parallel. (#47535)
* support sharding stage2 + mp hybrid_parallel. * fix the group of check_nan_inf. * update hcg.
Showing
想要评论请 注册 或 登录
* support sharding stage2 + mp hybrid_parallel. * fix the group of check_nan_inf. * update hcg.