---
title: "DeepSpeed ZeRO++: A leap in speed for LLM and chat model training with 4X less communication"
excerpt: ""
link: https://www.microsoft.com/en-us/research/blog/deepspeed-zero-a-leap-in-speed-for-llm-and-chat-model-training-with-4x-less-communication/
date: 2023-06-22 00:00:00
tags: training ZeRO RLHF English
---