提交 779ed45d 编写于 作者: M Megvii Engine Team

docs(mge/parampack): refine parampack doc

GitOrigin-RevId: 1cff83c3081c3d2dc1bbe2ed667367b66fa30385
上级 8e879404
......@@ -17,7 +17,10 @@ from .module import Module
class ParamPack(Module):
r"""Pack module's parameters
r"""Pack module's parameters by gathering their memory to continuous address.
Using (device, dtype, requires_grad) as key, for example ('gpu0', float32, True),
parameters with same key will be packed togather.
It helps a lot for multimachine training by speeding up allreduce gradients.
:param model: the module you want to pack parameters.
:param nr_ignore_first: how many parameters will be unpacked at first.
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册