Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
Greenplum
Annotated Deep Learning Paper Implementations
提交
15d82d84
A
Annotated Deep Learning Paper Implementations
项目概览
Greenplum
/
Annotated Deep Learning Paper Implementations
11 个月 前同步成功
通知
6
Star
0
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
DevOps
流水线
流水线任务
计划
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
A
Annotated Deep Learning Paper Implementations
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
DevOps
DevOps
流水线
流水线任务
计划
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
流水线任务
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
提交
15d82d84
编写于
4月 28, 2021
作者:
V
Varuna Jayasiri
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
WS readme
上级
e62e449c
变更
2
隐藏空白更改
内联
并排
Showing
2 changed file
with
124 addition
and
0 deletion
+124
-0
docs/normalization/weight_standardization/readme.html
docs/normalization/weight_standardization/readme.html
+118
-0
labml_nn/normalization/weight_standardization/readme.md
labml_nn/normalization/weight_standardization/readme.md
+6
-0
未找到文件。
docs/normalization/weight_standardization/readme.html
0 → 100644
浏览文件 @
15d82d84
<!DOCTYPE html>
<html>
<head>
<meta
http-equiv=
"content-type"
content=
"text/html;charset=utf-8"
/>
<meta
name=
"viewport"
content=
"width=device-width, initial-scale=1.0"
/>
<meta
name=
"description"
content=
""
/>
<meta
name=
"twitter:card"
content=
"summary"
/>
<meta
name=
"twitter:image:src"
content=
"https://avatars1.githubusercontent.com/u/64068543?s=400&v=4"
/>
<meta
name=
"twitter:title"
content=
"Weight Standardization"
/>
<meta
name=
"twitter:description"
content=
""
/>
<meta
name=
"twitter:site"
content=
"@labmlai"
/>
<meta
name=
"twitter:creator"
content=
"@labmlai"
/>
<meta
property=
"og:url"
content=
"https://nn.labml.ai/normalization/weight_standardization/readme.html"
/>
<meta
property=
"og:title"
content=
"Weight Standardization"
/>
<meta
property=
"og:image"
content=
"https://avatars1.githubusercontent.com/u/64068543?s=400&v=4"
/>
<meta
property=
"og:site_name"
content=
"LabML Neural Networks"
/>
<meta
property=
"og:type"
content=
"object"
/>
<meta
property=
"og:title"
content=
"Weight Standardization"
/>
<meta
property=
"og:description"
content=
""
/>
<title>
Weight Standardization
</title>
<link
rel=
"shortcut icon"
href=
"/icon.png"
/>
<link
rel=
"stylesheet"
href=
"../../pylit.css"
>
<link
rel=
"canonical"
href=
"https://nn.labml.ai/normalization/weight_standardization/readme.html"
/>
<!-- Global site tag (gtag.js) - Google Analytics -->
<script
async
src=
"https://www.googletagmanager.com/gtag/js?id=G-4V3HC8HBLH"
></script>
<script>
window
.
dataLayer
=
window
.
dataLayer
||
[];
function
gtag
()
{
dataLayer
.
push
(
arguments
);
}
gtag
(
'
js
'
,
new
Date
());
gtag
(
'
config
'
,
'
G-4V3HC8HBLH
'
);
</script>
</head>
<body>
<div
id=
'container'
>
<div
id=
"background"
></div>
<div
class=
'section'
>
<div
class=
'docs'
>
<p>
<a
class=
"parent"
href=
"/"
>
home
</a>
<a
class=
"parent"
href=
"../index.html"
>
normalization
</a>
<a
class=
"parent"
href=
"index.html"
>
weight_standardization
</a>
</p>
<p>
<a
href=
"https://github.com/lab-ml/labml_nn/tree/master/labml_nn/normalization/weight_standardization/readme.md"
>
<img
alt=
"Github"
src=
"https://img.shields.io/github/stars/lab-ml/nn?style=social"
style=
"max-width:100%;"
/></a>
<a
href=
"https://join.slack.com/t/labforml/shared_invite/zt-egj9zvq9-Dl3hhZqobexgT7aVKnD14g/"
rel=
"nofollow"
>
<img
alt=
"Join Slact"
src=
"https://img.shields.io/badge/slack-chat-green.svg?logo=slack"
style=
"max-width:100%;"
/></a>
<a
href=
"https://twitter.com/labmlai"
rel=
"nofollow"
>
<img
alt=
"Twitter"
src=
"https://img.shields.io/twitter/follow/labmlai?style=social"
style=
"max-width:100%;"
/></a>
</p>
</div>
</div>
<div
class=
'section'
id=
'section-0'
>
<div
class=
'docs'
>
<div
class=
'section-link'
>
<a
href=
'#section-0'
>
#
</a>
</div>
<h1><a
href=
"https://nn.labml.ai/normalization/weight_standardization/index.html"
>
Weight Standardization
</a></h1>
<p>
This is a
<a
href=
"https://pytorch.org"
>
PyTorch
</a>
implementation of Weight Standardization from the paper
<a
href=
"https://arxiv.org/abs/1903.10520"
>
Micro-Batch Training with Batch-Channel Normalization and Weight Standardization
</a>
.
We also have an
<a
href=
"https://nn.labml.ai/normalization/batch_channel_normalization/index.html"
>
annotated implementation of Batch-Channel Normalization
</a>
.
</p>
</div>
<div
class=
'code'
>
</div>
</div>
</div>
</div>
<script
src=
"https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.4/MathJax.js?config=TeX-AMS_HTML"
>
</script>
<!-- MathJax configuration -->
<script
type=
"text/x-mathjax-config"
>
MathJax
.
Hub
.
Config
({
tex2jax
:
{
inlineMath
:
[
[
'
$
'
,
'
$
'
]
],
displayMath
:
[
[
'
$$
'
,
'
$$
'
]
],
processEscapes
:
true
,
processEnvironments
:
true
},
// Center justify equations in code and markdown cells. Elsewhere
// we use CSS to left justify single line equations in code cells.
displayAlign
:
'
center
'
,
"
HTML-CSS
"
:
{
fonts
:
[
"
TeX
"
]
}
});
</script>
</body>
</html>
\ No newline at end of file
labml_nn/normalization/weight_standardization/readme.md
0 → 100644
浏览文件 @
15d82d84
# [Weight Standardization](https://nn.labml.ai/normalization/weight_standardization/index.html)
This is a
[
PyTorch
](
https://pytorch.org
)
implementation of Weight Standardization from the paper
[
Micro-Batch Training with Batch-Channel Normalization and Weight Standardization
](
https://arxiv.org/abs/1903.10520
)
.
We also have an
[
annotated implementation of Batch-Channel Normalization
](
https://nn.labml.ai/normalization/batch_channel_normalization/index.html
)
.
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录