Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
magicwindyyd
mindspore
提交
0a2f4725
M
mindspore
项目概览
magicwindyyd
/
mindspore
与 Fork 源项目一致
Fork自
MindSpore / mindspore
通知
1
Star
1
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
M
mindspore
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
提交
0a2f4725
编写于
9月 08, 2020
作者:
Y
yoonlee666
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
add hub config for bert base and nezha
上级
21c5207c
变更
1
隐藏空白更改
内联
并排
Showing
1 changed file
with
77 addition
and
0 deletion
+77
-0
model_zoo/official/nlp/bert/mindspore_hub_conf.py
model_zoo/official/nlp/bert/mindspore_hub_conf.py
+77
-0
未找到文件。
model_zoo/official/nlp/bert/mindspore_hub_conf.py
0 → 100644
浏览文件 @
0a2f4725
# Copyright 2020 Huawei Technologies Co., Ltd
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
# ============================================================================
'''
Bert hub interface for bert base and bert nezha
'''
from
src.bert_model
import
BertModel
from
src.bert_model
import
BertConfig
import
mindspore.common.dtype
as
mstype
bert_net_cfg_base
=
BertConfig
(
batch_size
=
32
,
seq_length
=
128
,
vocab_size
=
21128
,
hidden_size
=
768
,
num_hidden_layers
=
12
,
num_attention_heads
=
12
,
intermediate_size
=
3072
,
hidden_act
=
"gelu"
,
hidden_dropout_prob
=
0.1
,
attention_probs_dropout_prob
=
0.1
,
max_position_embeddings
=
512
,
type_vocab_size
=
2
,
initializer_range
=
0.02
,
use_relative_positions
=
False
,
input_mask_from_dataset
=
True
,
token_type_ids_from_dataset
=
True
,
dtype
=
mstype
.
float32
,
compute_type
=
mstype
.
float16
)
bert_net_cfg_nezha
=
BertConfig
(
batch_size
=
32
,
seq_length
=
128
,
vocab_size
=
21128
,
hidden_size
=
1024
,
num_hidden_layers
=
24
,
num_attention_heads
=
16
,
intermediate_size
=
4096
,
hidden_act
=
"gelu"
,
hidden_dropout_prob
=
0.1
,
attention_probs_dropout_prob
=
0.1
,
max_position_embeddings
=
512
,
type_vocab_size
=
2
,
initializer_range
=
0.02
,
use_relative_positions
=
True
,
input_mask_from_dataset
=
True
,
token_type_ids_from_dataset
=
True
,
dtype
=
mstype
.
float32
,
compute_type
=
mstype
.
float16
)
def
create_network
(
name
,
*
args
,
**
kwargs
):
'''
Create bert network for base and nezha.
'''
if
name
==
'bert_base'
:
if
"batch_size"
in
kwargs
:
bert_net_cfg_base
.
batch_size
=
kwargs
[
"batch_size"
]
if
"seq_length"
in
kwargs
:
bert_net_cfg_base
.
seq_length
=
kwargs
[
"seq_length"
]
return
BertModel
(
bert_net_cfg_base
,
*
args
)
if
name
==
'bert_nezha'
:
if
"batch_size"
in
kwargs
:
bert_net_cfg_nezha
.
batch_size
=
kwargs
[
"batch_size"
]
if
"seq_length"
in
kwargs
:
bert_net_cfg_nezha
.
seq_length
=
kwargs
[
"seq_length"
]
return
BertModel
(
bert_net_cfg_nezha
,
*
args
)
raise
NotImplementedError
(
f
"
{
name
}
is not implemented in the repo"
)
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录