Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
PaddlePaddle
DeepSpeech
提交
83706040
D
DeepSpeech
项目概览
PaddlePaddle
/
DeepSpeech
大约 1 年 前同步成功
通知
206
Star
8425
Fork
1598
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
245
列表
看板
标记
里程碑
合并请求
3
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
D
DeepSpeech
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
245
Issue
245
列表
看板
标记
里程碑
合并请求
3
合并请求
3
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
未验证
提交
83706040
编写于
10月 26, 2021
作者:
H
Hui Zhang
提交者:
GitHub
10月 26, 2021
浏览文件
操作
浏览文件
下载
差异文件
Merge pull request #936 from PaddlePaddle/fix_lm
[asr] fix egs of transformer lm usage
上级
e4852e3b
c89820e7
变更
3
显示空白变更内容
内联
并排
Showing
3 changed file
with
24 addition
and
20 deletion
+24
-20
deepspeech/decoders/recog.py
deepspeech/decoders/recog.py
+10
-13
examples/librispeech/s2/local/recog.sh
examples/librispeech/s2/local/recog.sh
+12
-2
examples/librispeech/s2/run.sh
examples/librispeech/s2/run.sh
+2
-5
未找到文件。
deepspeech/decoders/recog.py
浏览文件 @
83706040
...
...
@@ -24,6 +24,7 @@ from .utils import add_results_to_json
from
deepspeech.exps
import
dynamic_import_tester
from
deepspeech.io.reader
import
LoadInputsAndTargets
from
deepspeech.models.asr_interface
import
ASRInterface
from
deepspeech.models.lm_interface
import
dynamic_import_lm
from
deepspeech.utils.log
import
Log
logger
=
Log
(
__name__
).
getlog
()
...
...
@@ -31,11 +32,15 @@ logger = Log(__name__).getlog()
# NOTE: you need this func to generate our sphinx doc
def
get_config
(
config_path
):
confs
=
CfgNode
(
new_allowed
=
True
)
confs
.
merge_from_file
(
config_path
)
return
confs
def
load_trained_model
(
args
):
args
.
nprocs
=
args
.
ngpu
confs
=
CfgNode
()
confs
.
set_new_allowed
(
True
)
confs
.
merge_from_file
(
args
.
model_conf
)
confs
=
get_config
(
args
.
model_conf
)
class_obj
=
dynamic_import_tester
(
args
.
model_name
)
exp
=
class_obj
(
confs
,
args
)
with
exp
.
eval
():
...
...
@@ -46,19 +51,11 @@ def load_trained_model(args):
return
model
,
char_list
,
exp
,
confs
def
get_config
(
config_path
):
stream
=
open
(
config_path
,
mode
=
'r'
,
encoding
=
"utf-8"
)
config
=
yaml
.
load
(
stream
,
Loader
=
yaml
.
FullLoader
)
stream
.
close
()
return
config
def
load_trained_lm
(
args
):
lm_args
=
get_config
(
args
.
rnnlm_conf
)
# NOTE: for a compatibility with less than 0.5.0 version models
lm_model_module
=
getattr
(
lm_args
,
"model_module"
,
"default"
)
lm_model_module
=
lm_args
.
model_module
lm_class
=
dynamic_import_lm
(
lm_model_module
)
lm
=
lm_class
(
lm_args
.
model
)
lm
=
lm_class
(
**
lm_args
.
model
)
model_dict
=
paddle
.
load
(
args
.
rnnlm
)
lm
.
set_state_dict
(
model_dict
)
return
lm
...
...
examples/librispeech/s2/local/recog.sh
浏览文件 @
83706040
...
...
@@ -11,9 +11,9 @@ tag=
decode_config
=
conf/decode/decode.yaml
# lm params
lang_model
=
transformerLM.pdparams
lmexpdir
=
exp/lm/transformer
rnnlm_config_path
=
conf/lm/transformer.yaml
lmexpdir
=
exp/lm
lang_model
=
rnnlm.pdparams
lmtag
=
'transformer'
train_set
=
train_960
...
...
@@ -53,6 +53,9 @@ if [[ ${config_path} =~ ^.*chunk_.*yaml$ ]];then
fi
echo
"chunk mode:
${
chunk_mode
}
"
echo
"decode conf:
${
decode_config
}
"
echo
"lm conf:
${
rnnlm_config_path
}
"
echo
"lm model:
${
lmexpdir
}
/
${
lang_model
}
"
# download language model
#bash local/download_lm_en.sh
...
...
@@ -61,6 +64,13 @@ echo "decode conf: ${decode_config}"
#fi
# download rnnlm
mkdir
-p
${
lmexpdir
}
if
[
!
-f
${
lmexpdir
}
/
${
lang_model
}
]
;
then
wget
-c
-O
${
lmexpdir
}
/
${
lang_model
}
https://deepspeech.bj.bcebos.com/transformer_lm/transformerLM.pdparams
fi
pids
=()
# initialize pids
for
dmethd
in
join_ctc
;
do
...
...
examples/librispeech/s2/run.sh
浏览文件 @
83706040
...
...
@@ -37,12 +37,9 @@ if [ ${stage} -le 3 ] && [ ${stop_stage} -ge 3 ]; then
./local/test.sh
${
conf_path
}
${
dict_path
}
exp/
${
ckpt
}
/checkpoints/
${
avg_ckpt
}
||
exit
-1
fi
if
[
${
stage
}
-le
4
]
&&
[
${
stop_stage
}
-ge
4
]
&&
${
use_lm
}
==
true
;
then
if
[
${
stage
}
-le
4
]
&&
[
${
stop_stage
}
-ge
4
]
;
then
# join ctc decoder, use transformerlm to score
if
[
!
-f
exp/lm/transformer/transformerLM.pdparams
]
;
then
wget https://deepspeech.bj.bcebos.com/transformer_lm/transformerLM.pdparams exp/lm/transformer/
fi
bash
local
/recog.sh
--ckpt_prefix
exp/
${
ckpt
}
/checkpoints/
${
avg_ckpt
}
./local/recog.sh
--ckpt_prefix
exp/
${
ckpt
}
/checkpoints/
${
avg_ckpt
}
fi
if
[
${
stage
}
-le
5
]
&&
[
${
stop_stage
}
-ge
5
]
;
then
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录