Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
PaddlePaddle
DeepSpeech
提交
48e87737
D
DeepSpeech
项目概览
PaddlePaddle
/
DeepSpeech
大约 2 年 前同步成功
通知
210
Star
8425
Fork
1598
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
245
列表
看板
标记
里程碑
合并请求
3
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
D
DeepSpeech
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
245
Issue
245
列表
看板
标记
里程碑
合并请求
3
合并请求
3
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
提交
48e87737
编写于
7月 22, 2021
作者:
J
Jackwaterveg
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
change autoLog
上级
205c5641
变更
3
隐藏空白更改
内联
并排
Showing
3 changed file
with
39 addition
and
29 deletion
+39
-29
deepspeech/exps/deepspeech2/model.py
deepspeech/exps/deepspeech2/model.py
+3
-25
deepspeech/utils/log.py
deepspeech/utils/log.py
+32
-0
examples/aishell/s0/run.sh
examples/aishell/s0/run.sh
+4
-4
未找到文件。
deepspeech/exps/deepspeech2/model.py
浏览文件 @
48e87737
...
@@ -35,10 +35,8 @@ from deepspeech.utils import error_rate
...
@@ -35,10 +35,8 @@ from deepspeech.utils import error_rate
from
deepspeech.utils
import
layer_tools
from
deepspeech.utils
import
layer_tools
from
deepspeech.utils
import
mp_tools
from
deepspeech.utils
import
mp_tools
from
deepspeech.utils.log
import
Log
from
deepspeech.utils.log
import
Log
from
deepspeech.utils.log
import
Autolog
import
auto_log
import
os
from
paddle
import
inference
logger
=
Log
(
__name__
).
getlog
()
logger
=
Log
(
__name__
).
getlog
()
...
@@ -228,28 +226,8 @@ class DeepSpeech2Tester(DeepSpeech2Trainer):
...
@@ -228,28 +226,8 @@ class DeepSpeech2Tester(DeepSpeech2Trainer):
def
__init__
(
self
,
config
,
args
):
def
__init__
(
self
,
config
,
args
):
super
().
__init__
(
config
,
args
)
super
().
__init__
(
config
,
args
)
pid
=
os
.
getpid
()
self
.
autolog
=
Autolog
(
batch_size
=
config
.
decoding
.
batch_size
,
model_name
=
"deepspeech2"
,
model_precision
=
"fp32"
).
getlog
()
gpu_id
=
int
(
os
.
environ
[
'CUDA_VISIBLE_DEVICES'
].
split
(
','
)[
0
])
infer_config
=
inference
.
Config
()
infer_config
.
enable_use_gpu
(
100
,
gpu_id
)
autolog
=
auto_log
.
AutoLogger
(
model_name
=
"deepspeech2"
,
model_precision
=
"fp32"
,
batch_size
=
config
.
decoding
.
batch_size
,
data_shape
=
"dynamic"
,
save_path
=
"./output/auto_log.lpg"
,
inference_config
=
infer_config
,
pids
=
pid
,
process_name
=
None
,
gpu_ids
=
gpu_id
,
time_keys
=
[
'preprocess_time'
,
'inference_time'
,
'postprocess_time'
],
warmup
=
0
)
self
.
autolog
=
autolog
logger
=
autolog
.
logger
logger
.
info
(
"gpu_id:{}"
.
format
(
gpu_id
))
def
ordid2token
(
self
,
texts
,
texts_len
):
def
ordid2token
(
self
,
texts
,
texts_len
):
""" ord() id to chr() chr """
""" ord() id to chr() chr """
trans
=
[]
trans
=
[]
...
...
deepspeech/utils/log.py
浏览文件 @
48e87737
...
@@ -17,6 +17,12 @@ import os
...
@@ -17,6 +17,12 @@ import os
import
socket
import
socket
import
sys
import
sys
import
auto_log
import
os
from
paddle
import
inference
FORMAT_STR
=
'[%(levelname)s %(asctime)s %(filename)s:%(lineno)d] %(message)s'
FORMAT_STR
=
'[%(levelname)s %(asctime)s %(filename)s:%(lineno)d] %(message)s'
DATE_FMT_STR
=
'%Y/%m/%d %H:%M:%S'
DATE_FMT_STR
=
'%Y/%m/%d %H:%M:%S'
...
@@ -146,3 +152,29 @@ class Log():
...
@@ -146,3 +152,29 @@ class Log():
def
getlog
(
self
):
def
getlog
(
self
):
return
self
.
logger
return
self
.
logger
class
Autolog
:
def
__init__
(
self
,
batch_size
,
model_name
=
"DeepSpeech"
,
model_precision
=
"fp32"
):
pid
=
os
.
getpid
()
gpu_id
=
int
(
os
.
environ
[
'CUDA_VISIBLE_DEVICES'
].
split
(
','
)[
0
])
infer_config
=
inference
.
Config
()
infer_config
.
enable_use_gpu
(
100
,
gpu_id
)
autolog
=
auto_log
.
AutoLogger
(
model_name
=
model_name
,
model_precision
=
model_precision
,
batch_size
=
batch_size
,
data_shape
=
"dynamic"
,
save_path
=
"./output/auto_log.lpg"
,
inference_config
=
infer_config
,
pids
=
pid
,
process_name
=
None
,
gpu_ids
=
gpu_id
,
time_keys
=
[
'preprocess_time'
,
'inference_time'
,
'postprocess_time'
],
warmup
=
0
)
self
.
autolog
=
autolog
def
getlog
(
self
):
return
self
.
autolog
examples/aishell/s0/run.sh
浏览文件 @
48e87737
...
@@ -2,9 +2,9 @@
...
@@ -2,9 +2,9 @@
set
-e
set
-e
source
path.sh
source
path.sh
gpus
=
2
gpus
=
0,1,2,3
stage
=
0
stage
=
0
stop_stage
=
4
stop_stage
=
100
conf_path
=
conf/deepspeech2.yaml
conf_path
=
conf/deepspeech2.yaml
avg_num
=
1
avg_num
=
1
...
@@ -31,10 +31,10 @@ fi
...
@@ -31,10 +31,10 @@ fi
if
[
${
stage
}
-le
3
]
&&
[
${
stop_stage
}
-ge
3
]
;
then
if
[
${
stage
}
-le
3
]
&&
[
${
stop_stage
}
-ge
3
]
;
then
# test ckpt avg_n
# test ckpt avg_n
CUDA_VISIBLE_DEVICES
=
${
gpus
}
./local/test.sh
${
conf_path
}
exp/
${
ckpt
}
/checkpoints/
${
avg_ckpt
}
||
exit
-1
CUDA_VISIBLE_DEVICES
=
0
./local/test.sh
${
conf_path
}
exp/
${
ckpt
}
/checkpoints/
${
avg_ckpt
}
||
exit
-1
fi
fi
if
[
${
stage
}
-le
4
]
&&
[
${
stop_stage
}
-ge
4
]
;
then
if
[
${
stage
}
-le
4
]
&&
[
${
stop_stage
}
-ge
4
]
;
then
# export ckpt avg_n
# export ckpt avg_n
CUDA_VISIBLE_DEVICES
=
${
gpus
}
./local/export.sh
${
conf_path
}
exp/
${
ckpt
}
/checkpoints/
${
avg_ckpt
}
exp/
${
ckpt
}
/checkpoints/
${
avg_ckpt
}
.jit
CUDA_VISIBLE_DEVICES
=
0
./local/export.sh
${
conf_path
}
exp/
${
ckpt
}
/checkpoints/
${
avg_ckpt
}
exp/
${
ckpt
}
/checkpoints/
${
avg_ckpt
}
.jit
fi
fi
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录