Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
PaddlePaddle
PaddleOCR
提交
2c38604b
P
PaddleOCR
项目概览
PaddlePaddle
/
PaddleOCR
1 年多 前同步成功
通知
1535
Star
32963
Fork
6643
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
108
列表
看板
标记
里程碑
合并请求
7
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
P
PaddleOCR
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
108
Issue
108
列表
看板
标记
里程碑
合并请求
7
合并请求
7
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
提交
2c38604b
编写于
3年前
作者:
L
LDOUBLEV
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
delete debug part
上级
a7b81193
shiyutang-patch-1
docs_update
dygraph
fix_dead_link
fix_sar_bug
release/2.5
release/2.6
release/2.6.1
release/2.6rc
release/2.7
revert-10769-cherry-pick-for-open
revert-6577-dyg/rm_infer_fleet
revert-7381-dygraph
revert-7437-dygraph
revert-8552-dygraph
v2.6.0
v2.5.0
无相关合并请求
变更
1
隐藏空白更改
内联
并排
Showing
1 changed file
with
14 addition
and
33 deletion
+14
-33
test_tipc/benchmark_train.sh
test_tipc/benchmark_train.sh
+14
-33
未找到文件。
test_tipc/benchmark_train.sh
浏览文件 @
2c38604b
...
...
@@ -17,12 +17,7 @@ function func_sed_params(){
filename
=
$1
line
=
$2
param_value
=
$3
# cmd="sed -n '${line}p' $filename"
# params=`eval $cmd`
params
=
`
sed
-n
"
${
line
}
p"
$filename
`
# params=`cmd`
#params=$($cmd)
IFS
=
":"
array
=(
${
params
}
)
key
=
${
array
[0]
}
...
...
@@ -35,7 +30,6 @@ function func_sed_params(){
new_params
=
"
${
key
}
:
${
param_value
}
"
IFS
=
";"
cmd
=
"sed -i '
${
line
}
s/.*/
${
new_params
}
/' '
${
filename
}
'"
# echo $cmd
eval
$cmd
}
...
...
@@ -60,16 +54,16 @@ function get_repo_name(){
echo
${
arr
[-1]
}
}
#
FILENAME=$1
# # MODE be one of ['benchmark_train']
# MODE=$2
#
params=$3
FILENAME
=
$1
#
MODE be one of ['benchmark_train']
MODE
=
$2
params
=
$3
#
bash test_tipc/benchmark_train.sh test_tipc/configs/det_mv3_db_v2.0/train_benchmark.txt benchmark_train dynamic_bs8_null_SingleP_DP_N1C1
IFS
=
"
\n
"
FILENAME
=
"test_tipc/configs/det_mv3_db_v2.0/train_benchmark.txt"
MODE
=
"benchmark_train"
params
=
"dynamic_bs8_fp32_SingleP_DP_N1C4"
#
FILENAME="test_tipc/configs/det_mv3_db_v2.0/train_benchmark.txt"
#
MODE="benchmark_train"
#
params="dynamic_bs8_fp32_SingleP_DP_N1C4"
# parser params from input: modeltype_bs${bs_item}_${fp_item}_${run_process_type}_${run_mode}_${device_num}
IFS
=
"_"
...
...
@@ -98,8 +92,6 @@ model_name=$(func_parser_value "${lines[1]}")
# 获取benchmark_params所在的行数
line_num
=
`
grep
-n
"benchmark_params"
$FILENAME
|
cut
-d
":"
-f
1
`
echo
$line_num
# debug
echo
${
lines
[
$line_num
]
}
# debug
# for train log parser
line_num
=
`
expr
$line_num
+ 3
`
ips_unit_value
=
$(
func_parser_value
"
${
lines
[line_num]
}
"
)
...
...
@@ -107,8 +99,6 @@ ips_unit_value=$(func_parser_value "${lines[line_num]}")
line_num
=
`
expr
$line_num
+ 1
`
skip_steps_value
=
$(
func_parser_value
"
${
lines
[line_num]
}
"
)
echo
$skip_steps_value
"haha"
line_num
=
`
expr
$line_num
+ 1
`
keyword_value
=
$(
func_parser_value
"
${
lines
[line_num]
}
"
)
...
...
@@ -118,44 +108,35 @@ convergence_key_value=$(func_parser_value "${lines[line_num]}")
line_num
=
`
expr
$line_num
+ 1
`
flags_value
=
$(
func_parser_value
"
${
lines
[line_num]
}
"
)
# echo "device_num: $device_num"
# gpu_id=$(set_gpu_id "N4C32")
# echo "gpuid: $gpu_id"
gpu_id
=
$(
set_gpu_id
$device_num
)
echo
"gpu_id:
$gpu_id
"
repo_name
=
$(
get_repo_name
)
echo
"repo_name:
${
repo_name
}
"
# train_log_file=${run_log_path}/${model_repo}_${model_name}_${device_num}_log
# profiling_log_file=${profiling_log_path}/${model_repo}_${model_name}_${device_num}_profiling
SAVE_LOG
=
"benchmark_log"
if
[
${#
gpu_id
}
-le
1
]
;
then
echo
"single_gpu train"
log_path
=
"
$SAVE_LOG
/profiling_log"
mkdir
-p
$log_path
log_name
=
"
${
repo_name
}
_
${
model_name
}
_bs
${
batch_size
}
_
${
precision
}
_
${
run_process_type
}
_
${
run_mode
}
_
${
device_num
}
_profiling"
echo
$log_name
func_sed_params
"
$FILENAME
"
"4"
"0"
# sed used gpu_id
cmd
=
"bash test_tipc/test_train_inference_python.sh benchmark_train >
${
log_path
}
/
${
log_name
}
2>&1 "
cmd
=
"bash test_tipc/test_train_inference_python.sh
${
FILENAME
}
benchmark_train >
${
log_path
}
/
${
log_name
}
2>&1 "
echo
$cmd
eval
$cmd
# without profile
log_path
=
"
$SAVE_LOG
/train_log"
mkdir
-p
$log_path
log_name
=
"
${
repo_name
}
_
${
model_name
}
_bs
${
batch_size
}
_
${
precision
}
_
${
run_process_type
}
_
${
run_mode
}
_
${
device_num
}
_log"
func_sed_params
"
$FILENAME
"
"13"
"null"
# sed used gpu_id
cmd
=
"bash test_tipc/test_train_inference_python.sh benchmark_train >
${
log_path
}
/
${
log_name
}
2>&1 "
cmd
=
"bash test_tipc/test_train_inference_python.sh
${
FILENAME
}
benchmark_train >
${
log_path
}
/
${
log_name
}
2>&1 "
echo
$cmd
eval
$cmd
else
echo
"multi_gpu training"
log_path
=
"
$SAVE_LOG
/train_log"
mkdir
-p
$log_path
log_name
=
"
${
repo_name
}
_
${
model_name
}
_bs
${
batch_size
}
_
${
precision
}
_
${
run_process_type
}
_
${
run_mode
}
_
${
device_num
}
_log"
func_sed_params
"
$FILENAME
"
"4"
"
$gpu_id
"
# sed used gpu_id
func_sed_params
"
$FILENAME
"
"13"
"
$null
"
# sed --profile_option as null
cmd
=
"bash test_tipc/test_train_inference_python.sh benchmark_train >
${
log_path
}
/
${
log_name
}
2>&1 "
e
cho
$cmd
cmd
=
"bash test_tipc/test_train_inference_python.sh
${
FILENAME
}
benchmark_train >
${
log_path
}
/
${
log_name
}
2>&1 "
e
val
$cmd
fi
This diff is collapsed.
Click to expand it.
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录
反馈
建议
客服
返回
顶部