Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
PaddlePaddle
PaddleClas
提交
b77a4314
P
PaddleClas
项目概览
PaddlePaddle
/
PaddleClas
大约 1 年 前同步成功
通知
115
Star
4999
Fork
1114
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
19
列表
看板
标记
里程碑
合并请求
6
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
P
PaddleClas
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
19
Issue
19
列表
看板
标记
里程碑
合并请求
6
合并请求
6
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
提交
b77a4314
编写于
8月 04, 2022
作者:
R
root
提交者:
Tingquan Gao
8月 05, 2022
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
tipc: set num workers=12 iff fp16
上级
81b42f62
变更
1
隐藏空白更改
内联
并排
Showing
1 changed file
with
5 addition
and
2 deletion
+5
-2
test_tipc/benchmark_train.sh
test_tipc/benchmark_train.sh
+5
-2
未找到文件。
test_tipc/benchmark_train.sh
浏览文件 @
b77a4314
...
@@ -74,7 +74,6 @@ model_type=$4
...
@@ -74,7 +74,6 @@ model_type=$4
IFS
=
$'
\n
'
IFS
=
$'
\n
'
# parser params from train_benchmark.txt
# parser params from train_benchmark.txt
sed
-i
's/ -o DataLoader.Train.sampler.shuffle=False/ -o Global.print_batch_step=1/g'
$FILENAME
sed
-i
's/ -o DataLoader.Train.sampler.shuffle=False/ -o Global.print_batch_step=1/g'
$FILENAME
sed
-i
's/ -o DataLoader.Train.loader.num_workers=0/ -o DataLoader.Train.loader.num_workers=12/g'
$FILENAME
sed
-i
's/-o DataLoader.Train.loader.use_shared_memory=False/ -o Global.eval_during_train=False/g'
$FILENAME
sed
-i
's/-o DataLoader.Train.loader.use_shared_memory=False/ -o Global.eval_during_train=False/g'
$FILENAME
dataline
=
`
cat
$FILENAME
`
dataline
=
`
cat
$FILENAME
`
# parser params
# parser params
...
@@ -178,9 +177,13 @@ for batch_size in ${batch_size_list[*]}; do
...
@@ -178,9 +177,13 @@ for batch_size in ${batch_size_list[*]}; do
func_sed_params
"
$FILENAME
"
"
${
line_batchsize
}
"
"
$batch_size
"
func_sed_params
"
$FILENAME
"
"
${
line_batchsize
}
"
"
$batch_size
"
func_sed_params
"
$FILENAME
"
"
${
line_epoch
}
"
"
$epoch
"
func_sed_params
"
$FILENAME
"
"
${
line_epoch
}
"
"
$epoch
"
gpu_id
=
$(
set_gpu_id
$device_num
)
gpu_id
=
$(
set_gpu_id
$device_num
)
sed
-i
's/ -o DataLoader.Train.loader.num_workers=0//g'
$FILENAME
if
[[
${
precision
}
=
"fp16"
]]
;
then
sed
-i
's/ -o Global.print_batch_step=1/ -o Global.print_batch_step=1 -o DataLoader.Train.loader.num_workers=12/g'
$FILENAME
fi
# if bs is big, then copy train_list.txt to generate more train log
# if bs is big, then copy train_list.txt to generate more train log
# There are 5w image in train_list. And the train log printed interval is 10 iteration.
# At least 25 log number would be good to calculate ips for benchmark system.
# At least 25 log number would be good to calculate ips for benchmark system.
# So the copy number for train_list is as follows:
# So the copy number for train_list is as follows:
total_batch_size
=
`
echo
$[$batch_size
*${
device_num
:1:1
}*${
device_num
:3:3
}
]
`
total_batch_size
=
`
echo
$[$batch_size
*${
device_num
:1:1
}*${
device_num
:3:3
}
]
`
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录