Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
Crayon鑫
Paddle
提交
693b1aa1
P
Paddle
项目概览
Crayon鑫
/
Paddle
与 Fork 源项目一致
Fork自
PaddlePaddle / Paddle
通知
1
Star
1
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
1
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
P
Paddle
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
1
Issue
1
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
未验证
提交
693b1aa1
编写于
10月 14, 2021
作者:
S
Sing_chan
提交者:
GitHub
10月 14, 2021
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
reduce some unittest's parallel number to avoding timeout failure (#36397)
上级
cb5bf583
变更
2
隐藏空白更改
内联
并排
Showing
2 changed file
with
13 addition
and
17 deletion
+13
-17
paddle/scripts/paddle_build.bat
paddle/scripts/paddle_build.bat
+8
-8
tools/parallel_UT_rule.py
tools/parallel_UT_rule.py
+5
-9
未找到文件。
paddle/scripts/paddle_build.bat
浏览文件 @
693b1aa1
...
...
@@ -381,7 +381,7 @@ if not exist %THIRD_PARTY_PATH% (
echo
There
is
no
usable
third_party
cache
in
%THIRD_PARTY_PATH%
,
will
download
from
bos
.
pip
install
wget
if
not
exist
%THIRD_PARTY_HOME%
mkdir
"
%THIRD_PARTY_HOME%
"
cd
%THIRD_PARTY_HOME%
cd
/d
%THIRD_PARTY_HOME%
echo
Getting
third
party
:
downloading
...
%PYTHON_ROOT%
\python.exe
-c
"import wget;wget.download('https://paddle-windows.bj.bcebos.com/third_party/
%sub_dir%
/
%md5
%
.tar.gz')"
2
>
nul
if
!ERRORLEVEL!
EQU
0
(
...
...
@@ -397,7 +397,7 @@ if not exist %THIRD_PARTY_PATH% (
echo
Get
third
party
failed
,
reason
:
download
failed
,
will
build
locally
.
)
if
not
exist
%THIRD_PARTY_PATH%
set
UPLOAD_TP_FILE
=
ON
cd
%work_dir%
\
%BUILD_DIR%
cd
/d
%work_dir%
\
%BUILD_DIR%
)
else
(
echo
Found
reusable
third_party
cache
in
%THIRD_PARTY_PATH%
,
will
reuse
it
.
)
...
...
@@ -519,16 +519,16 @@ if "%UPLOAD_TP_FILE%"=="ON" (
echo
Uploading
third_party
:
checking
bce
...
if
not
exist
%cache_dir%
\bce
-python-sdk
-
0
.8.33
(
echo
There
is
no
bce
in
this
PC
,
will
install
bce
.
cd
%cache_dir%
cd
/d
%cache_dir%
echo
Download
package
from
https
://paddle
-windows
.bj.bcebos.com/bce
-python-sdk
-
0
.8.33.tar.gz
%PYTHON_ROOT%
\python.exe
-c
"import wget;wget.download('https://paddle-windows.bj.bcebos.com/bce-python-sdk-0.8.33.tar.gz')"
%PYTHON_ROOT%
\python.exe
-c
"import shutil;shutil.unpack_archive('bce-python-sdk-0.8.33.tar.gz', extract_dir='./',format='gztar')"
cd
%cache_dir%
\bce
-python-sdk
-
0
.8.33
cd
/d
%cache_dir%
\bce
-python-sdk
-
0
.8.33
%PYTHON_ROOT%
\python.exe
setup
.py
install
1
>
nul
del
%cache_dir%
\bce
-python-sdk
-
0
.8.33.tar.gz
)
if
!errorlevel!
EQU
0
(
cd
%THIRD_PARTY_HOME%
cd
/d
%THIRD_PARTY_HOME%
echo
Uploading
third_party
:
compressing
...
tar
-zcf
%md5
%
.tar.gz
%md5
%
if
!errorlevel!
EQU
0
(
...
...
@@ -546,7 +546,7 @@ if "%UPLOAD_TP_FILE%"=="ON" (
)
else
(
echo
Failed
upload
third
party
to
bos
,
reason
:
install
bce
failed
.
)
cd
%work_dir%
\
%BUILD_DIR%
cd
/d
%work_dir%
\
%BUILD_DIR%
)
echo
Build
Paddle
successfully
!
...
...
@@ -711,7 +711,7 @@ for /F %%i in ("%libsize%") do (
echo
ipipe_log_param_Windows_Paddle_Inference_Size
:
!libsize_m!
M
)
cd
%work_dir%
\paddle\fluid\inference\api\demo_ci
cd
/d
%work_dir%
\paddle\fluid\inference\api\demo_ci
%cache_dir%
\tools\busybox64.exe
bash
run
.sh
%work
_dir:\
=
/
%
%WITH_MKL%
%WITH_GPU%
%cache
_dir:\
=
/
%
/inference
_demo
%TENSORRT_ROOT%
/include
%TENSORRT_ROOT%
/lib
%MSVC_STATIC_CRT%
goto
:eof
...
...
@@ -811,7 +811,7 @@ echo ========================================
echo
Step
7
.
Testing
fluid
library
with
infer_ut
for
inference
...
echo
========================================
cd
%work_dir%
\paddle\fluid\inference\tests\infer_ut
cd
/d
%work_dir%
\paddle\fluid\inference\tests\infer_ut
%cache_dir%
\tools\busybox64.exe
bash
run
.sh
%work
_dir:\
=
/
%
%WITH_MKL%
%WITH_GPU%
%cache
_dir:\
=
/
%
/inference
_demo
%TENSORRT_ROOT%
%MSVC_STATIC_CRT%
goto
:eof
...
...
tools/parallel_UT_rule.py
浏览文件 @
693b1aa1
...
...
@@ -676,12 +676,10 @@ CPU_PARALLEL_JOB = [
'test_static_save_load_large'
,
'version_test'
,
'var_type_traits_test'
,
'var_type_inference_test'
,
'variable_test'
,
'unroll_array_ops_test'
,
'tuple_test'
,
'to_string_test'
,
'timer_test'
,
'threadpool_test'
,
'test_zeros_op'
,
'test_while_op'
,
...
...
@@ -1015,7 +1013,6 @@ CPU_PARALLEL_JOB = [
'program_desc_test'
,
'profiler_test'
,
'place_test'
,
'pass_test'
,
'op_version_registry_test'
,
'op_tester'
,
'op_proto_maker_test'
,
...
...
@@ -1179,7 +1176,6 @@ CPU_PARALLEL_JOB = [
'test_fleet_sharding_meta_optimizer'
,
'test_listen_and_serv_op'
,
'test_analyzer_zerocopytensor_tensor'
,
'test_conv_bn_fuse_pass_cc'
,
'test_collective_optimizer'
,
'test_bf16_utils'
,
'test_analyzer_seq_pool1_compare_determine'
,
...
...
@@ -1236,6 +1232,9 @@ CPU_PARALLEL_JOB = [
# It run 4 job each time, If it failed due to Insufficient GPU memory or CUBLAS_STATUS_ALLOC_FAILED,
# just remove it from this list.
TETRAD_PARALLEL_JOB
=
[
'timer_test'
,
'var_type_inference_test'
,
'pass_test'
,
'graph_node_test'
,
'test_assert'
,
'test_nce'
,
...
...
@@ -1254,7 +1253,6 @@ TETRAD_PARALLEL_JOB = [
'test_imperative_using_non_zero_gpu'
,
'retry_allocator_test'
,
'system_allocator_test'
,
'test_fc_fuse_pass_cc'
,
'test_fc_lstm_fuse_pass_cc'
,
'test_fc_gru_fuse_pass_cc'
,
'test_conv_bn_fuse_pass_cc'
,
...
...
@@ -1281,14 +1279,11 @@ TETRAD_PARALLEL_JOB = [
'test_analyzer_bert'
,
'test_analyzer_googlenet'
,
'test_fleet_base'
,
'test_sequential'
,
'test_sequential'
,
'test_imperative_layers'
,
'test_dgc_momentum_op'
,
'test_memcpy_op'
,
'test_dgc_op'
,
'test_lookahead'
,
'test_callback_visualdl'
,
'test_new_group_api'
,
'test_collective_split_embedding_none_divisible'
,
'test_collective_wait'
,
...
...
@@ -1304,6 +1299,8 @@ TETRAD_PARALLEL_JOB = [
# It run 2 job each time, If it failed due to Insufficient GPU memory or CUBLAS_STATUS_ALLOC_FAILED,
# just remove it from this list.
TWO_PARALLEL_JOB
=
[
'test_callback_visualdl'
,
'test_sequential'
,
'test_lambv2_op'
,
'test_math_op_patch'
,
'test_tensor_to_numpy'
,
...
...
@@ -1398,7 +1395,6 @@ TWO_PARALLEL_JOB = [
'test_kron_op'
,
'test_isfinite_v2_op'
,
'test_ctc_align'
,
'test_imperative_save_load_v2'
,
'test_decayed_adagrad_op'
,
'test_dropout_op'
,
'test_functional_conv3d'
,
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录