Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
Crayon鑫
Paddle
提交
632ea575
P
Paddle
项目概览
Crayon鑫
/
Paddle
与 Fork 源项目一致
Fork自
PaddlePaddle / Paddle
通知
1
Star
1
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
1
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
P
Paddle
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
1
Issue
1
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
未验证
提交
632ea575
编写于
10月 12, 2022
作者:
N
Nyakku Shigure
提交者:
GitHub
10月 12, 2022
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
[CodeStyle][F401] remove unused imports in unittests/auto_parallel,distribution (#46915)
上级
0784f961
变更
69
隐藏空白更改
内联
并排
Showing
69 changed file
with
16 addition
and
197 deletion
+16
-197
python/paddle/fluid/tests/unittests/auto_parallel/amp_pass_unittest.py
.../fluid/tests/unittests/auto_parallel/amp_pass_unittest.py
+1
-2
python/paddle/fluid/tests/unittests/auto_parallel/auto_parallel_relaunch_model.py
...s/unittests/auto_parallel/auto_parallel_relaunch_model.py
+0
-9
python/paddle/fluid/tests/unittests/auto_parallel/auto_parallel_relaunch_with_gpt_planner.py
.../auto_parallel/auto_parallel_relaunch_with_gpt_planner.py
+0
-4
python/paddle/fluid/tests/unittests/auto_parallel/clip_grad_by_global_norm.py
...tests/unittests/auto_parallel/clip_grad_by_global_norm.py
+1
-2
python/paddle/fluid/tests/unittests/auto_parallel/converter.py
...n/paddle/fluid/tests/unittests/auto_parallel/converter.py
+0
-1
python/paddle/fluid/tests/unittests/auto_parallel/engine_api.py
.../paddle/fluid/tests/unittests/auto_parallel/engine_api.py
+1
-12
python/paddle/fluid/tests/unittests/auto_parallel/engine_api_dp.py
...ddle/fluid/tests/unittests/auto_parallel/engine_api_dp.py
+1
-9
python/paddle/fluid/tests/unittests/auto_parallel/gradient_merge_pass_unittest.py
...s/unittests/auto_parallel/gradient_merge_pass_unittest.py
+1
-2
python/paddle/fluid/tests/unittests/auto_parallel/high_order_grad.py
...le/fluid/tests/unittests/auto_parallel/high_order_grad.py
+0
-2
python/paddle/fluid/tests/unittests/auto_parallel/iterable_dataset.py
...e/fluid/tests/unittests/auto_parallel/iterable_dataset.py
+0
-12
python/paddle/fluid/tests/unittests/auto_parallel/optimization_tuner_api.py
...d/tests/unittests/auto_parallel/optimization_tuner_api.py
+0
-12
python/paddle/fluid/tests/unittests/auto_parallel/recompute_pass_unittest.py
.../tests/unittests/auto_parallel/recompute_pass_unittest.py
+1
-2
python/paddle/fluid/tests/unittests/auto_parallel/sharding_pass_unittest.py
...d/tests/unittests/auto_parallel/sharding_pass_unittest.py
+1
-2
python/paddle/fluid/tests/unittests/auto_parallel/test_auto_parallel_relaunch.py
...ts/unittests/auto_parallel/test_auto_parallel_relaunch.py
+0
-2
python/paddle/fluid/tests/unittests/auto_parallel/test_base_cost.py
...dle/fluid/tests/unittests/auto_parallel/test_base_cost.py
+0
-4
python/paddle/fluid/tests/unittests/auto_parallel/test_cluster.py
...addle/fluid/tests/unittests/auto_parallel/test_cluster.py
+0
-1
python/paddle/fluid/tests/unittests/auto_parallel/test_comp_cost.py
...dle/fluid/tests/unittests/auto_parallel/test_comp_cost.py
+0
-2
python/paddle/fluid/tests/unittests/auto_parallel/test_converter.py
...dle/fluid/tests/unittests/auto_parallel/test_converter.py
+0
-2
python/paddle/fluid/tests/unittests/auto_parallel/test_dist_attr_v2.py
.../fluid/tests/unittests/auto_parallel/test_dist_attr_v2.py
+0
-2
python/paddle/fluid/tests/unittests/auto_parallel/test_dist_context.py
.../fluid/tests/unittests/auto_parallel/test_dist_context.py
+0
-4
python/paddle/fluid/tests/unittests/auto_parallel/test_dist_embedding.py
...luid/tests/unittests/auto_parallel/test_dist_embedding.py
+0
-3
python/paddle/fluid/tests/unittests/auto_parallel/test_dist_matmul.py
...e/fluid/tests/unittests/auto_parallel/test_dist_matmul.py
+0
-1
python/paddle/fluid/tests/unittests/auto_parallel/test_dist_op_cost.py
.../fluid/tests/unittests/auto_parallel/test_dist_op_cost.py
+0
-1
python/paddle/fluid/tests/unittests/auto_parallel/test_dist_pnorm.py
...le/fluid/tests/unittests/auto_parallel/test_dist_pnorm.py
+0
-1
python/paddle/fluid/tests/unittests/auto_parallel/test_dist_reshape.py
.../fluid/tests/unittests/auto_parallel/test_dist_reshape.py
+0
-4
python/paddle/fluid/tests/unittests/auto_parallel/test_dist_slice.py
...le/fluid/tests/unittests/auto_parallel/test_dist_slice.py
+0
-1
python/paddle/fluid/tests/unittests/auto_parallel/test_dist_split.py
...le/fluid/tests/unittests/auto_parallel/test_dist_split.py
+0
-3
python/paddle/fluid/tests/unittests/auto_parallel/test_engine_api.py
...le/fluid/tests/unittests/auto_parallel/test_engine_api.py
+0
-2
python/paddle/fluid/tests/unittests/auto_parallel/test_engine_api_dp.py
...fluid/tests/unittests/auto_parallel/test_engine_api_dp.py
+0
-2
python/paddle/fluid/tests/unittests/auto_parallel/test_high_order_grad.py
...uid/tests/unittests/auto_parallel/test_high_order_grad.py
+0
-2
python/paddle/fluid/tests/unittests/auto_parallel/test_interface.py
...dle/fluid/tests/unittests/auto_parallel/test_interface.py
+0
-3
python/paddle/fluid/tests/unittests/auto_parallel/test_iterable_dataset.py
...id/tests/unittests/auto_parallel/test_iterable_dataset.py
+0
-2
python/paddle/fluid/tests/unittests/auto_parallel/test_lr_grad_clip.py
.../fluid/tests/unittests/auto_parallel/test_lr_grad_clip.py
+0
-10
python/paddle/fluid/tests/unittests/auto_parallel/test_new_cost_model.py
...luid/tests/unittests/auto_parallel/test_new_cost_model.py
+1
-1
python/paddle/fluid/tests/unittests/auto_parallel/test_optimization_tuner_api.py
...ts/unittests/auto_parallel/test_optimization_tuner_api.py
+0
-1
python/paddle/fluid/tests/unittests/auto_parallel/test_pass_amp.py
...ddle/fluid/tests/unittests/auto_parallel/test_pass_amp.py
+0
-2
python/paddle/fluid/tests/unittests/auto_parallel/test_pass_grad_clip.py
...luid/tests/unittests/auto_parallel/test_pass_grad_clip.py
+0
-2
python/paddle/fluid/tests/unittests/auto_parallel/test_pass_gradient_merge.py
...tests/unittests/auto_parallel/test_pass_gradient_merge.py
+0
-2
python/paddle/fluid/tests/unittests/auto_parallel/test_pass_quantization.py
...d/tests/unittests/auto_parallel/test_pass_quantization.py
+1
-4
python/paddle/fluid/tests/unittests/auto_parallel/test_pass_recompute.py
...luid/tests/unittests/auto_parallel/test_pass_recompute.py
+0
-2
python/paddle/fluid/tests/unittests/auto_parallel/test_pass_sharding.py
...fluid/tests/unittests/auto_parallel/test_pass_sharding.py
+0
-2
python/paddle/fluid/tests/unittests/auto_parallel/test_prim_dist_op.py
.../fluid/tests/unittests/auto_parallel/test_prim_dist_op.py
+2
-4
python/paddle/fluid/tests/unittests/auto_parallel/test_process_mesh.py
.../fluid/tests/unittests/auto_parallel/test_process_mesh.py
+0
-3
python/paddle/fluid/tests/unittests/auto_parallel/test_relaunch_with_gpt_planner.py
...unittests/auto_parallel/test_relaunch_with_gpt_planner.py
+0
-2
python/paddle/fluid/tests/unittests/auto_parallel/test_relaunch_with_planner.py
...sts/unittests/auto_parallel/test_relaunch_with_planner.py
+0
-2
python/paddle/fluid/tests/unittests/auto_parallel/test_strategy.py
...ddle/fluid/tests/unittests/auto_parallel/test_strategy.py
+0
-1
python/paddle/fluid/tests/unittests/auto_parallel/test_to_static.py
...dle/fluid/tests/unittests/auto_parallel/test_to_static.py
+0
-2
python/paddle/fluid/tests/unittests/auto_parallel/test_while_op_completion.py
...tests/unittests/auto_parallel/test_while_op_completion.py
+1
-7
python/paddle/fluid/tests/unittests/auto_parallel/test_while_op_partition.py
.../tests/unittests/auto_parallel/test_while_op_partition.py
+1
-5
python/paddle/fluid/tests/unittests/distribution/test_dirichlet_op.py
...e/fluid/tests/unittests/distribution/test_dirichlet_op.py
+0
-7
python/paddle/fluid/tests/unittests/distribution/test_distribution.py
...e/fluid/tests/unittests/distribution/test_distribution.py
+0
-2
python/paddle/fluid/tests/unittests/distribution/test_distribution_beta.py
...id/tests/unittests/distribution/test_distribution_beta.py
+0
-1
python/paddle/fluid/tests/unittests/distribution/test_distribution_beta_static.py
...s/unittests/distribution/test_distribution_beta_static.py
+0
-1
python/paddle/fluid/tests/unittests/distribution/test_distribution_categorical.py
...s/unittests/distribution/test_distribution_categorical.py
+0
-1
python/paddle/fluid/tests/unittests/distribution/test_distribution_constraint.py
...ts/unittests/distribution/test_distribution_constraint.py
+0
-1
python/paddle/fluid/tests/unittests/distribution/test_distribution_dirichlet.py
...sts/unittests/distribution/test_distribution_dirichlet.py
+0
-1
python/paddle/fluid/tests/unittests/distribution/test_distribution_dirichlet_static.py
...ttests/distribution/test_distribution_dirichlet_static.py
+1
-1
python/paddle/fluid/tests/unittests/distribution/test_distribution_expfamily.py
...sts/unittests/distribution/test_distribution_expfamily.py
+0
-1
python/paddle/fluid/tests/unittests/distribution/test_distribution_expfamily_static.py
...ttests/distribution/test_distribution_expfamily_static.py
+0
-1
python/paddle/fluid/tests/unittests/distribution/test_distribution_independent.py
...s/unittests/distribution/test_distribution_independent.py
+0
-2
python/paddle/fluid/tests/unittests/distribution/test_distribution_independent_static.py
...ests/distribution/test_distribution_independent_static.py
+0
-2
python/paddle/fluid/tests/unittests/distribution/test_distribution_transform.py
...sts/unittests/distribution/test_distribution_transform.py
+1
-1
python/paddle/fluid/tests/unittests/distribution/test_distribution_transform_static.py
...ttests/distribution/test_distribution_transform_static.py
+1
-1
python/paddle/fluid/tests/unittests/distribution/test_distribution_transformed_distribution.py
...istribution/test_distribution_transformed_distribution.py
+0
-2
python/paddle/fluid/tests/unittests/distribution/test_distribution_transformed_distribution_static.py
...tion/test_distribution_transformed_distribution_static.py
+0
-2
python/paddle/fluid/tests/unittests/distribution/test_distribution_uniform.py
...tests/unittests/distribution/test_distribution_uniform.py
+0
-1
python/paddle/fluid/tests/unittests/distribution/test_distribution_variable.py
...ests/unittests/distribution/test_distribution_variable.py
+0
-2
python/paddle/fluid/tests/unittests/distribution/test_kl.py
python/paddle/fluid/tests/unittests/distribution/test_kl.py
+0
-1
python/paddle/fluid/tests/unittests/distribution/test_kl_static.py
...ddle/fluid/tests/unittests/distribution/test_kl_static.py
+0
-1
未找到文件。
python/paddle/fluid/tests/unittests/auto_parallel/amp_pass_unittest.py
浏览文件 @
632ea575
...
...
@@ -13,14 +13,13 @@
# limitations under the License.
import
unittest
import
sys
import
random
import
numpy
as
np
import
paddle
from
paddle.distributed.fleet
import
auto
from
paddle.fluid.dygraph.parallel
import
ParallelEnv
from
get_gpt_model
import
generate_model
,
create_data_holder
,
FakeDataset
from
get_gpt_model
import
FakeDataset
,
generate_model
def
apply_pass
(
use_amp
=
False
,
level
=
None
):
...
...
python/paddle/fluid/tests/unittests/auto_parallel/auto_parallel_relaunch_model.py
浏览文件 @
632ea575
...
...
@@ -12,21 +12,12 @@
# See the License for the specific language governing permissions and
# limitations under the License.
import
unittest
import
time
import
paddle.fluid
as
fluid
import
copy
import
os
import
numpy
as
np
import
subprocess
import
paddle
import
paddle.nn
as
nn
import
paddle.fluid
as
fluid
import
paddle.static
as
static
import
paddle.nn.functional
as
F
import
paddle.utils
as
utils
from
paddle.fluid
import
layers
from
paddle.io
import
IterableDataset
,
DataLoader
from
paddle.distributed
import
fleet
from
paddle.distributed.fleet
import
auto
...
...
python/paddle/fluid/tests/unittests/auto_parallel/auto_parallel_relaunch_with_gpt_planner.py
浏览文件 @
632ea575
...
...
@@ -19,10 +19,6 @@ import sys
import
numpy
as
np
from
paddle.distributed.fleet
import
auto
from
auto_parallel_relaunch_model
import
mlp_pretrain_forward
from
auto_parallel_relaunch_model
import
batch_generator_creator
sys
.
path
.
append
(
".."
)
import
auto_parallel_gpt_model
as
modeling
from
auto_parallel_gpt_model
import
GPTModel
,
GPTForPretraining
,
GPTPretrainingCriterion
...
...
python/paddle/fluid/tests/unittests/auto_parallel/clip_grad_by_global_norm.py
浏览文件 @
632ea575
...
...
@@ -13,14 +13,13 @@
# limitations under the License.
import
unittest
import
sys
import
random
import
numpy
as
np
import
paddle
from
paddle.distributed.fleet
import
auto
from
paddle.fluid.dygraph.parallel
import
ParallelEnv
from
get_gpt_model
import
generate_model
,
create_data_holder
,
FakeDataset
from
get_gpt_model
import
FakeDataset
,
generate_model
paddle
.
enable_static
()
...
...
python/paddle/fluid/tests/unittests/auto_parallel/converter.py
浏览文件 @
632ea575
...
...
@@ -12,7 +12,6 @@
# See the License for the specific language governing permissions and
# limitations under the License.
import
unittest
import
numpy
as
np
import
paddle
...
...
python/paddle/fluid/tests/unittests/auto_parallel/engine_api.py
浏览文件 @
632ea575
...
...
@@ -12,26 +12,15 @@
# See the License for the specific language governing permissions and
# limitations under the License.
import
unittest
import
time
import
tempfile
import
copy
import
os
import
numpy
as
np
import
subprocess
import
paddle
import
paddle.nn
as
nn
import
paddle.fluid
as
fluid
import
paddle.static
as
static
import
paddle.nn.functional
as
F
import
paddle.utils
as
utils
from
paddle.fluid
import
layers
from
paddle.io
import
Dataset
,
IterableDataset
,
DataLoader
from
paddle.io
import
Dataset
from
paddle.distributed.fleet
import
auto
from
paddle.distributed.auto_parallel.interface
import
get_collection
,
CollectionNames
from
paddle.optimizer.lr
import
CosineAnnealingDecay
from
paddle.fluid.dataloader.collate
import
default_collate_fn
paddle
.
enable_static
()
global_process_mesh
=
auto
.
ProcessMesh
(
mesh
=
[
0
,
1
])
...
...
python/paddle/fluid/tests/unittests/auto_parallel/engine_api_dp.py
浏览文件 @
632ea575
...
...
@@ -12,21 +12,13 @@
# See the License for the specific language governing permissions and
# limitations under the License.
import
unittest
import
time
import
tempfile
import
copy
import
os
import
numpy
as
np
import
subprocess
import
paddle
import
paddle.nn
as
nn
import
paddle.fluid
as
fluid
import
paddle.static
as
static
import
paddle.nn.functional
as
F
import
paddle.utils
as
utils
from
paddle.fluid
import
layers
from
paddle.io
import
Dataset
,
DataLoader
from
paddle.io
import
Dataset
from
paddle.distributed.fleet
import
auto
...
...
python/paddle/fluid/tests/unittests/auto_parallel/gradient_merge_pass_unittest.py
浏览文件 @
632ea575
...
...
@@ -13,14 +13,13 @@
# limitations under the License.
import
unittest
import
sys
import
random
import
numpy
as
np
import
paddle
from
paddle.distributed.fleet
import
auto
from
paddle.fluid.dygraph.parallel
import
ParallelEnv
from
get_gpt_model
import
generate_model
,
create_data_holder
,
FakeDataset
from
get_gpt_model
import
FakeDataset
,
generate_model
paddle
.
enable_static
()
...
...
python/paddle/fluid/tests/unittests/auto_parallel/high_order_grad.py
浏览文件 @
632ea575
...
...
@@ -12,9 +12,7 @@
# See the License for the specific language governing permissions and
# limitations under the License.
import
random
import
paddle
import
unittest
import
numpy
as
np
from
paddle.distributed.fleet
import
auto
from
paddle.incubate.autograd
import
Hessian
...
...
python/paddle/fluid/tests/unittests/auto_parallel/iterable_dataset.py
浏览文件 @
632ea575
...
...
@@ -12,26 +12,14 @@
# See the License for the specific language governing permissions and
# limitations under the License.
import
unittest
import
time
import
tempfile
import
copy
import
os
import
numpy
as
np
import
subprocess
import
paddle
import
paddle.nn
as
nn
import
paddle.fluid
as
fluid
import
paddle.static
as
static
import
paddle.nn.functional
as
F
import
paddle.utils
as
utils
from
paddle.fluid
import
layers
from
paddle.io
import
Dataset
,
IterableDataset
,
DataLoader
from
paddle.static
import
InputSpec
from
paddle.distributed.fleet
import
auto
from
paddle.optimizer.lr
import
CosineAnnealingDecay
from
paddle.fluid.dataloader.collate
import
default_collate_fn
paddle
.
enable_static
()
global_process_mesh
=
auto
.
ProcessMesh
(
mesh
=
[
0
,
1
])
...
...
python/paddle/fluid/tests/unittests/auto_parallel/optimization_tuner_api.py
浏览文件 @
632ea575
...
...
@@ -12,21 +12,9 @@
# See the License for the specific language governing permissions and
# limitations under the License.
import
unittest
import
time
import
tempfile
import
copy
import
os
import
numpy
as
np
import
subprocess
import
paddle
import
paddle.nn
as
nn
import
paddle.fluid
as
fluid
import
paddle.static
as
static
import
paddle.nn.functional
as
F
import
paddle.utils
as
utils
from
paddle.fluid
import
layers
from
paddle.io
import
Dataset
,
IterableDataset
,
DataLoader
from
paddle.distributed.fleet
import
auto
from
engine_api_dp
import
MyDataset
...
...
python/paddle/fluid/tests/unittests/auto_parallel/recompute_pass_unittest.py
浏览文件 @
632ea575
...
...
@@ -13,14 +13,13 @@
# limitations under the License.
import
unittest
import
sys
import
random
import
numpy
as
np
import
paddle
from
paddle.distributed.fleet
import
auto
from
paddle.fluid.dygraph.parallel
import
ParallelEnv
from
get_gpt_model
import
generate_model
,
create_data_holder
,
FakeDataset
from
get_gpt_model
import
FakeDataset
,
generate_model
def
apply_pass
(
use_recompute
=
False
):
...
...
python/paddle/fluid/tests/unittests/auto_parallel/sharding_pass_unittest.py
浏览文件 @
632ea575
...
...
@@ -13,14 +13,13 @@
# limitations under the License.
import
unittest
import
sys
import
random
import
numpy
as
np
import
paddle
from
paddle.distributed.fleet
import
auto
from
paddle.fluid.dygraph.parallel
import
ParallelEnv
from
get_gpt_model
import
generate_model
,
create_data_holder
,
FakeDataset
from
get_gpt_model
import
FakeDataset
,
generate_model
paddle
.
enable_static
()
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_auto_parallel_relaunch.py
浏览文件 @
632ea575
...
...
@@ -17,9 +17,7 @@ import unittest
import
os
import
sys
import
json
import
shutil
import
subprocess
from
paddle.distributed.fleet.launch_utils
import
run_with_coverage
cluster_json
=
"""
{
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_base_cost.py
浏览文件 @
632ea575
...
...
@@ -27,11 +27,7 @@ from paddle.distributed.auto_parallel.completion import Completer
from
paddle.distributed.auto_parallel.dist_context
import
DistributedContext
from
paddle.distributed
import
fleet
from
paddle.distributed.auto_parallel.parallelizer
import
AutoParallelizer
from
paddle.distributed.auto_parallel.partitioner
import
Partitioner
from
paddle.distributed.auto_parallel.reshard
import
Resharder
from
paddle.distributed.auto_parallel.utils
import
print_program_with_dist_attr
from
paddle.distributed.auto_parallel.cluster
import
Cluster
from
paddle.distributed.auto_parallel.cost
import
CommContext
from
paddle.distributed.auto_parallel.cost.base_cost
import
build_comp_desc_from_dist_op
from
paddle.distributed.auto_parallel.cost.base_cost
import
build_comm_desc_from_dist_op
from
paddle.distributed.auto_parallel.cost.base_cost
import
build_comm_costs_from_descs
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_cluster.py
浏览文件 @
632ea575
...
...
@@ -17,7 +17,6 @@ import unittest
import
os
import
json
import
paddle
from
paddle.distributed.auto_parallel.cluster
import
Cluster
from
paddle.distributed.auto_parallel.cluster
import
get_default_cluster
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_comp_cost.py
浏览文件 @
632ea575
...
...
@@ -16,7 +16,6 @@ import unittest
import
os
import
json
import
paddle
from
paddle.distributed.auto_parallel.cluster
import
Cluster
from
paddle.distributed.auto_parallel.cost.comp_op_cost
import
AssignOpCost
from
paddle.distributed.auto_parallel.cost.comp_op_cost
import
AssignValueOpCost
...
...
@@ -51,7 +50,6 @@ from paddle.distributed.auto_parallel.cost.comp_op_cost import LogOpCost
from
paddle.distributed.auto_parallel.cost.comp_op_cost
import
LookupTableV2OpCost
from
paddle.distributed.auto_parallel.cost.comp_op_cost
import
LookupTableV2GradOpCost
from
paddle.distributed.auto_parallel.cost.comp_op_cost
import
MatmulOpCost
from
paddle.distributed.auto_parallel.cost.comp_op_cost
import
MatmulGradOpCost
from
paddle.distributed.auto_parallel.cost.comp_op_cost
import
MatmulV2OpCost
from
paddle.distributed.auto_parallel.cost.comp_op_cost
import
MatmulV2GradOpCost
from
paddle.distributed.auto_parallel.cost.comp_op_cost
import
MemcpyOpCost
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_converter.py
浏览文件 @
632ea575
...
...
@@ -16,9 +16,7 @@ import tempfile
import
unittest
import
os
import
sys
import
shutil
import
subprocess
from
paddle.distributed.fleet.launch_utils
import
run_with_coverage
from
paddle.distributed.auto_parallel.converter
import
Converter
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_dist_attr_v2.py
浏览文件 @
632ea575
...
...
@@ -14,8 +14,6 @@
import
unittest
import
paddle
import
numpy
as
np
import
paddle.nn
as
nn
import
paddle.static
as
static
from
paddle.fluid.core
import
TensorDistAttr
from
paddle.fluid.core
import
OperatorDistAttr
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_dist_context.py
浏览文件 @
632ea575
...
...
@@ -13,21 +13,17 @@
# limitations under the License.
import
unittest
import
os
import
json
import
copy
import
paddle
import
numpy
as
np
import
paddle.nn
as
nn
import
paddle.utils
as
utils
import
paddle.static
as
static
import
paddle.nn.functional
as
F
from
paddle.distributed
import
fleet
from
paddle.distributed.fleet
import
auto
from
paddle.distributed.auto_parallel.dist_context
import
DistributedContext
from
paddle.distributed.auto_parallel.utils
import
print_program_with_dist_attr
paddle
.
enable_static
()
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_dist_embedding.py
浏览文件 @
632ea575
...
...
@@ -16,9 +16,6 @@ import unittest
import
paddle
from
paddle.distributed.fleet
import
auto
from
paddle.fluid
import
program_guard
from
paddle.fluid.backward
import
append_backward
from
paddle.distributed.auto_parallel.utils
import
print_program_with_dist_attr
from
test_dist_pnorm
import
parallelizer
paddle
.
enable_static
()
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_dist_matmul.py
浏览文件 @
632ea575
...
...
@@ -18,7 +18,6 @@ from paddle.distributed.fleet import auto
from
paddle.fluid
import
program_guard
from
paddle.fluid.backward
import
append_backward
from
paddle.distributed.auto_parallel.utils
import
print_program_with_dist_attr
paddle
.
enable_static
()
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_dist_op_cost.py
浏览文件 @
632ea575
...
...
@@ -29,7 +29,6 @@ paddle.enable_static()
def
parallelizer
(
program_func
,
rank
):
from
paddle.distributed.auto_parallel.completion
import
Completer
from
paddle.distributed.auto_parallel.partitioner
import
Partitioner
from
paddle.distributed.auto_parallel.dist_context
import
DistributedContext
main_program
,
startup_program
,
loss
=
program_func
()
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_dist_pnorm.py
浏览文件 @
632ea575
...
...
@@ -18,7 +18,6 @@ from paddle.distributed.fleet import auto
from
paddle.fluid
import
program_guard
from
paddle.fluid.backward
import
append_backward
from
paddle.distributed.auto_parallel.utils
import
print_program_with_dist_attr
paddle
.
enable_static
()
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_dist_reshape.py
浏览文件 @
632ea575
...
...
@@ -16,10 +16,6 @@ import unittest
import
paddle
from
paddle.distributed.fleet
import
auto
from
paddle.fluid
import
program_guard
from
paddle.fluid.backward
import
append_backward
from
paddle.distributed.auto_parallel.utils
import
print_program_with_dist_attr
paddle
.
enable_static
()
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_dist_slice.py
浏览文件 @
632ea575
...
...
@@ -15,7 +15,6 @@
import
unittest
import
paddle
from
paddle.distributed.fleet
import
auto
from
paddle.distributed.auto_parallel.utils
import
print_program_with_dist_attr
paddle
.
enable_static
()
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_dist_split.py
浏览文件 @
632ea575
...
...
@@ -16,9 +16,6 @@ import unittest
import
paddle
from
paddle.distributed.fleet
import
auto
from
paddle.fluid
import
program_guard
from
paddle.distributed.auto_parallel.utils
import
print_program_with_dist_attr
paddle
.
enable_static
()
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_engine_api.py
浏览文件 @
632ea575
...
...
@@ -16,9 +16,7 @@ import tempfile
import
unittest
import
os
import
sys
import
shutil
import
subprocess
from
paddle.distributed.fleet.launch_utils
import
run_with_coverage
class
TestEngineAPI
(
unittest
.
TestCase
):
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_engine_api_dp.py
浏览文件 @
632ea575
...
...
@@ -16,9 +16,7 @@ import tempfile
import
unittest
import
os
import
sys
import
shutil
import
subprocess
from
paddle.distributed.fleet.launch_utils
import
run_with_coverage
class
TestEngineAPI
(
unittest
.
TestCase
):
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_high_order_grad.py
浏览文件 @
632ea575
...
...
@@ -16,9 +16,7 @@ import tempfile
import
unittest
import
os
import
sys
import
shutil
import
subprocess
from
paddle.distributed.fleet.launch_utils
import
run_with_coverage
class
TestHighOrderGrad
(
unittest
.
TestCase
):
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_interface.py
浏览文件 @
632ea575
...
...
@@ -14,15 +14,12 @@
import
unittest
import
paddle
import
paddle.fluid
as
fluid
import
paddle.nn
as
nn
import
paddle.nn.functional
as
F
import
paddle.static
as
static
import
paddle.distributed
as
dist
from
paddle.distributed.fleet
import
auto
from
paddle.distributed.auto_parallel.dist_context
import
get_default_distributed_context
from
paddle.distributed.auto_parallel.process_mesh
import
ProcessMesh
from
paddle.distributed.auto_parallel.utils
import
print_program_with_dist_attr
paddle
.
enable_static
()
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_iterable_dataset.py
浏览文件 @
632ea575
...
...
@@ -16,9 +16,7 @@ import tempfile
import
unittest
import
os
import
sys
import
shutil
import
subprocess
from
paddle.distributed.fleet.launch_utils
import
run_with_coverage
class
TestEngineAPI
(
unittest
.
TestCase
):
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_lr_grad_clip.py
浏览文件 @
632ea575
...
...
@@ -14,18 +14,8 @@
import
unittest
import
os
import
numpy
as
np
import
paddle
import
paddle.nn
as
nn
import
paddle.nn.functional
as
F
from
paddle.distributed.fleet
import
auto
import
paddle.distributed.fleet
as
fleet
from
paddle.io
import
Dataset
from
paddle.static
import
InputSpec
from
paddle.fluid.framework
import
_non_static_mode
from
test_to_static
import
MLPLayer
,
MyDataset
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_new_cost_model.py
浏览文件 @
632ea575
...
...
@@ -25,7 +25,7 @@ from paddle.distributed.auto_parallel.cost.base_cost import build_comp_desc_str_
from
paddle.distributed.auto_parallel.cost.base_cost
import
calc_time_by_modeling
from
paddle.distributed.auto_parallel.cluster
import
Cluster
from
paddle.distributed.auto_parallel.cost
import
CommContext
from
test_cluster
import
cluster_json
,
multi_cluster_json
from
test_cluster
import
cluster_json
paddle
.
enable_static
()
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_optimization_tuner_api.py
浏览文件 @
632ea575
...
...
@@ -18,7 +18,6 @@ import os
import
sys
import
shutil
import
subprocess
from
paddle.distributed.fleet.launch_utils
import
run_with_coverage
class
TestOptimizationTunerAPI
(
unittest
.
TestCase
):
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_pass_amp.py
浏览文件 @
632ea575
...
...
@@ -16,9 +16,7 @@ import tempfile
import
unittest
import
os
import
sys
import
shutil
import
subprocess
from
paddle.distributed.fleet.launch_utils
import
run_with_coverage
class
TestAMPPass
(
unittest
.
TestCase
):
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_pass_grad_clip.py
浏览文件 @
632ea575
...
...
@@ -16,9 +16,7 @@ import tempfile
import
unittest
import
os
import
sys
import
shutil
import
subprocess
from
paddle.distributed.fleet.launch_utils
import
run_with_coverage
class
TestGradientClip
(
unittest
.
TestCase
):
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_pass_gradient_merge.py
浏览文件 @
632ea575
...
...
@@ -16,9 +16,7 @@ import tempfile
import
unittest
import
os
import
sys
import
shutil
import
subprocess
from
paddle.distributed.fleet.launch_utils
import
run_with_coverage
class
TestGradientMergePass
(
unittest
.
TestCase
):
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_pass_quantization.py
浏览文件 @
632ea575
...
...
@@ -13,13 +13,10 @@
# limitations under the License.
import
unittest
import
sys
import
random
import
numpy
as
np
import
paddle
from
paddle.distributed.fleet
import
auto
from
get_gpt_model
import
generate_model
,
create_data_holder
,
FakeDataset
from
get_gpt_model
import
FakeDataset
,
generate_model
paddle
.
enable_static
()
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_pass_recompute.py
浏览文件 @
632ea575
...
...
@@ -16,9 +16,7 @@ import tempfile
import
unittest
import
os
import
sys
import
shutil
import
subprocess
from
paddle.distributed.fleet.launch_utils
import
run_with_coverage
class
TestRecomputePass
(
unittest
.
TestCase
):
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_pass_sharding.py
浏览文件 @
632ea575
...
...
@@ -16,9 +16,7 @@ import tempfile
import
unittest
import
os
import
sys
import
shutil
import
subprocess
from
paddle.distributed.fleet.launch_utils
import
run_with_coverage
class
TestShardingPass
(
unittest
.
TestCase
):
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_prim_dist_op.py
浏览文件 @
632ea575
...
...
@@ -16,15 +16,13 @@ import unittest
import
paddle
from
paddle.distributed.fleet
import
auto
from
paddle.fluid
import
program_guard
from
paddle.incubate.autograd
import
prim2orig
,
enable_prim
,
prim_enabled
from
paddle.incubate.autograd
import
enable_prim
from
paddle.fluid.layer_helper
import
LayerHelper
from
paddle.distributed.auto_parallel.utils
import
print_program_with_dist_attr
from
paddle.distributed.fleet
import
auto
from
paddle.distributed.auto_parallel.completion
import
Completer
from
paddle.distributed.auto_parallel.partitioner
import
Partitioner
from
paddle.distributed.auto_parallel.utils
import
set_var_dist_attr
from
paddle.distributed.auto_parallel.dist_context
import
DistributedContext
,
get_default_distributed_context
,
set_default_distributed_context
from
paddle.distributed.auto_parallel.dist_context
import
DistributedContext
,
get_default_distributed_context
paddle
.
enable_static
()
enable_prim
()
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_process_mesh.py
浏览文件 @
632ea575
...
...
@@ -15,14 +15,11 @@
import
unittest
import
numpy
as
np
import
paddle
import
paddle.fluid
as
fluid
import
paddle.nn
as
nn
import
paddle.nn.functional
as
F
import
paddle.static
as
static
from
paddle.distributed.fleet
import
auto
from
paddle.distributed.auto_parallel.process_mesh
import
ProcessMesh
from
paddle.distributed.auto_parallel.dist_context
import
get_default_distributed_context
from
paddle.distributed.auto_parallel.utils
import
print_program_with_dist_attr
paddle
.
enable_static
()
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_relaunch_with_gpt_planner.py
浏览文件 @
632ea575
...
...
@@ -17,9 +17,7 @@ import unittest
import
os
import
sys
import
json
import
shutil
import
subprocess
from
paddle.distributed.fleet.launch_utils
import
run_with_coverage
class
TestPlannerReLaunch
(
unittest
.
TestCase
):
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_relaunch_with_planner.py
浏览文件 @
632ea575
...
...
@@ -17,9 +17,7 @@ import unittest
import
os
import
sys
import
json
import
shutil
import
subprocess
from
paddle.distributed.fleet.launch_utils
import
run_with_coverage
class
TestPlannerReLaunch
(
unittest
.
TestCase
):
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_strategy.py
浏览文件 @
632ea575
...
...
@@ -12,7 +12,6 @@
# See the License for the specific language governing permissions and
# limitations under the License.
import
os
# import yaml
import
unittest
from
paddle.distributed.fleet
import
auto
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_to_static.py
浏览文件 @
632ea575
...
...
@@ -14,14 +14,12 @@
import
unittest
import
os
import
numpy
as
np
import
paddle
import
paddle.nn
as
nn
import
paddle.nn.functional
as
F
from
paddle.distributed.fleet
import
auto
import
paddle.distributed.fleet
as
fleet
from
paddle
import
LazyGuard
from
paddle.io
import
Dataset
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_while_op_completion.py
浏览文件 @
632ea575
...
...
@@ -16,19 +16,13 @@ import unittest
import
paddle
import
numpy
as
np
import
paddle.nn
as
nn
import
paddle.utils
as
utils
import
paddle.static
as
static
import
paddle.nn.functional
as
F
from
paddle.distributed.fleet
import
auto
from
paddle.distributed
import
fleet
from
paddle.distributed.auto_parallel.completion
import
Completer
from
paddle.distributed.auto_parallel.partitioner
import
Partitioner
from
paddle.distributed.auto_parallel.utils
import
make_data_unshard
from
paddle.distributed.auto_parallel.dist_attribute
import
OperatorDistributedAttribute
,
TensorDistributedAttribute
from
paddle.distributed.auto_parallel.dist_context
import
DistributedContext
,
get_default_distributed_context
from
paddle.distributed.auto_parallel.operators
import
find_compatible_distributed_operator_impls
from
paddle.distributed.auto_parallel.utils
import
print_program_with_dist_attr
from
paddle.distributed.auto_parallel.dist_context
import
DistributedContext
paddle
.
enable_static
()
...
...
python/paddle/fluid/tests/unittests/auto_parallel/test_while_op_partition.py
浏览文件 @
632ea575
...
...
@@ -16,7 +16,6 @@ import unittest
import
paddle
import
numpy
as
np
import
paddle.nn
as
nn
import
paddle.utils
as
utils
import
paddle.fluid
as
fluid
import
paddle.static
as
static
import
paddle.nn.functional
as
F
...
...
@@ -26,10 +25,7 @@ from paddle.distributed import fleet
from
paddle.distributed.auto_parallel.completion
import
Completer
from
paddle.distributed.auto_parallel.partitioner
import
Partitioner
from
paddle.distributed.auto_parallel.utils
import
make_data_unshard
from
paddle.distributed.auto_parallel.dist_attribute
import
OperatorDistributedAttribute
,
TensorDistributedAttribute
from
paddle.distributed.auto_parallel.dist_context
import
DistributedContext
,
get_default_distributed_context
from
paddle.distributed.auto_parallel.operators
import
find_compatible_distributed_operator_impls
from
paddle.distributed.auto_parallel.utils
import
print_program_with_dist_attr
from
paddle.distributed.auto_parallel.dist_context
import
get_default_distributed_context
paddle
.
enable_static
()
...
...
python/paddle/fluid/tests/unittests/distribution/test_dirichlet_op.py
浏览文件 @
632ea575
...
...
@@ -12,21 +12,14 @@
# See the License for the specific language governing permissions and
# limitations under the License.
import
re
import
sys
import
unittest
import
numpy
as
np
import
paddle
import
paddle.fluid.core
as
core
import
paddle.fluid.dygraph
as
dg
import
paddle.static
as
static
import
scipy.stats
from
numpy.random
import
random
as
rand
sys
.
path
.
append
(
"../"
)
from
op_test
import
OpTest
from
paddle.fluid
import
Program
,
program_guard
paddle
.
enable_static
()
...
...
python/paddle/fluid/tests/unittests/distribution/test_distribution.py
浏览文件 @
632ea575
...
...
@@ -12,12 +12,10 @@
# See the License for the specific language governing permissions and
# limitations under the License.
import
math
import
unittest
import
numpy
as
np
import
paddle
from
paddle
import
fluid
from
paddle.distribution
import
*
from
paddle.fluid
import
layers
...
...
python/paddle/fluid/tests/unittests/distribution/test_distribution_beta.py
浏览文件 @
632ea575
...
...
@@ -18,7 +18,6 @@ import numpy as np
import
paddle
import
scipy.stats
import
config
from
config
import
ATOL
,
DEVICES
,
RTOL
from
parameterize
import
TEST_CASE_NAME
,
parameterize_cls
,
place
,
xrand
...
...
python/paddle/fluid/tests/unittests/distribution/test_distribution_beta_static.py
浏览文件 @
632ea575
...
...
@@ -11,7 +11,6 @@
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
import
numbers
import
unittest
import
numpy
as
np
...
...
python/paddle/fluid/tests/unittests/distribution/test_distribution_categorical.py
浏览文件 @
632ea575
...
...
@@ -12,7 +12,6 @@
# See the License for the specific language governing permissions and
# limitations under the License.
import
math
import
unittest
import
numpy
as
np
...
...
python/paddle/fluid/tests/unittests/distribution/test_distribution_constraint.py
浏览文件 @
632ea575
...
...
@@ -18,7 +18,6 @@ import numpy as np
import
paddle
from
paddle.distribution
import
constraint
import
config
import
parameterize
as
param
np
.
random
.
seed
(
2022
)
...
...
python/paddle/fluid/tests/unittests/distribution/test_distribution_dirichlet.py
浏览文件 @
632ea575
...
...
@@ -18,7 +18,6 @@ import numpy as np
import
paddle
import
scipy.stats
import
config
from
config
import
ATOL
,
DEVICES
,
RTOL
import
parameterize
as
param
...
...
python/paddle/fluid/tests/unittests/distribution/test_distribution_dirichlet_static.py
浏览文件 @
632ea575
...
...
@@ -19,7 +19,7 @@ import paddle
import
scipy.stats
from
config
import
ATOL
,
DEVICES
,
RTOL
from
parameterize
import
TEST_CASE_NAME
,
parameterize_cls
,
place
,
xrand
from
parameterize
import
TEST_CASE_NAME
,
parameterize_cls
,
place
np
.
random
.
seed
(
2022
)
paddle
.
enable_static
()
...
...
python/paddle/fluid/tests/unittests/distribution/test_distribution_expfamily.py
浏览文件 @
632ea575
...
...
@@ -16,7 +16,6 @@ import unittest
import
numpy
as
np
import
paddle
import
scipy.stats
import
config
import
mock_data
as
mock
...
...
python/paddle/fluid/tests/unittests/distribution/test_distribution_expfamily_static.py
浏览文件 @
632ea575
...
...
@@ -16,7 +16,6 @@ import unittest
import
numpy
as
np
import
paddle
import
scipy.stats
import
config
import
mock_data
as
mock
...
...
python/paddle/fluid/tests/unittests/distribution/test_distribution_independent.py
浏览文件 @
632ea575
...
...
@@ -11,12 +11,10 @@
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
import
numbers
import
unittest
import
numpy
as
np
import
paddle
import
scipy.stats
import
config
import
parameterize
as
param
...
...
python/paddle/fluid/tests/unittests/distribution/test_distribution_independent_static.py
浏览文件 @
632ea575
...
...
@@ -11,12 +11,10 @@
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
import
numbers
import
unittest
import
numpy
as
np
import
paddle
import
scipy.stats
import
config
import
parameterize
as
param
...
...
python/paddle/fluid/tests/unittests/distribution/test_distribution_transform.py
浏览文件 @
632ea575
...
...
@@ -17,7 +17,7 @@ import unittest
import
numpy
as
np
import
paddle
from
paddle.distribution
import
constraint
,
transform
,
variable
from
paddle.distribution
import
transform
,
variable
import
config
import
parameterize
as
param
...
...
python/paddle/fluid/tests/unittests/distribution/test_distribution_transform_static.py
浏览文件 @
632ea575
...
...
@@ -16,7 +16,7 @@ import unittest
import
numpy
as
np
import
paddle
from
paddle.distribution
import
transform
,
variable
,
constraint
from
paddle.distribution
import
transform
,
variable
import
config
import
parameterize
as
param
...
...
python/paddle/fluid/tests/unittests/distribution/test_distribution_transformed_distribution.py
浏览文件 @
632ea575
...
...
@@ -11,12 +11,10 @@
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
import
numbers
import
unittest
import
numpy
as
np
import
paddle
import
scipy.stats
import
config
import
parameterize
as
param
...
...
python/paddle/fluid/tests/unittests/distribution/test_distribution_transformed_distribution_static.py
浏览文件 @
632ea575
...
...
@@ -11,12 +11,10 @@
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
import
numbers
import
unittest
import
numpy
as
np
import
paddle
import
scipy.stats
import
config
import
parameterize
as
param
...
...
python/paddle/fluid/tests/unittests/distribution/test_distribution_uniform.py
浏览文件 @
632ea575
...
...
@@ -12,7 +12,6 @@
# See the License for the specific language governing permissions and
# limitations under the License.
import
math
import
unittest
import
numpy
as
np
...
...
python/paddle/fluid/tests/unittests/distribution/test_distribution_variable.py
浏览文件 @
632ea575
...
...
@@ -14,12 +14,10 @@
import
unittest
import
numpy
as
np
import
paddle
from
paddle.distribution
import
variable
from
paddle.distribution
import
constraint
import
config
import
parameterize
as
param
paddle
.
seed
(
2022
)
...
...
python/paddle/fluid/tests/unittests/distribution/test_kl.py
浏览文件 @
632ea575
...
...
@@ -12,7 +12,6 @@
# See the License for the specific language governing permissions and
# limitations under the License.
import
numbers
import
unittest
import
numpy
as
np
...
...
python/paddle/fluid/tests/unittests/distribution/test_kl_static.py
浏览文件 @
632ea575
...
...
@@ -12,7 +12,6 @@
# See the License for the specific language governing permissions and
# limitations under the License.
import
numbers
import
unittest
import
numpy
as
np
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录