* remove deps and prior comm

* grad comm fuse

* add deps for amp&global norm

* stage2 broadcast prior deps

* stage2 grad overlap

* stream_analyzer bugfix

* overlap enable

* dep op namescope

* depend support multiple inputs

* check finite deps

* stage2 param comm overlap

* Set kD2HStream

* grad comm hierarchical

* grad comm hierarchical

* new unitest
Co-authored-by: Nchenruibiao <chenruibiao@baidu.com>

* fix get_single_test_cov.py bug

* debug

* update requirements.txt and setup.py.in

* update requirements.txt setup.py.in setup.py

This reverts commit 2c444dfa.

* add for-else

* add * for unpacking

* execute use kernel_key first

* change OpKernelType->KernelKey

* fix py3 compile error, remove redundant header files

* fix build_strategy_test

* fix DataType::RAW

* fix custom_type test: operator_test.cc

* fix transform place

* fix backends_are_same_class

* try fix place TransDataDevice

* support all KernelKey

* fix TransformData

* fix place_are_same_class

* fix merge

* fix test_params_no_grad

* fix specific place of GetExpectedKernelType

* fix specific place of GetExpectedKernelType

* fix GetKernelTypeForVar

* fix dtype error

* fix fetch_v2

* change GetKernelTypeForVar

* fix interpreter

* fix typo error

* polish codes

* polish codes

* polish codes

* fix conflict

* [CodeStyle][isort][UP019] sort imports and update deprecated type annotation in paddle/jit/api.py

* Revert "[CodeStyle][isort][UP019] sort imports and update deprecated type annotation in paddle/jit/api.py"

This reverts commit 0ca4d52c900199126e6433057d1514dbf9d4ee07.

* update deprecated typing

* Fix param and out grad names in dy2st for high order grad

* replace matmul with matmul_v2 in fuse passes

* Remove fusion logic from matmul

* removing fusion methods

* add proper name

* adjust namespaces

* move fc from fluid to paddle2.0

* fix unit test

* fix some examples

* fix some examples

* remove fluid.save_dygraph and fluid.load_dygraph use paddle.save and paddle.load instead

* move Sequential to paddle.nn

* modify convert_call_func.py Sequential reference

* remove related unitests

* remove fluid.dynamic.Sequntial

* test remove conver_call_func

* fix conflicts

* fix typro

* fix unitests

* fix sample_code

* fix unitest

* fix __init__

* [CodeStyle][py2] test dockerfile

* remove some deps for pip2.7

* clean python2

* remove pip upgrade

* use tar extract setuptools package

* downgrade setuptools

* Implement conv2d_fusion NHWC format using CUTLASS
* Add unit testing for CUTLASS Conv in inference
* Add experimental API for CUTLASS.

* [OpAttr]Fix Ignore AttriteTensor in IndicateDataType bug in grad_op

* add GetExpectedKernelType

* Use BroadcastKernel and ReduceKernel to optimize expand and expand_grad.

* Correct the axis when there is only 1 input in BroadcastKernel.

* Add the calculate of output's shape.

* [Zero-Dim] reshape/reshape_/reverse 0D support

* rm comment

* change paddle.to_tensor to paddle.full

* fix docs

* update paddle.full

* relu flops all

* add annotations and tests

* revision for codestyle

* bugfix: fix bugs in Indexable and support LayerDict

* fix bugs.

* check weight shape of conv1d_transpose

* add unittest case

* speedup getFNDAFile

* add fnda_base for c++ ut cc file

* fix bug

* fix bug

* fix bug

* fix bug

* add custom_cpu testcase

* update test_custom_device_setup

* update path to custom_runtime

* fix cmd wait

* test Linux only

* setup once

* integrate to one run_cmd

* add pip install

* change timeout

* add debug string

* add debug string

* add debug string

* use os.system and change module name

* add runtime

* add more debug message

* continue debug

* timestamp

* fix testcase import bug

* remove error message

* set TIMEOUT property