* add broadcast supporting for elementwise_add

* add broadcast supporting for elementwise_add

* add more tests

* remove the redundant code

* update

* fix place error in unittest

* remove skip.If

* support kunlun black list and add kl1 op

* xpu_op_list add device_context dependence

* fix npu compile error, test=develop

* [NPU] Support npu kernel for atan and atan_grad op, test=develop

* [NPU] Support npu kernel for atan and atan_grad op, test=develop
Co-authored-by: Nqili93 <qili93@qq.com>

* [NPU] add reduce_prod

* [NPU] delete check_dygraph=False

* [NPU] delete skipIf

* add attrs support or check

* [NPU] delete extra codes for test_reduce_max_op_npu

* [NPU] add attr out_dtype

* fix paddle.optimizer test=document_fix

* fix paddle.optimizer test=document_fix

* fix bugs in paddle.nn.functional document test=document_fix

* fix bugs in paddle.nn.functional document test=document_fix

* fix bugs in paddle.nn.functional document test=document_fix

* fix bugs in paddle.nn.functional document test=document_fix

* fix nn formula bugs test=document_fix

* fix nn formula bugs test=document_fix

* fix nn formula bugs test=document_fix

* add eye npu op

* remove useless headers

* code style

* Update eye_op_npu.cc

* Update eye_op_npu.cc

* remove useless code in test file

* code style check

* change Copyright to 2021

* add test case and do some fix

* fix

* update code

* fix for CI

* return

* fix

* fix ut

* decrease gpu memory consumption

* remove exclusive

* [NPU] Support npu op: (1) cos (2) cos_grad

* Update test_cos_op_npu.py

* Update activation_op_npu.cc

* rm redundant {1}

* Add relu6 and relu6_grad npu op

* fixed pre-commit-config.yaml

* fixed for CI

* first test version

* add test exec;

* add data transfer; test=develop

* add new exec head;

* add memcpy; test=develop

* add python fetch

* add new test

* add graph node; test=develop

* remove useless new executor test; test=develop

* remove gperf dependency; test=develop

* fix compile bugs; test=develop

* remove useless code; test=develop

* remove useless code; test=develop

* add uni test; test=develop

* polish code; test=develop

* polish code; test=develop

* add interpreter cmakefile; test=develop

* remove useless code; test=develop

* integrated gast library

* integrated gast library

* fix unittest and remove ast2.py

* remove 'gast' from __all__ in __init__.py

* add copyright in other files

* fix copyright

* support bool dtype for paddle.sum

* Support Mixed Precision training in @to_static

* fix block.vars logic

* fix GPU training loss diff

* remove unused code

* replace boost::algorithm::ends_with with self define ends_with function

* remove BOOST macro in certain operators

* remove boost::lexical_cast

* add test for string_helper

* add more test case for string_helper

* modify join_string func and test case

* fix build_strategy_test failed bug

* remove string_helper_test from parallel_UT_rule.py

* add NPU support for zero_copy_tensor.

* revert unnesessary codes.

* revert unnesessary codes.

* add not_equal NPU op

* add not_equal NPU op

* add not_equal NPU op

* add not_equal NPU op

* fix bug of p2p for partial

* fix error

* revert commit id 34212

* fix paddle.optimizer test=document_fix

* fix paddle.optimizer test=document_fix

* fix bugs in paddle.nn.functional document test=document_fix

* fix bugs in paddle.nn.functional document test=document_fix

* fix bugs in paddle.nn.functional document test=document_fix

* fix bugs in paddle.nn.functional document test=document_fix

* add gradients_with_optimizer api

* modify gradients_with_optimizer

* add gradients_with_optimizer api into paddle.auto.backward_mode

* add gradients_with_optimizer test case

* add doc for gradients_with_optimizer

* add doc for gradients_with_optimizer