* support elementwise add, activation, matmul on Baidu Kunlun
* test=kunlun

* minor
* test=kunlun

* reconstuct the xpu directory
* test=kunlun

* minor
* test=kunlun

* minor
* test=kunlun

* minor
* test=kunlun

* minor
* test=kunlun

* minor
* test=kunlun

register log double grad kernel for cpu and cuda

* fix sgd/momentum/dpsgd/rmsprop error message

* fix test_dist_fleet_heter_ctr & peformance update

fix cpplint error for the autmic max/min

* fix bn double grad, test=develop

* update, test=develop

* add fp16 for matmul

add abs support double grad for the api 2.0

* refine PADDLE_ENFORCE

* fix error message in conv/conv_transpose. test=develop

* refine err msg in shuffle channel op

* use iwyu clean include, test=develop, test=win

* compilation error, test=develop

* fix compilation error2, test=develop

* fix compilation error3, test=develop

* fix compilation error4, test=develop

* fix compilation error5, test=develop

* fix compilation error6, test=develop

* fix compilation error7, test=develop

* fix compilation error8, test=develop

* fix compilation error8, test=develop

* fix compilation error10, test=develop

* fix compilation error11, test=develop

* refine the error message for bath size like

Add GPU Kernels of Segment Ops,  support, sum, max, min, mean

* [bug fix]:Memory increases after adapting the cudnn version to 8

* [bug fix]cudnnGetConvolutionForwardAlgorithm not defined

The calculation result of Diag_v2 Op under large size input is wrong 

* rename communicator meet->BatchesCounter

* fix parame recv for sparse

* geo sparse init from pserver

* optimize init from pserver

* add large scale optimizer fuse(SGD/ADAM)

* rectification init_worker and exe.run startup program

* polish no onwer op error message

* fix unittest failed

* polish details based reviewer comment

* add fused_bn_add_relu op

* test=develop, update error message

Add the cpu version of segment sum mean max min op

* argsort op acceleration on GPU when the input size is equal to the length of the ‘axis’ dimension

* add double grad compute for batch norm,test=develop

* fix unittest, test=develop

* remove unuse tensor,test=develop

* add format,test=develop

* update, test=develop

* fix bug sequececonv_eltadd_relu_fuse_pass, output error when sequence_conv's padding_start > 0

* fix seqconv_eltadd_relu_fuse_pass unitest error

* support use add instead of sum to do gradient accumulation

* add inplace addto pass

* add grad_add op and inplace addto pass

* remove debug code

* code refine

* fix bug when sereral sum ops inserts at same op_idx

* fix Flags type

* add addto attribute for conv3d

* fix ut

* code clean

* fix type

Fix bug: shapes of Topk outputs are wrong when the parameter k is Tensor 

* Finished ChannelWiseQuantDequantAbsMaxOp and Passed unittests.

* Finished channel-wise quantize strategy in imperative quantization.

* Added Cuda code of ChannelWiseQuantDequantMaxAbsOP
Add Cuda code of ChannelWiseQuantDequantMaxAbsOp

* Add quant_axis for channel_wise quant.

* fixed a bug in unnitests, which will not trigger axis = 1 case and cannot meet the coverage rate requirement.

* Added some assert infomation and fixed some coding style mistakes.

* fix adam

* rmsprop support double

* fix cudnn dyload error

https://github.com/PaddlePaddle/Paddle/pull/27332

* fix op print error info problem. test=develop

* fix build error

* fix format

* fix error msg info

* fix format