* fix malloc L3 failed bug for kunlun

* minor

* [ROCM] update fluid platform for rocm35 (part1), test=develop

* address review comments, test=develop

* add abs test case

* use std::abs to fix abs bug

* fix the abs bug

* fix abs bug

* delete empty line of pybing.cc, test=develop

* use nvtx push pop in timeline, test=develop

* change year, test=develop

* add #ifdef PADDLE_WITH_CUDA, test=develop

* add #ifndef WIN32, test=develop

* is_pushed to is_pushed_, test=develop

* rewrite abs op

* rewrite abs op and remove abs in activation

* remove abs register in old codes

* fix abs_grad type error

* fix abs double_grad output name error

* modify abs_grad, abs_grad_grad functor for windows building

* format code style

* fix the bug of result is nan when the divisor is zero

* add missing abs attr and add abs for float16

* unify calling cudaSetDevice

* fix compile

usleep function in <unistd.h> only takes argument less than 1,000,000. Current call can exceed this limit, we have to fix it. This PR can fix random CI error.

* optimize memcpy perf for kunlun

* remove useless unitest for kunlun mean

* minor

* - Added UT for testing elementwise_mul caching

* lint fixes

* Polish and Optimize the print/repr message of all layer

* fix some code format

PADDLE_RETRY_CUDA_SUCCESS used wrong sleep time so it can cause timeout in unittest. This PR fixed it.

After we searched the doc in https://pubs.opengroup.org/onlinepubs/7908799/xsh/unistd.h.html, the time unit of sleep in unistd.h takes "seconds", usleep takes "microseconds", Sleep in windows.h takes "milliseconds".

* flush denormals to zero, test=develop

* add comments, test=develop

* Support MIPS arch.

* enable bilateral_slice unittest on windows platform

* reduce max threads

* add support for complex grad accumulated

* add unittest for coverage

* update test dtype

* remove useless blank line

Add Retry Logic to CublasHandlerHolder to avoid random unittest failure.

* - Reimplemented elementwise_add grad

- lint

* - fix after review

* - Fix to fix after review

* Windows generate pdb and dump, for debug

* fix code style, test=develop

* modify cmakelist

Modify CublasHandleHolder from using PADDLE_ENFORCE_CUDA_SUCCESS to PADDLE_RETRY_CUDA_SUCCESS to fix random unittest failure. We checked that the unittest log showed CUDA allocation error at this file, which may due to GPU not enough. We fixed similar failure in the past, so we applied PADDLE_RETRY_CUDA_SUCCESS here.

* 添加rocm平台支持代码

* 修改一些问题

* 修改一些歧义并添加备注

* 修改代码格式

* 解决冲突后的代码修改

* 修改operators.cmake

* 修改格式

* 修正错误

* 统一接口

* 修改日期