* 　add heter box

* add trainer, worker, wrapper...

* format

* for ci

* format

* remove boost get

* boost & copyright

* rename

* 　rename

* format

* format

* format
Co-authored-by: Nyaoxuefeng6 <yaoxuefeng@baidu.com>

* update condition of logger print

* - Tensor copy fix to oneDNN tensors

* - Fixes after review

* test=develop, optimize roll_op_cuda_kernel

* Using VisitDataTypeTiny and put CastOP after ReduceOP, test=develop

* remove changes of reduce_op.h, test=develop

* add conj op for complex types

* add conj for complex types

* add more test case

* add conj_op test

* modify conj api and impl

* add complex type for fill_constant_op xpu

* add setConstant for complex type

* remove complex conj test file

* user define grad for test_conj_op

* add test case for static mode of conj api

* modify conj doc

* change input args name to x

* remove useless codes

* conj support real types

* add conj test case for real number

* delete no need to calculate inputs in dygraph op_test

* delete no need to calculate inputs in dygraph op_test

* modify grad of mul for complex types

* fix the grads of inputs args order not match bug

* change the grad of div when complex types

* fix the grads of inputs args order not match bug

fix api link  for the any, all, isfinite

test=develop

* add nearest_interp_v2 on kunlun

* add nearest_interp_v2 on kunlun

* [ROCM] add rocm 3.5 and 3.9 dockefile, test=develop

* [ROCM] update rocm bin path, test=develop

* [ROCM] add dockerfile for rocm 3.5 amd 3.9, test=document_fix

* [ROCM] fix code stype failure, test=document_fix

* fix fleet for multi-stream

* fix memcpy for ncclid

* use sync to solve move operation

* Add approval for PR-CI-OP-benchmark, test=develop

* dont show token in log, test=document_fix

* merge amp related function in Momentum from paddle.fluid.contrib.optimizer into paddle.optimizer.

* Add unittest for 2.0  Momentum API.

* fix some bugs in weight_decay.

4 APIs: array_length, array_read, array_write, create_array

Add Retry Logic to CublasHandlerHolder to avoid random unittest failure.

* fix flops

* fix flops

[Dy2Stat] Fix bug for loop: a variable is used and created in loop, but used before created (#29769)

* add double grad for conv_transpose

* Test compilation time with less parallel count, notest, test=windows_ci

* optimize rules of Unity Build, notest, test=windows_ci, test=windows_op

* limit parallel counts used only on GPU, test=develop

* remove limit of argument /m:8 on Windows, test=develop

* - Reimplemented elementwise_add grad

- lint

* - fix after review

* - Fix to fix after review