* add matmul doublegrad op

* fix compile errors

* modify code according to review

* delete float16

* delete GetDimForInput to be consitent with release/1.8

[Cherry-Pick] Add Log double grad kernel (#27604)

 double grad support for abs 

* add batch norm double grad, test=release/1.8

* update, test=develop

* fix, test=develop

* optimize slice TRT plugin

This patch removes unnecessary barrier for data transfer of needed offset,
so data transfer can be overlap with GPU kernel execution.

This patch also fixes incorrect name of slice plugin. That is, replaces
"layernorm" with "slice"

test=develop

* add serialize/deserialize to slice plugin

* add static shape slice trt plugin

* fix slice trt op convertor dynamic shape bug

* fix format by clang-format

* fix pylint format error

* fix problems commented by peiyang
Co-authored-by: NRyan Jeng <rjeng@nvidia.com>
Co-authored-by: NShang Zhizhou <shangzhizhou@baidu.com>
Co-authored-by: NRyan Jeng <rjeng@nvidia.com>

test=release/1.8

* Fix test_gast_with_compatibility.py due to the problem of gast in python3.8 (#27433)

test=develop

* fix dll load bug on windows from python3.8 (#27324)

* Support python3.8 (#26850)

* Support python3.8

test=notest

* Replace the 'spawn' start method with 'fork' start method for multiprocessing, on MacOS with python>=3.8 (#27317)

* Replace the 'spawn' start method with 'fork' start method for multiprocessing, on MacOs when python>=3.8

test=develop

* Correct the error in decorator.py (#27409)

test=develop
Co-authored-by: NZhou Wei <52485244+zhouwei25@users.noreply.github.com>

* [Paddle-TRT] Stack op plugin (#25605)

* add stack_op to CMakeLists

* add dim=3 support for scale op

* add trt stack op, test=develop

* remove debug message

* add stack plugin serialize

* remove slice, scale op, will add later

* enhence error message

* revise trt ernie test to conver the stack op CI testi, test=develop

* add stack op serialization

* fix test shape after adding stack op

* remove slice op, will add after implementing serialization

* roll back to min_graph=5 to avoid using slice op

* fix scale op output layer

* implement stack op createPlugin

* use workspace and move the defination to .cu

* move stack plugin creator definition to .cu, test=develop

* sync ut with develop
Co-authored-by: Nzlsh80826 <zlsh80826@gmail.com>

* fix multihead matmul shared params (#27121)

* fix multihead matmul shared params

* add DISTRIBUTED_TRAINER_ENDPOINTS env for cloud

test=develop

* add double grad for expand, test=develop

* add double grad to reduce sum

* delate some wrong message test=develop, test=document_fix

* delate some wrong message

cherry-pick fix cvm check
test=develop
Co-authored-by: N123malin <malin10@baidu.com>

* fix eigen in push sparse; fix hadoop command
test=develop

* add log in load_combine_op
test=develop

This commit fixs the compiling bug regarding unique_ptr of IOptimizationProfile.

IOptimizationProfile has protected dtor and is controlled by TensorRT
internally. Application shouldn't delete the pointer of IOptimizationProfile.
See TensorRT document: https://docs.nvidia.com/deeplearning/sdk/tensorrt-api/c_api/classnvinfer1_1_1_i_builder.html#a9ac47e100454151d8206ac91d543299a
test=develop
Co-authored-by: NJeng Bai-Cheng <jeng1220@users.noreply.github.com>

* mod cvm test=develop

* mod code format test=develop

* add mock barrier all (#24786)

* add mock barrier all
test=develop

* fix
test=develop

* fix
test=develop

* fix
test=develop

* fix gloo error
test=develop
Co-authored-by: Nxujiaqi01 <173596896@qq.com>

* fix dataset py3 (#25012)

* fix dataset py3 error
* test=develop

* fix logger (#24682)

* fix logger of FetchHandler，which may print log twice
* test=develop

* add timeout and http store in communication (#23436)

* add timeout and http store in communication, add revert and confirm in fleet
* test=develop

* modify datanorm op test=develop (#23030)
Co-authored-by: Nxujiaqi01 <173596896@qq.com>
Co-authored-by: Nyaoxuefeng <yaoxuefeng@baidu.com>

* fix prelu for compatibility with saved model of old version

* reshape alpha

* add macro check for using TRT api dynamicRangeIsSet() (#25694)

* adjust minimum trt version for hard_sigmoid converter to 5130. test=develop (#24746)

* fix bug
bug fix

Co-authored-by: NTao Luo <luotao02@baidu.com>