* 12.3 first add metrics module

* add Mask/MultiTask

* add WuAUC

* [PSLIB] Update WuAUC Compute

* [PSLIB] Change WuAUC Compute Mehod

* [PSLIB] Clean WuAUC Compute

* [PSLIB] Clean Metric Module Unused Code

* mv metric instance

* [PSLIB] Add Metrics Module, Support User-defined Add Metric (#38789)

* [PSLIB] Add Metrics Module, Support User-defined Add Metric

* [PSLIB] Modify According to CI

* [PSLIB] Modify According to CI

* [PSLIB] Modify According to CI

* [PSLIB] Modify According to CI Coverage

* [PSLIB] Modify According to CI

* [PSLIB] Modify According to CI

* [PSLIB] Modify According to CI

* [PSLIB] Modify According to CI

* [PSLIB] Modify According to CI

* [PSLIB] Modify According to CI Coverage

* [PSLIB] Modify According to CI Coverage

* [PSLIB] Modify According to CI Coverage

* modify role_maker

* update CMakeLists.txt

* add n-d input support for trt scale converter (#31316)

* add n-d input support for trt scale converter

* add flatten for ut

* fix dims

* fix batchnorm when inpu dims < 3 (#31933)

* fix batchnorm when inpu dims < 3

* add unittest for batchnorm dims = 2

* fix unittest
Co-authored-by: NPei Yang <peiyang@baidu.com>

* fix conflict

* fix compile error

* cherry-pick #31316

* Refine cudnn softmax (#25757)

* refine cudnn softmax

* Trt elementwise plugin serialize (#31587)

* add serialize unittest

* fix element_op trt plugin serialize bug

* remove PassVersionChecker.IsCompatible

* fix unittest
Co-authored-by: NPei Yang <peiyang@baidu.com>
Co-authored-by: NGaoWei8 <53294385+GaoWei8@users.noreply.github.com>

* cherry-pick PR #27933

* fix: cuda version is in varibale CUDA_VERSION in 1.8 cuda.cmake

* close unittest failed temporarily

* cherry-pick PR #27544, fix layer_norm and softmax bug in tensorRT

* 裁剪transformer模型trt支持；修复tensorRT不支持DeletePass的bug (#28517)

* skip_layernorm_op done

* add unittest

* slice op convertor support trt < 6

* skip_layernorm only work in ernie

* fix unittest

* fix unittest

* Fix TRT plugin registry without TRT lib (#25982)

* fix trt plugin registry without trt lib

* support trt4

* refine code style

* pick ea851796 from develop

* cherry-pick develop PR  #26273 && #27796

* fix unittest error

* fix unittest error

* remove const_cast
Co-authored-by: NPei Yang <peiyang@baidu.com>

* cherry-pick:Add double grad in Squeeze and Unsqueeze to release/1.8, test=develop
Signed-off-by: NTeslaZhao <zhaolisoftware@163.com>

* cherry-pick:Add double grad in Squeeze and Unsqueeze to release/1.8, test=develop

* add matmul doublegrad op

* fix compile errors

* modify code according to review

* delete float16

* delete GetDimForInput to be consitent with release/1.8

[Cherry-Pick] Add Log double grad kernel (#27604)

 double grad support for abs 

* add batch norm double grad, test=release/1.8

* update, test=develop

* fix, test=develop

* optimize slice TRT plugin

This patch removes unnecessary barrier for data transfer of needed offset,
so data transfer can be overlap with GPU kernel execution.

This patch also fixes incorrect name of slice plugin. That is, replaces
"layernorm" with "slice"

test=develop

* add serialize/deserialize to slice plugin

* add static shape slice trt plugin

* fix slice trt op convertor dynamic shape bug

* fix format by clang-format

* fix pylint format error

* fix problems commented by peiyang
Co-authored-by: NRyan Jeng <rjeng@nvidia.com>
Co-authored-by: NShang Zhizhou <shangzhizhou@baidu.com>
Co-authored-by: NRyan Jeng <rjeng@nvidia.com>

test=release/1.8

* Fix test_gast_with_compatibility.py due to the problem of gast in python3.8 (#27433)

test=develop

* fix dll load bug on windows from python3.8 (#27324)

* Support python3.8 (#26850)

* Support python3.8

test=notest

* Replace the 'spawn' start method with 'fork' start method for multiprocessing, on MacOS with python>=3.8 (#27317)

* Replace the 'spawn' start method with 'fork' start method for multiprocessing, on MacOs when python>=3.8

test=develop

* Correct the error in decorator.py (#27409)

test=develop
Co-authored-by: NZhou Wei <52485244+zhouwei25@users.noreply.github.com>

* add DISTRIBUTED_TRAINER_ENDPOINTS env for cloud

* add double grad for expand, test=develop

* add double grad to reduce sum

* add mock barrier all (#24786)

* add mock barrier all
test=develop

* fix
test=develop

* fix
test=develop

* fix
test=develop

* fix gloo error
test=develop
Co-authored-by: Nxujiaqi01 <173596896@qq.com>

* fix dataset py3 (#25012)

* fix dataset py3 error
* test=develop

* fix logger (#24682)

* fix logger of FetchHandler，which may print log twice
* test=develop

* add timeout and http store in communication (#23436)

* add timeout and http store in communication, add revert and confirm in fleet
* test=develop

* modify datanorm op test=develop (#23030)
Co-authored-by: Nxujiaqi01 <173596896@qq.com>
Co-authored-by: Nyaoxuefeng <yaoxuefeng@baidu.com>

* fix prelu for compatibility with saved model of old version

* reshape alpha

test=develop
Co-authored-by: Nchalsliu <45041955+chalsliu@users.noreply.github.com>

* fix cpuid.h not found

* fix-jetson-compile-pyramid_hash

* add more info to version.txt, test=develop (#24551)

* Fix dygraph grad bugs (#25781)

* fix double grad visitid unit; test=develop

* change name hash_pair to HashPair; test=develop

* follow comment; test=develop

* remove manual seed; test=develop

* change create_graph from True to False; test=develop

* add scale_x_y for yolo_box, test=develop

* add scale_x_y for yolo_box, test=develop

* refine eps in iou_similarity, test=develop

cherry-pick,fix optimizer.state_dict and LRScheduler.state_dict to save/load dygraph

add new API:LambdaDecay,test=develop 

* enable load_program_state run in imperative mode; test=develop

* remove useless code; test=develop

* make default_collate_fn visible. test=develop. test=release/1.8

* test=release/1.8, cherry fix fluid.embedding

test=release/1.8

* CHERR-PICK1.8,add base class of LearningRateEpochDecay, and API: MultiStepDecay, and API: StepDecay,test=release/1.8

* fix unittest to add coverage,test=develop

* test=release/1.8, add index sample

* fix bug of prelu when rank not equal 4, test=develop

* fix prelu inference, test=develop

* fix api, test=develop

* fix shape when mode is chennel, test=develop

* remove debug code, test=develop

* add unittest, test=develop