* fix some bug

fix the CudaPinMemory bug for the equal op， add the branch for the CudaPinnedMemory

* fix typo for interp_v2,test=develop

* align with torch, test=develop

* add area mode, test=develop

* fix bug, test=develop

* format notes, test=develop

* update for converage, test=develop

* fix bilinear, test=develop

* fix bicubic, test=develop

* fix typo, test=develop

* fix coverage, test=develop

* fix helper.input_dtype, test=develop

* polish notes, test=develop

* polish notes, test=develop

* polish notes, test=develop

* - Added fix to mobilenet

* - compilation fix

* - Fix to conv2d grad oneDNN with groups

test=develop

fix cache judge more safe

support heter-xpu-ps

update the check for the dtype check for the argmin, argmax

cherry-pick from the develop PR#26792, fix the argmin, argmax

test=develop

* fix dropout bug in backward when input is 1d tensor, test=develop

* add test case and refine error message, test=develop

* refine error message, test=develop

fix pool trt plugin bug
test=release/2.0-beta

* fix fluid.embedding

* add embedding 2.0

* add embedding support input int32

* add check for bernoulli and register bool for unsqueeze

* follow comments

* refine cudnn softmax

* get use of global 'use_mkldnn' in layer_helper

* update for CI

* update for CI, relu test

* update for CI, relu test added, make FLAGS_use_mkldnn a public flag

* added more strict tests, fixes after review

* fixes after review

* fixes after review, CI stuff

* support trt dynamic shape int8

* add unittest

* add support for sigmoid; adapt to trt6+ api

update the doc for the some ops, ceil asin, atan

* Support Heter Parameter Server

* add doc; notest

* fix doc; notest

* update doc; notest

* refine optimizer && adam

* refine optimizer; notest

* add adam

* fix doc

* fix doc && add adamw; notest

* add error message

* bug fix

* refine rmsprop && adamax

* fix ci

* buf fix

* update comment

* unify arguments place; notest

* fix ut, test=develop

* bug fix

* fix conflicts, test=develop

* add examples code

* bug fix

* fix comments

* fix sample code

* add sample code for Optimizer

* add adamax ut, test=develop

* fix rmsprop ut, test=develop

* add ut for optimizer.py and adamw.py

* first commit of adadelta optimizer

* fix learning rate

* fix adadelta doc and add sgd momentum

* remove unused fluid

* fix codestyle

* Update test_adam_op.py

* Update test_adam_op.py

* fix SGD in 2 unittests

* fix SGD in 2 unittests

* fix ci

* fix ut
Co-authored-by: NMRXLT <xlt2024@gmail.com>
Co-authored-by: Nmapingshuo <mps2012@yeah.net>

* fix bug

* add version check

* fix docs, test=document_fix

* fix formula, test=document_fix

* refine paddle inference api
Co-authored-by: Nnhzlx <nhzlx.dragon@gmail.com>

* decouple weights and bias from fc primitive in cache

* removed reduntant update of pointers

Use `Tensor` instead of `Variable`  in the doc of paddle.grad.