* test=develop, optimize global_step

* refine doc of bernoulli

* fix some problems

* fix unsqueeze

* fix squeeze

* fix doc

* update, test=develop

* fix English doc for dice_loss, log_loss, unfold and NLLLoss API test=document_fix

* add early stopping

* add doc for early stopping

* fix sample code bugs

* update infer of mode, update doc, add unittests to increase coverage rate

* fix sample code for early stopping

* update sample code and unittests

* reduce time cost of test_callbacks unittest

* fix model.py code style error

* update hapi save_inference_model output pathname

* update hapi save_inference_model output pathname

* use new 2.0-api paddle.static.io.load_inference_model

* add unittests to increase coverage rate

* ps gpu transpile

* ps gpu

* remove op

* gps trainer

* local ps

* add macro

* HeterBox

* def cuda

* tab

* code style

* style

Co-authored-by: Thunderbrook <a754913769#163.com>

* refactor momentum op to combine weight_decay (scale op and sum op)

fix error for Can not find test to add properties to:test_parallel_dygraph_transformer,test_parallel_dygraph_sparse_embedding (#28968)

* optimize conv performance

* add lr scheduler

* fix conv_transpose unittest. test=develop

* fix dataloader. test=develop

* fix param base trainable set failed

* add unittest

* fix typo

* polish comment

Adding uint8 support for squeeze operator.

* test=develop, bug fix for embeddings padding

* fix raise Value for Embedding

Change-Id: I6d343fceee369a5796ad59cca5c91fdd15429125
Co-authored-by: NseiriosPlus <tangwei12@baidu.com>

* fix code example, test=document_fix

* Add bf16 matmul, fc, elementwise add and mul

* Correct unit test

* Fix wrong out dtype from helper.input_dtype

* add unittest

* remove disable_static in op_test

* fix param name typo

* 1.add xpu slice op 2. add xpu top_k op 3.modify xpu cast to new api

* 1.add xpu slice op 2. add xpu top_k op 3.modify xpu cast to new api

* add lstm, simple rnn op kernel

* fix the test_lstm for the rnn op

* change func name

* fix forward postprocess bug

* add gru forward, backward code

* remove unittest.skipIf; use a big rnn op instead of combination op

* fix input doesn't have gradient bug

* add eigen lstm forward, backward
Co-authored-by: Nwawltor <fangzeyang0904@hotmail.com>

* adjust kunlun header file
*test=kunlun

* update kunlun unittest
*test=kunlun

* update xpu unitest
* test = kunlun

* update xpu unittest
* test=kunlun

* update xpu unitest
* test=kunlun

* fix pool exclusive and delete disable_static, test=develop

* fix pool1d  exclusive, test=develop

* fix pool APIs en doc, test=document_fix

[Dynamic-to-Static] Fix bug in loop_transformer: loop vars should contain the var from ancestor-for-node (#28735)

* Add multi_gru op and tests

* removed redundant disable_dygraph()