* open unittests on windows

* open GPU unittest on windows

* fix clip by norm eng doc. test=develop

Add support for using tuple as tensor.shape (For example: a, b, c, d = x.shape)

* add lamb optimizer and unittest

* fix lamb

* fix lamb v2 op

* fix sampling id

* fix lamb sample code

* Update lamb.py

* fix doc

* fix doc

* Update lamb.py

* upgrade comment string to raw string

* fix string in

* fix string with ' '

* revert update on comments

* upgrade only necessary

* fix sample code checker

* fix comments with '''

[Dynamic-to-Static] Fix bug of convert_logical_and/convert_logical_or: the operands are executed sequentially(#28993)

  
  1) The operands are executed sequentially according to the running logic of Python.
  
  2) If the left hand operand is True(for convert_logical_or)/False(for convert_logical_and), the right hand operand should be executed.

The PR description is long. See details in the PR link.

* fix eng doc, test=develop

* add import deprecated for layers, test=develop

* add block line for doc generate, test=develop

* remove todo for create_variable, test=develop

* add blank line for doc generate, test=develop

* add blank line for doc generate, test=develop

* Add multi_gru_seq_fuse_pass and tests

* fix date

* removed unused functions

* Fix en doc for rnn.py. test=document_fix

* Delete mq2007 dataset.

* polish dataloader doc detail, test=decument_fix

* fix commnet error

* fix word error

* test=develop, optimize global_step

* refine doc of bernoulli

* fix some problems

* fix unsqueeze

* fix squeeze

* fix doc

* update, test=develop

* fix English doc for dice_loss, log_loss, unfold and NLLLoss API test=document_fix

* add early stopping

* add doc for early stopping

* fix sample code bugs

* update infer of mode, update doc, add unittests to increase coverage rate

* fix sample code for early stopping

* update sample code and unittests

* reduce time cost of test_callbacks unittest

* fix model.py code style error

* update hapi save_inference_model output pathname

* update hapi save_inference_model output pathname

* use new 2.0-api paddle.static.io.load_inference_model

* add unittests to increase coverage rate

* ps gpu transpile

* ps gpu

* remove op

* gps trainer

* local ps

* add macro

* HeterBox

* def cuda

* tab

* code style

* style

Co-authored-by: Thunderbrook <a754913769#163.com>

* refactor momentum op to combine weight_decay (scale op and sum op)

* add musl docker build script

* rm space test=document_fix

* fix some docs and types errors test=document_fix

* move install of python requirement to docker build

* add copyright to docker file.

* add extr opts

* format docs

fix error for Can not find test to add properties to:test_parallel_dygraph_transformer,test_parallel_dygraph_sparse_embedding (#28968)

* change avg pooling and global pooling to trt layer

* add support for static shape global pooling

* modify trt errmsg

* optimize conv performance

* add lr scheduler

* fix conv_transpose unittest. test=develop