* add dygraph parallel run interface

* polish implement & unified env property name

* add print config arg

* refactor init_parallel_env function

* Compatible with multiprocessing and launch modes

* set default trainer start port

* support run in python 2

* polish python2 support code

* remove python2 support

* refine launch import

* polish dome design details

* refactor api implemention & path

* use new method _set_expected_place

* add spawn unittest framework & mnist test

* add more unittests & doc

* fix unittest failed

* polish english doc

* self review and polish details

* refactor code by reviewer's comments

* fix unittest failed

* fix parallel_env unittest

* fix several typos

* fix error introduced when fixing typos

* add unpublic note for start_processes

* polish details by xiaoguang's comment

* verify correctly when spawn nprocs=-1

* refactor spawn & init_parallel_env design

* polish doc details

* open spawn unittests

* try to fix doc compile error

* try to fix unknown doc format error

* add skip unittest when not gpu

* [Dy2Stat] Add debugging and logging mechanism for dygraph to static. 

* Remove TransformerError temporarily. 

* import mock in PY2, from unittest import mock in PY3. test=develop

* Expose interfaces set_code_level and set_verbosity in paddle.jit, fix doc of the two interface. 

* polish doc of set_verbosity and set_code_level. 

* support 2.0 lr_scheduler for 2.0 optimizer

* fix unittest

* fix doc

* fix unittest

* fix sample code, fix unittest

* fix remainder, floordiv

For normalize op, remove special treatment of one-dimensional input, add check for one-dimensional input (#26747)

For normalize op, remove special treatment of one-dimensional input, add check for one-dimensional input

add parameters check in static mode for diag op 

* fix sample shape error

* Add unittest

* change assert_allclose to assert_equal

* Add unittest doc

* fix encoding problem

add broadcast feature for elementwise logical op

* Fix clip input check

* Fix default min/max value

* Allow both max and min to be None

* Register op change

* Revert OP signature change

* update the demo code and the doc of varbase.backward.

* update the doc of the fake interface `paddle.fluid.Variable`.

* remove BackwardStrategy.

* Add RNN related apis in paddl.nn
test=develop

* new rnn api, cell almost done

* add new progresses in rnn APIs for 2.0

* refine rnn APIs and docstrings.

* add unittets

* disable gpu tests when paddle is not compiled with cuda support

* remove unnecessary imports

* fix docstring

* add to no_sample wlist

* backport to python2 to avoid yield from

* add **kwargs, fix typos

* update docstrings for birnn

* rename argument for SimpleRNN and SimpleRNNCell, fix sample code

* add default value for initial_states in fluid.layers.birnn
Co-authored-by: Nguosheng <guosheng@baidu.com>

As the title

* Add the option to execute unit tests only at night

* set ut nightly label for 3 cases.

* add InputSpec

* add unittest for tensorSpec and SimpleNet

* add intepolte_v2

* fix linear interp

* polish unittest, test=develop

* update code samples to 2.0 API, test=develop

* remove warning, test_develop

* add name in attrs, test=develop

* polish code, test=develop

* change Align to align, test=develop

* fix unittest in py3,test=develop

* fix coverage, test=develop

* fix coverage, test=develop

* fix for windows ci, test=develop

* fix coverage, test=develop

* update doc, test=document_fix

* add attr(dtype)

* refine code

* API2.0 del old api(BilinearTensorProduct) from nn init.py, test=develop

* add import for deprecated, test=develop

* modify deprecated location, test=develop

* fix english doc, test=develop

* Update __init__.py

* Update __init__.py

* Update common.py

* fix english doc, test=develop
Co-authored-by: NChen Weihang <chenweihang@baidu.com>

* add TensorDataset. test=develop

* modified timeout value on windows and mac (#26690)

* add Local SGD algorithm referenced paper
test=develop

add collective op for cpu using gloo and paddle.distributed.* apis

* fix problems commented by Lutao

* rename _to_variable to _to_tensor

* fix unittest coverage

* little problem

* fix the tanh

* fix the learning rate