* move dygraph amp api to paddle

* refine code and add unit test

* add visualdl callback

* add multinomial cpu kernel

* fix C++ notype error

* fix windows ci array len error

* let array len be const

* change array to vector

* add cuda kernrl with num_distribution is 1, and not support replacement=False

* add multinomial python api

* support num_distribution different multinomial distributions

* add categorical class

* fix test_distribution enable_static error

* add unittest for different setting of Categorical

* optimize format

* little change

* little change

* add raise error if shape not match, optimize format

* fix windows CI dtype error in concat

* little changes

* little changes2

* change values type to int64

* change values type to int64

* change values type to int64

* Add test_resnet_v2.py test=develop

* refine grid_sample and temporal_shift

* fleet support non_distributed training in dygraph mode; test=develop

* add double grad for expand, test=develop

* add xpu test

* notest;add kunlun_test

* notest;add kunlun_test

* notest;test=kunlun

* notest;test=kunlun

* notest;test=kunlun

* notest;test=kunlun

* test=kunlun

* remove input requirment in dygraph Model

* correct unittest

* upadte save inference model in dygraph without input

* fix unittets for test_model.py

* solve conflicts

* solve conflicts

* delete http.log

* fix test_model.py bug, correct initialization of MyModel

* fix unittests bugs

* set paddle manual seed for unittest

* fix Model bugs, because inputs can be list or dict when it is provided.

* add random seed for test_export_deploy_model

* delete redundant codes, because  calls

* Code optimization, error information optimization

* fix distributed error info

* bug fix; notest

* error info refine

* update error info

* update error info

* update error info

* bug fix

* bug fix

* bug fix

* bug fix

* update 2.0 API for dice_loss and log_loss test=document_fix

* fix test_se_resnet unittest

* fix test_se_resnet unittest

* add comments for decresing test_se_resnet precision

* fix the scatternd/scatterndadd

* fix the doc of scatter

* replace rank with ndim

As the title

* migrate code example and doc

* add multinomial cpu kernel

* fix C++ notype error

* fix windows ci array len error

* let array len be const

* change array to vector

* add cuda kernrl with num_distribution is 1, and not support replacement=False

* add multinomial python api

* support num_distribution different multinomial distributions

* add multinomial python api unittest

* change output dtype to int64

* fix coverage prob

* optimize format

* fix dtype of output error, should be int64_t

* add pip new requirements to windows

* Increase the conditions that restrict system installation

* increase tolerance

* increase the difference between low and high

* change tolerance of Normal log_prob method

* change probs tolerance to 1e-4

* change tolerance of Normal kl method

* fix reg

* fix code example and doc

* remove disable_static

* fix doc

* fix l2decay

* test=develop, optimize geo communicator 

* remove data parallel scale loss & apply collective_grads

* move apply in minimize

* fix failed unittests

* polish Program api doc & example

* polish CompiledProgram api doc & example

* polish ParallelEnv api doc & examples

* polish details, test=document_fix

* polish program doc details, test=document_fix

* polish details, test=document_fix

* fix note format error, test=document_fix

* add lost example, test=document_fix

* fix lost example, test=document_fix