* Speed GEO-SGD (#20158)

* delete debug vlog & add rpc function & fix word2vec bug & speed GEO-SGD

* Add lod_level parameter to paddle.fluid.data

* Add "optional" in API doc for optional parameters

Heartbeat for distributed async training.

* test=develop, fix docker with paddle nccl problem

* test=develop, Add Variable api and refine dygraph related API

* test=develop, Add Variable api and refine dygraph related API

* test=develop, refine test for new api and error info

* test=develop, refine error info and test_layers

* test=develop, add API.spec

* test=devleop, fix to_string python2 and python3 compat error and refien doc

* test=devleop, add API spec

* test=devleop, update API spec

* test=devleop, update API spec

* test=develop, invoke ci

* test=develop, fix example code

* test=develop, update API spec

* test=develop, fix auto_prune_error_on_leaf

* test=develop, fix auto prune error on loss stop_gradient

* test=develop, remove useless error check

* test=develop, add more ut for sorted gradient

* Update crf_decoding api & example

* Update api spec

* Fix linear chain crf api

* Avoid sharing data pointer with input

* Simplify the logic in linear_chain_crf_decoding

* Add unittest for crf_decoding when label & path both are set

* Update API spec

* Add unittest for layers && correct infer_shape in chunk_eval

test=release/1.6

test=release/1.6

* Add multihead op for ernie opt

* Refine softmax

* Refine kernel.

* Refine cuda kernel

* Refine cuda version

* Refine cmake

1.support asymmetric padding;
2.support padding algorithm:"SAME" and "VALID";
3.support channel_last: data_format NHWC and NDHWC;
4.change doc of python API and c++;

test=release/1.6

* refector geo sgd & communicator

* add a default value for _prune interface

* modify document

* refine doc, test=document_fix

* add API.spec,test=develop,test=document_fix

* How to write custom op needs to follow framework OP spec.
* Package fluid_framework.so and headers into whl.
* Add paddle.sysconfig.get_include() and paddle.sysconfig.get_lib() to get include dir and lib dir.
* Export some C-APIs to merge OpInfo between core.so and custom_op.so.
* Add unit testing.
* Update API.spec.

* test=develop, argument shape support tensor and tensor in list

* test=develop,Increasing the coverage of CI tests

* test=develop, modify the document and update API.spec

* test=develop, modify the doc and update API.spec

* test=develop, modify the doc and update API.spec

* test=develop, modify the interface of UniformInitializer

* test=develop, modify the interface of XavierInitializer and MSRAInitializer

* test=develop, modify based on review's comments

* test=develop, modify based on review's comments

*  test=develop, modify based on review's comments

* fix pool2d pool3d:
1. support asymmetric padding;
2. support padding algorithm:"SAME" and "VALID";
3. support channel_last: data_format NHWC and NDHWC;
4. support inferring shape when input with negative dims in compile time;
5. change doc of python API and c++;
6. fix bug in cuda kernel when Attr(adaptive) is true.

test=develop,test=document_preview

* fix 'tensors' to 'Tensors'. test=develop,test=document_preview

* add test for converage ValueError.test=develop,test=document_preview

* resolve conflict in test_pool2d. test=develop

* opt FC

* opt rest of dygraph.nn

* new param shape check and unittest

* add kwargs for Layer

* add new set_value api

* use property decorator

* update API.spec, test=develop

* use UserList, separate gettersetters, test=develop

* update test_custom_layer_with_kwargs, test=develop

* fix UserList compatibility, test=develop

* fix UserList compatibility, test=develop

* keep FC._w, test=develop

* add unittests, Conv3D bug fix, test=develop

* clean code, test=develop

* fix dygraph guard in unittest, test=develop

* add property setters, remove unused param in tracer, test=develop

* tracer none check, test=develop

* merge, test=develop

* refine, test=develop

* bug fix in  prelu and conv3d_transpose, test=develop

* rm __set__, test=develop

* set tensor value instead of assign op

* fix property setter call, test=develop

* fix api.spec, test=develop

* fix doc sample, test=develop

* Follow Wangzhen's comment in PR 18970, test=develop

* Review comments, test=develop

* Leave fake quantization around mul

test=develop

* Replace Fake with Real Quantized Mul

test=develop

* Fix bug in quantize placement pass

Nodes in the graph now have checked type instead of node name when they are to be marked for quantization test=develop

* add parameter shape check when load parameter from file; test=develop

* fix test error; test=develop

* add wrong shape check; test=develop

* remove useless code; test=develop

* add testcase setup

* add teardown, remove temp model_path; test=develop

* add clean process; test=develop

* update operator compatible info, test=develop

* revert cmake/version.cmake, test=develop

* add unit_tests and fix bugs, test=develop

* update ../paddle/fluid/framework/framework.proto, test=develop

* fix bug of paddle/fluid/inference/api/analysis_predictor.cc, test=develop

* update paddle/fluid/framework/version_test.cc, test=develop

* add comments and rename interfaces, test=develop

* fix en docs of apis, test=develop, test=document_fix

* follow chunwei's comments, test=develop

* test=develop, fix docker with paddle nccl problem

* test=develop, Add Variable api and refine dygraph related API

* test=develop, Add Variable api and refine dygraph related API

* test=develop, refine test for new api and error info

* test=develop, refine error info and test_layers

* test=develop, add API.spec

* test=devleop, fix to_string python2 and python3 compat error and refien doc

* test=devleop, add API spec

* test=devleop, update API spec

* test=devleop, update API spec

* test=develop, invoke ci

* test=develop, fix example code

* test=develop, update API spec

* test=develop, add compat test and fix inplace campat dict error

* fix pool infershape. test=develop

* fix unittest converage. test=develop

* fix format. test=develop

* make pad and split support fp16
test=develop

* add a base class for the Communicator
* add AsyncCommunicator Impl for async distributed training

Refine document of DGCMomentumOptimizer

Polish English docs of elementwise_add/sub/mul/div

* shape and optimize paddle error message stack, test=develop

* limit exception type & add unittest, test=develop

* fix multi-platform problem, test=develop

* fix related unnitest failed, test=develop

* add doc & fix unittest errors, test=develop

* fix function name error, test=develop

* update tensor test exception msg compare, test=develop

* remove unittest on win32, the dir format is different, test=develop

* remove useless package, test=develop

* add paddle enforce handler unittest, test=develop

* add exception checkout, test=develop

* fix coverage failed, test=develop

* fix op registry test failed, test=develop

* refactor whole pr, test=develop

* remove test in CMakelist, test=develop

* fix coverage, test=develop

test=develop
Signed-off-by: Nzhaoyuchen <zhaoyuchen01@baidu.com>

Set output type LoDTensor only

After code experiment, I found data doens't support other type

* fix DistributeTranspilerConfig document, test=develop

* Make PaddleSlim support PyReader.
* Fix unittest of sensitive pruning.
* Add some assert.

* impove error message when passing ndarray with object dtype

* imporve message format

* change assert to raise TypeError

* remind user how to locate the irregular data instead of printing

* add unittest for input array type check

* Fix conv2d+dequantize squash for residual fusion

test=develop

* Correct int8 input

test=develop

* Add if exclude or include padding in pool2d mkldnn

test=develop

* x.dims == y.dims test=develop

* refine comment

* Expose `mutable_data` as python binding

test=develop

* Add test for device pointer binding

test=develop

* Make test compatible with python 2