* Simplify multi_box_head API in detection.py and remove assign op.

BackwardStrategy
dygraph.nn
dygraph.checkpoint

*  add cuda_is_available
test=release/1.5

* update pe reduce config
test=release/1.5

*  drop the local_exe_scopes of the previous parallel_executor
test=release/1.5

Socket can't be pickled.

test=release/1.5

* test=release/1.5, add mutigpu install check

* test=develop, refine code to use cuda_devices

* sequnce mask support max length tensor input; test=develop

* add rnn_impl.py; test=develop

* add basic gru lstm unittest; test=develop

* fix api spec; test=develop

* fix sequence_mask op bug;
test=develop
test=document_preview

* change +-*x to elmentwise_op; test=develop

* add mkl flag; test=develop

* fix rnn impl bug; test=develop

* update api spec; test=develop

* fix doc bug; test=develop

* fix lstm bugs; test=develop

test=release/1.5

* Fix the GetExpectedKernelType of add_position_encoding_op.

* Fix the doc of lstm_unit outputs in nn.py.

test=release/1.5

* fix paddle cloud role maker bug

* Revert "Cherry pick install check for multi gpu (#18245)"

This reverts commit d0219002.

* test=release/1.5, ci start

* fix default value of fluid.memory_optimize
test=release/1.5

cherry-pick for #18293

add dygraph api doc for fluidDoc and api spec

* fix slice op bug; test=develop

* fix variabel test bug; test=develop

* remove slice while true; test=develop

test=release/1.5

* refine core cmake warning and print more info
* fix comments

test=release/1.5

* test=develop, add add_multi_gpu_install_check (#18157)

* test=develop, add add_multi_gpu_install_check

* test=develop, refine warning doc

* test=develop, refine warning doc

* test=develop, refine warning doc

* test=develop, support multi cpu

* test=release/1.5, cherry-picked from develop

* update some op doc, test=release/1.5

* fix relative import error in python3
* fix debug string info

* fix_create_lod_tensor, test=release/1.5

* remove program_guard import,test=release/1.5

* fix windows numpy default int32 error, test=release/1.5

* Update backward appending stragety to support double backward and fix some bug. (#18104)

* Update backward.py:
     - If there is no input grad var in all outputs of previous ops, do not append this op into graph.
     - Only apply this stragety when double backward.
* Update some double backward op.
* Update sum_op to judge whether a tensor is empty by numel or IsInitialized().

* add mkldnn Int8v2 slim doc (#17909)

* Change int8v2 CAPI unit test name and add log in the prediction stage (#18200)

* fix issue 18111;test=develop

* fix timer;test=develop

* refine code;test=develop

* test=release/1.5

* add multi process reader
test=release/1.5

* fix save/load in fleet (#17675)

* fix save/load in Fleet
* add UT framework of Fleet (#18058)

* add paddle cloud role maker for customized usage, note this is only for industrial users that have cloud environment pre-configuration (#18121)

add paddle cloud role maker for specific cloud usage. This pr will simplifies user's configuration in distributed training.

* assign role_maker before use (#18137)

* [Cherry-pick] change dirname mobilenet to mobilenetv1 (#18160)

test=release/1.5

* [Cherry-pick] update mkldnn int8v2 doc (#18177)

test=release/1.5

* cherry pick refine core warning message (#18063)

* cherry pick core replace x86cpu with py cpuinfo (#18151)

test=release/1.5

Cherry pick retinanet_target_assign_op(#17893), sigmoid_focal_loss_op(#17895) and retinanet_detection_output_op(#17896) for supporting retinanet (#18141)

* test=release/1.5
Fix conflicts in test_layers.py when adding target assign operator for supporting retinanet. Cherry pick #17893

* test=release/1.5
Add sigmoid focal loss operator for supporting retinanet. Cherry pick #17895

* test=release/1.5
Add detection output operator for supporting retinanet. Cherry pick #17896

* test=release/1.5
fix wrong code style in test_layers.py when cherry pick retinanet_target_assign #17893

* test=release/1.5
Fix type error of std::pow in sigmoid_focal_loss. Cherry pick #17895

* fix logging unable. test=develop

* unset sys.stdout for stream handler. test=develop

* fix newly add basicConfig. test=develop

* fix import error. test=release/1.5

* remove nccl dep when the number of GPU is 1
test=develop

* use multi card run syncBN
test=release/1.5

Add cascade rcnn support.

Cherry pick #18077 and  #18111 unify FP32 vs. INT8 comparison tests output, reuse C-API INT8 unit test application (#18145)

* unify FP32 vs. INT8 comparison tests output (#18111)

test=release/1.5

* reuse C-API INT8 unit test application (#18077)

test=release/1.5

* fix get items slice bug; test=develop

* fix unique_name bug; test=develop

* fix dygraph mem leak, test=release/1.5

* polish msg, test=release/1.5

cherry pick for deform roi pooling

* add UserDefinedCollectiveRoleMaker for collective mode (#17898)

cherry-pick for (https://github.com/PaddlePaddle/Paddle/pull/17402)

Add Pipeline Concurrency Train Mode:
- Cpp: pipeline_trainer & section_worker
- Python: PipelineOptimizer
- Add a new data_feed type: PrivateInstantDataFeed
- Add a test demo of pipeline trainer and the test model is gnn
- Do not support win32 now