* modify slice infershape

* code style

* modify slice_unittest

* temp fix

* batch_norm api move

* code_style

* codestyle

* ci_static

* add __init__

* reset other change

* revert .cc

* add import batchnorm

* conflict and revert

* fix bug

* fix third conflict one day

* fix conflict

* fix conflict bug

* fix conflict bug

* modify api

* code_style

* modify doc

* add lost doc stable

* fix conflict bug

* ci lack of gpu

* clean elem_arithmetic part2 unittest

* fix test_model_cast_to_bf16

* restore test_model_cast_to_bf16

* clear fluid apis in fleet and passes

* fix model.py

* fix model.py

* fix cpp_pass.py

* clear loss.py

* change test file

* fix some test_*.py

* fix adaround.py

* fix evaluator.py

* fix CI bug

* fix CI bug

* fix decode.py

* fix detection.py

* fix ci bug

* rm test_sigmoid_cross_entropy_with_logits_op_ipu.py and fix __init__.py

* fix ci bug

* fix ci BUG

* mv accuracy and auc

* rm distributions

* rm get_places

* replace metric

* update config

* re-blacken python code

* temporarily disable date and diff_py_file

* skip a format

* [CodeStyle] remove all future import

* revert test_error.py

* restore future import in example code

* change fluid.mean to paddle.mean

* reverse some old code examples

* tempfile_fix

* update

* fix_CI

* update_word2vec.inference.model

* remove_change_in_word2vec_book

* fix_word2vec_book

* use yapf to format all python file

* yapf exclude two unittests file for they rely on writing and reading file, and format will break them

* disable diff_py_file because too many diff files cause command following failed

* clip op extra information when export model,test=ocr

* rename clip_extra parameter to kwargs in save_inference_model, test=ocr

* add static.amp into setup.pu.in

* add unittest for api

* skip reader op in mixed_precision decorator

* add ut

* default open dygraph mode

* fix CI-Mac

* fix Mac-CI other unittest file

* fix CI-Py3

* fix test_communicator_geo and test_buffer_shared_memory_reuse_pass

* add enable_static to fix CI-Py3

* add enable_static to fix CI-coverage

* delete try except

* add custom black varname test=develop

* fix dtype test=develop

* fix num test=develop

* fix ut test=develop

* fix coverage test=develop

* fix blackvar names test=develop

Optimize amp for multi-gpu to enable FP16 gradients transfer across gpus

Fix float16 optimizer

init new amp, optimize inserting cast op for batchnorm

* remove unused inference_transpiler unit-tests

test=develop

* remove InferenceTranspiler usage in quantize_transpiler.py

test=develop

* Add LAMB optimizer

* Expose LAMB Optimizer's APIs

test=develop, test=document_preview

* Cleanup code & doc

test=develop, test=document_preview

* Update lamb optimizer's formula

test=develop

* init auto loss scaling

test=develop

* change API.spec

* change ifelse to switch and use reduce_sum to optimize checking isfinite

test=develop

* Remove redundant code

test=develop

* Init mixed precision training interface

* Add fp16 test script

test=develop

* All initializers support float16

test=develop

* Code cleanup & add more code annotations

test=develop

* Update API spec

test=develop

* Add usage example in doc

test=develop

test=develop

This reverts commit f5d5d7b2.

* Disable in_place in batch_norm API.

Fix str and bytes problem
Fix sorted problem
Fix math problem
Fix CI problem

* add test float16 inference accuracy example

* complete the test

* clean code

* add argument parse and refine tests

* add shell script

* add float16 benchmark code

* refine code

* prepare for contrib/float16

* put things in contrib float16 folder

* update benchmark result

* further update benchmark report

* add float16 inference report

* update report

* add float16 transpiler

* fix feed fetch target names mismatch

* fix cast op input change issue

* fix program desc flush error

* fix inconsistent var names in block desc bug

* code clean up

* add float16 infernce C++ example and fix prune bug

* remove share lod; it has already been performed in infershape

* slightly release test bound of test_image_classification

Fix a bug in save_inference_model and prune when the program is initailized by load_inference_model (#10011)

* Fix bug in save_inference_model and prune when the program is initialized by load_inference_program.

* Save the transpiled program instead.