* clear 'BasicEngine' when an exception occurs in the backward. (#32546)

* clear 'BasicEngine' when an exception occurs in the backward.

* deal with conflict.

* deal with conflict.

* forward return any type. (#32661)

* revert data_generator

* add setup.py

cherry-pick:change softmax_with_cross_entropy_op's parameter name from softmax_switch to use_softmax (#32750)

* change parameter name from softmax_switch to use_softmax, test=develop

* cherry-pick:change parameter name from softmax_switch to use_softmax, test=develop

avoid polluting logging's root logger

* add to_grayscale, normalize

* add rotate

* add vfip and hflip

* add crop center_crop

* add utils

* add utils

* update utils, add raise for some cases

* add padding, support constant, reflect, replicate, circular same as paddle.pad

* update rotate

* using utils func in [v|h]flip

* add get-image-[n,c,w,h] axis utils

* add get-image-[n,c,w,h] axis utils

* align

* update

* remove default value in utils func

* add assert for pad

* update assert paddle image

* support rotate fill func

* raise valueerror for pad

* remove typing, py2 dont support

* init uinttest for transforms tensor

* add resize op

* register [normalize hflip crop center_crop resize transpose] imagenet

* register [normalize hflip crop center_crop resize transpose] imagenet

* fix bugs, (w, h) getter and import

* add _get_image_size for tensor image

* add pad vflip for tensor image

* add unittest for tensor transforms

* update transforms unittest for converage CI probelms, test=develop

* update

* update

* update

* fix `get_shape` for tensor backend

* update

* update

* add more resize tests

* update

* update for ci test

* update

* remove redundancy code

* update uinttest, and set tensor image to hwc by default

* add tensor backend

* fix copyright doc, rm comment code, add pil unittest

* update data_format to `chw` for tensor

* coverage notest,test=coverage

* update

* update

cherry-pick #32561

Dy2stat failed when user writes return paddle.to_tensor(xxx), the reason is that visit_Expr doesn't work when the Expr is in return. Some other statements may trigger same bug. To fix it, we re-wrote a transformer to transform paddle.to_tensor to paddle.assign for all Call nodes.

* update, test=develop

* add relu6_ hardsigmoid_ leaky_relu_ Inplace APIs

* add softmax_with_cross_entropy_ Inplace API

* add clip_ scale_ add_ subtract_ Inplace APIs

* add wlist

* fix parameter of scale api

* add add_n_ Inplace API and remove log_ Inplace API

* fix elementwise_add_ and elementwise_sub_ broadcast problem

* elementwise inplace api give error message before run the op

* use broadcast_shape in elementwise inplace op

* add 8 inplace apis that is auto generated

* add unittest for all inplace apis

* add decorator for inplace apis in static mode

* fix windows blas fail of exp inplace api, change array_equal to allclose

* add flatten inplace api

* add flatten unittest

* fix flatten unittest

* add decorator

* fix grad.numpy in test_pylayer_op

* unsupport softmax_with_cross_entropy_

* add test_inplace_softmax_with_cross_entropy to static_mode_white_list

* delete __all__ in inplace_utils

* delete activation inplace function and add Tensor.inplace_func

* change paddle.inplace_ to Tensor.inplace_

* fix little problem

* add paddle in inplace_utils

* add op read_file and decode_jpeg

* Add bf16 uniform random initializer

* Remove duplicated section

* Change UT to CPU place only

* Put detail functions into anonymous namespace

This is cherry-pick of #32281

* add fake interface for hook in static mode

* add unittests

* fix failed unittests

* jit.save/load support function.

* delete unnittest test_jit_load_model_incomplete.

* edit code according to CI

* Modify the documentation.

* add note to doc.

* edit paddle.save/load API

* Update io.py

edit doc

* delete cpython-37.pyc

* Update io.py

edit doc

* Update io.py

recommit

* Update io.py

recommit

* Update io.py

recommit

* Update io.py

recommit

add __all__=[] to python files not in API public list; import * only support in API public list files (#32644)

Co-authored-by: NXiaoguangHu <46782768+XiaoguangHu01@users.noreply.github.com>
Co-authored-by: NXiaoguangHu <46782768+XiaoguangHu01@users.noreply.github.com>

* update 2.0 public api in nn

* replace Chinese character cause error in ci;synchronization with pr:#32588 to avoid 'ascii' codec in python2

* numbers used in paddle.nn.functional.norm but not imported

* fixed docs.

* Fixed docs. test=document_fix

code bak.

fixed docs. test=document_fix

* Revert to previous version of python/paddle/fluid/backward.py

* fixed bugs.

* test=document_fix. Fixed examples.

* fix cross_entropy calculation error

* add unittest and fix static

* Support list and tuple for parameters of layer_norm, multiprocess_reader, DatasetFolder and ImageFolder.

* add unittest for layer_norm.

* add require gpu for example.

This reverts commit 4b7242b0.

* fix amp bug

* fix name of wordsize

* add sendrecv, test=develop

* optimize pull sparse

* optimize pull sparse

* change macro

* format