* finish task

* fix some question.

* fix error

* change unittest:zeroDim.

* rename flash_attn_raw to flash_attn_unpadded

* fix static api

* fix static return

* update env setting

* update pass logic

* dist op support bf16

* backward cast update

* update setting

* update backward

* revert amp pass

* update fp16 backward logic

* register c_embedding bf16

* revert engine

* add unitest

* add unitest

* update unitest

* update cmake

* update math

* update math.py

* update unitest

* update unitest

* revise unitest

* revise unitest

* update unitest

* update unitest

* update unitest

* update rnn.py

* update common.py

* update rnn.py

* update common.py

* fix CI

* support to_static for SpectralNorm

* support amp logic for layer_norm and softmax

* fix layer_norm amp

* fix layernorm api and dropout fp16

* fix layernorm api and dropout fp16

* fix bn, ln dtype in float16

* fix dropout fp16

* fix comment

* fix docs 第七轮第一组

* fix docs 第七轮第一组

* move fluid.utils to paddle.utils.layers_utils

* fix error

* delete original fluid layers utils

* remove import and old utils

* remove more old utils import

* change import path of fill_constant in the layers_utils.py

* fix mistake

* fix error

* expose in __init__.py

* for comment

* when change the ref of func is_sequence, it should change to the root of is_sequence instead

* for codecheck

add comment.

Fix the quotation mark format problem in PixelShuffle document

* add float16 to pixel_shuffle

* update

* update

* update solve PR-CI-Kunlun-R200-Test

---------
Co-authored-by: Nwqgo <1552367872@qq.com>

* fluid clean: remove dygraph_utils._append_bias_in_dygraph

* fix func name and imports

* flash attn

* seed

* almost

* softmax

* fix workspace

* add unitest; linux only

* fix setup

* fix datatype include

* fix setup typo

* fix def scope

* new error api

* use paddle fork

* fix attr bug; complete ut

* update flash hash

* fix rng reset

* fix offset

* fix comments

* support fp16 on LocalResponseNorm

* add docs in avgpool3d

* add unittest for nn.DropOut2D

* add fp16

* add fp16 in docs of temporal_shift_op.cc

* Update test_dropout_op.py

Unify the digital presentation of rrelu's English and Chinese Documentations.

Modify `Parameters` section of `rrelu` `s default `lower` value from `1.0 / 8.0` to `0.125`.

Modify `Parameters` section of `rrelu` `s default `upper` value from `1.0 / 3.0` to `0.3333333333333333`.

* Fix fp16 dtype checking for AvgPool1D op

* Update code style for PR-CI-Static-Check

* support fp16 on AvgPool3D

* Apply suggestions from code review

* change amp with to_prim

* fix prim amp

* fix rules

* fix liear

* add amp test

* add test

* disable this test on cpu

* disable this test on cpu

---------
Co-authored-by: Ncyber-pioneer <chenzhuo@tju.edu.cn>

Add PTQ and exporting function
1. Add Post-Training Quantization
1.1 Abstract some functions from QAT to Quantization class
1.2 Add Post-Training Quantization by extending Quantization class
1.3 Add observers for PTQ
1.4 Add unittest for PTQ
2. Add exporting function for QAT and PTQ

* 为split增加取值范围维度的判断

* 为glu的axis进行取值判断并添加单测

* 完善glu的单测

* fix glu

* add upsample 0d test

* update api references

* update api references

* update api reference