* [MLU]: add mean and reduce mean op

* [MLU]add mlu pytest dir in CMakeLists.txt

* [MLU]fix tensor data

* [MLU]fix TensorToPyArray and license

[NPU] fix tril_triu

* [NPU] fix expand op

* [NPU] optimize codes

* [NPU] optimize codes

roi_align aligned supported

* base changes for mul reimplementation

* empty commit

* tmp save

* full implementation of mul bf16/fp32 fwd bwd

* CI fix

* CI rerun

* changed unity build cmake to avoid gpu issues

* removed mul mkldnn from unity build

* added skipping tests if not cpu_bf16

* CI fix

* CI fix

* CI fix

* fix mkldnn invalid infershape

* add unittest for mkldnn in new executor

* add import os

* Support test_imperative using_non_zero_gpu and Add a TODO comment

* Change GPU number to 0

* Modify the cuda device selection method

* fix conv act int8 scale

* add unit test for conv+hard_swish

* support 5d for nearest

* update nearest3d unittest, test=develop

* fix approve ci, test=develop

* fix approve ci, test=develop

* auto parallel sharding base

* chmod

* add unitest

* set unitest cmake dist label

* revise code according to rewiew

* chmod

* bugfix for grad_clip and param broadcast

* chmod

* update unitest

* chmod

* add clip

* chmod

* add amp pass

* chmod

* add unitest

* remove grad update

* fixed bug

* fixed bug

* fixed typose

* fixed typoes

* update dist tensor

* add unitest

* update unitest

* refactor dist tensor

* update dist tensor and unitest

* check amp.decorate and DataParallel

* refine coverage

* fix layer dtype

* refine code

* Pre-save hooks of jit.save

1. Added pre_save_hooks features to jit.save.
2. Added related unittests

* Added jit pre_save_hooks functions's alias to paddle.jit and copyright.

* Make jit.save_pre_hook style be consisent with Paddle's rule.

* Fixed arguments passing bug in run_save_pre_hooks

* Added API Documents

* Move clear and run_pre_save_hooks as internal methonds only.

* Made register_save_pre_hook as an internal function.

* add lstsq gpu kernel

* update

* add docs_en

* modify ut

* fix bugs

* modify example in docs_en

* remove lstsq_op.cu from ROCM cmake

* modify docs_en

* modify docs_en

* modify docs_en

* remove unneccessary TensorCopy

* Add the backward support for QR

* Remove unnecessary comments

This reverts commit ee813e34.

* add maxunpool3d op

* update doc for maxunpool3d op

* update doc for maxunpool3d op

* update doc for maxunpool3d op

* update sample code for maxunpool3d

* add maxunpool1d op

* update some code for maxunpool1d

* add mish operator and api

* remove redundant code and modify grad_atol of mish unittest

* modify mish code to be consistent with other activation implementation

* add multi tensor for adam

* add merged_adam op

* refine code

* refine adam compute logic

* delete the modification of dygraph

* CI

* check CI

* modify the retrun value of get_lr

* reuploaded files

* Changed year from 2021 to 2022

* minor change

* fixed requirements.txt file

* Handled special sum_grad_op code gen in Eager Dygraph

* Fixed merge issues

* added exp activation and use_dst_for_bwd kernels

* CI RERUN

* minor change