* remove v2_transpose_reshape

* matmul_transpose_reshape

* reshape_transpose_matmul

* restore ut

* adjust old ut

* restore parallel UT ruels

* feedback from review

* add fused_multi_transformer post_layer_norm

* add test post_layer_norm

* move fft kernels to phi, done with cufft, pocketfft, mkl_cdft, hipfft
* make stft_op use fft from phi/kernels/funcs, clean code

* Add unit tests

* matmul_v2 + activation

* matmuls + elementwise_add

* matmul_v2 postops

* transform matmul to v2

* opcompat

* fix fusing matmul with multipe outs

* add shape constraints

* remove unused vars

* change pass order

* - Unit tests to be debugged

- fix

- refactor

- diagnostic

- more diagnostic

- fix

- Fix number two

- fix

- fix

- fix

- alpha added

- more fixes

- compilation fix

- removed diagnostic code

- cosmetic fixes

* lint

* add alpha constraint

* merge matmul refactor

* trigger CI

* - fix

* - another fix

* code style

* add support for matmul+elementwise_add+activation

* code style

* fix bfloat16 bugs

* change append_binary to append_sum
Co-authored-by: NJacek Czaja <jacek.czaja@intel.com>

* add name attribute to code-block, test=document_fix

* remove redundant labels, test=document_fix

* remove redundant labels (from upstream), test=document_fix

* more COPY-FROM (try multiple code example), test=document_fix

* empty commit, try to trigger PR-CI-build

* fix some `Examples:` format issues

* fix some ci errors

* add rnn

* first commit

* add fp16 ctest files for compare op

* add cpu register of float16 for compare ops

* [Eager] fix slice's input mistake

* add tests for slice

* phi_fill_diagonal_tensor

* delete extra lines

* update

* add legacy api test

* rename sig

* phi_generate_proposals_v2

* remove old kernels

* optest add eager_check

* del lod

* update

* update

* update test_detection with_lod

* update nms_util

* remove old nms_util.h

* fix conflicts

* mv unused file

* revert backward.h

* revert lu_unpack kernel

* rm .cu file

* Update lu_unpack_kernel.cc

* format phi yaml

* [XPU] fleet dist_model support xpu. test=kunlun

* [XPU] fleet dist_model support xpu. test=kunlun

* move unittest file location. test=kunlun

Set the lr var's dtype to fp32 when create a fp16 lr var in optimizer if user not mean to use global fp16. (#44840)

* add paddle.bucketize api

add paddle.bucketize api

* updata paddle.bucketize code style.

* upgrade unittests/test_bucketize_api.py.

* update tests/unittests/test_bucketize_api.py file.

* 修改bucketize API 的英文参数描述

* phi_fill_diagonal

* remove old kernels

* update

* update attr args

* refix

* update

* [CustomDevice] add custom ccl 2/2

* update

* update

* update launch

* add sequence_unpad for xpu,*test=kunlun

* add sequence_unpad, *test=kunlun

* fix bug in testcase,should not be sequence_pad,*test=kunlun

* save change

* save change by YSL

* save change by YSL

* change by YSL

* test pre commit

* Revert "test pre commit"

This reverts commit eee5e116331186cc544de871b4a5174a6431f17c.

* fix code style

* fix ctest

* temp save

* save change

* change by YSL

* final change by ysl

* fix ci

* fix code style

* delete unuse code

* change by ysl

* fix dy2staic: cpu, cuda, assign([Var, Var, ])

* fix1

* fix2
Co-authored-by: Nxiongkun <xiongkun03@baidu.com>

* move repeat interleave

* fix api name

* recover op registration

* fix arguments order

* fix

* fix infermeta

* fix infermeta

* fix header

* fix infermeta

* fix

* fix

* fix dtype

* log&test

* test

* remove logs

* fix

* remove logs

* combine files

* combine

* combine files

* fix cuda place

* [Dy2St]Support generate whole program in ProgramHelper for Engine

* support to(mode)

* fix word typo

* fix unittest

* fix_auc in instag task

* fix_auc in instag task

* fix_auc in instag task

* fix opmaker error

* optmize default value of ins_tag

* fix multiary

* fix multiary

* reback ctr_metric_bundle

* reback ctr_metric_bundle

* for ci auc_test

* code style

* code style fix

* suit paddle

* suit paddle

* update code example

* complete Auc unittest

* set asdispensable

* set optional

* compatable and code style

* fix cu

* fix cu

* for ci win

* update unittests of auc

* update code doc by reviews

* change code doc by reviews

* mv kernel

* mv infershape

* mv yaml

* update some

* maintain decoe_jpeg in old dygraph

* fix as review

* rm decode_jpeg_op.cu

* update for rocm

* release the convert_len()

* fix bugs

* fix bugs

* fix start error.

* when shape==0, we should also call paddle.shape

* mv eigvalsh op