* Fix dnnl errors in elementwise_sub tests

* Fix model accuracy attempt

* Add new fix

* Add proper fix

* Refactor by removing code repetition

* support sharding stage2 + mp hybrid_parallel.

* fix the group of check_nan_inf.

* update hcg.

* Dispath computation OPs before communication in standalone executor

* Update code

* Fix CI errors

* Improve performance of coalesce_tensor and depend OP in standalone executor

* pre-commit check

* add constant_folding_pass pass for mkldnn int8

* update UpdateScaleOpInOutScales

* [CodeStyle][py2][U008] remove unnecessary args in `super()`

* remove remained args

* revert changes in test_pylayer_op

* Revert "revert changes in test_pylayer_op"

This reverts commit ff185a9ae738afac3b0264f61bde6c6b7f72e7c4.

* revert some changes in example code

* opt CanMKLDNNBeUsed performance

* fix nullptr bug

* fix OpBase default_attrs=nullptr bug

* fix OpBase default_attrs=nullptr bug

* fix OpBase default_attrs=nullptr bug

* Remove reduntant numpy input in Example code

* Remove reduntant numpy input in Example code, test=document_fix

* add extra attr property set

* add type_info for all context

* add onednn context to all context

* fix context compile error

* simplify conv kernel args

* pass runtime attr into dev_ctx

* fix marco error

* clear conv_grad_kernel extra args

* merge conv_grad_grad into conv_grad

* clear conv2d_grad_grad extra attrs

* remove redundant imports

* migrate softmax

* clear yaml and eager extra attr

* fix conv1d error

* change to thread local

* fix npu compile failed

* try to fix windows compile failed

* add conv2d onednn phi kernel

* fix ci bugs (#36)

* fix compile bugs (#38)

* fix extra input transform bug (#39)

* support dynamic created attr (#40)

* reset extra info gen code

* rm conv_grad_grad kernel

* reimpl pass attr adapting

* add int attr support

* remove vector inputnames creating

* merge dev

* fix map at error

* adjust attribute

* adapt funcs to PHI
Co-authored-by: NChen Weihang <chenweihang@baidu.com>
Co-authored-by: NYuanRisheng <yuanrisheng@baidu.com>

* add cudnn into whl package

* add cudnn dso into whl package

* let WITH_CUDNN_DSO be consistent with WITH_GPU

* fix WITH_CUDNN_DSO in paddle_build

* Add six for @to_static and add CI approval

* add six

* refine logic

* delete approve

* fix return

* add ImportError

* typo `moduels` -> `modules`
Co-authored-by: NNyakku Shigure <sigure.qaq@gmail.com>

* remove unused-variable warning in linux

* fix unused-variable error in GpuPS

This reverts commit f9134045.

* add bilinear OutSize

* fix ci bug

* test

* Support NHWC layout in GroupNorm

* fix cteset

* add cuda117 dockerfile; test=cuda117

* notest;test=cuda117

* test=cuda117

* test=document_fix

* Dispath computation OPs before communication in standalone executor

* Update code

* Fix CI errors

* add phi core file into ci list, test=document_fix

* remove repated file, test=document_fix

* add storage properties for npu

* fix compile failed

* fix api name mismatch

* polish design

* Standardise batch norm

* standardize conv3d and depwise_conv2d

* fix ci bugs