* fix cache

* Fix unittest

* Fix the slow running speed of kl_div when option reduction is set

* fix unittest coverage

* add benchmark

* Add the `GetFetchNames` method in CinnGraphSymbolization.

* Use unordered_set instead vector as the type of fetch_var_names.

* Reuse the definition of kCompilationKey.

* Use CompileOptions to set fetch_var_ids.

* Update the argument passing of GraphCompiler.Build.

* Fix some bugs in CinnGraphSymbolization::GetFetchIds.

topk中有cub和手写kernel两种实现，而cub是通过排序来获取topk，通过多组数据发现只有当input_width>=128且k超过input_width 75%的时候性能会比手写的更好。

* Use oneDNN reorder instead of custom one

* Fix whitespace typo

* Fix Code format error

* Incorporating feedback

* Remove unncessary reorder

* Support GIOHW format

* Fix code format error

* init

* add feed ops in python side

* import LRScheduler

* update_feed

* refine code format

* Change first batch of mkldnn headers and namespace names to dnnl

* Revert changes to tensor.h, which require approval

* Format changes with pre-commit

* Add int32 tests

* Fix int32 tests and call GetDataFromTensor for int32

* Fix test

* Modify reduce_op.op.h for xpu2 with kernel primitive api

* upgrade oneDNN to v2.4-rc

* Removed failing test

* Revert "Removed failing test"

This reverts commit 60e70e717fac2c86b7beb24dfa1343a5804ea455.

* Remove most tests for debugging purposes

* Update hash to oneDNN 2.4

* Revert test change

* Update oneDNN to 2.4.2

* Update oneDNN to 2.4.3

* Change oneDNN version to 2.3 for Jenkins test

* Revert "Change oneDNN version to 2.3 for Jenkins test"

This reverts commit 0b176defc3b63f65dd0ba85873a018534f287000.

* Update oneDNN to 2.4.4

* Change version of oneDNN to 2.3 for new Jenkins test

* Revert "Change version of oneDNN to 2.3 for new Jenkins test"

This reverts commit e005a0f78f2b41cdcf4d7de3a21df7f910b78268.

* remove test_hapi_hub from mac

* fix format error

* add slice api impl of Tensor

* fix test slice error

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix ut. test=develop

* fix ut. test=develop

* fix ut. test=develop

* refactor heter trainer. test=develop

* fix. test=develop

* fix ut. test=develop

* fix ut. test=develop

* fix ut. test=develop

* fix ut. test=develop

* fix ut. test=develop

* fix ut. test=develop

* fix ut. test=develop

* fix ut. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix ut. test=develop

* fix ut. test=develop

* fix ut. test=develop

* copy beta pow to same place when skip_update=1

* fix xpu

* [Einsum] correct output dimension errors due to single element tensors.

* [Einsum] format polish.

* add

* add BuildOperatorDependences

* fix bug

* add unittest for write after write

* fix merge bug

* fix

* Added BF16 Pool2d grad

* upstream pulled

* fix for CI

* fixes after review

* reshape kernel refactor

* fix compile bugs when run ci

* support xpu for reshape

* fix bugs when run unittest in kunlun ci

* fix compile bugs when run kunlun

* perfect code according to suggestion

* add api and unit test for reshape

Add pure fp16 support for fused transformer.

* make pass ut timeout smaller

* increate ut timeout

* Make FLAGS_determinstic effective in conv2d forward.

* Add call of SetCinnCudnnDeterministic in cinn_launch op.

fused_attention_op的实现中，使用了bias_add，且其实现是通过使用kernel primitive来实现的，之后kernel primitive的WriteData api接口及函数内部实现发生了更改，将判断越界的逻辑移到了template的参数中，使得调用的分支有错误，产生了越界赋值操作，污染了别的显存空间的内容。具体表现为：test_fused_attention_op_api.py 单次执行基本上不会报错，多次循环执行不同shape的输入，结果计算不对，具有偶发性，bug不易察觉。