this pr fix distributed service

* refine structure for cuda and rocm

* update

* update

* update

* update

* use sync h2d copy

* use stream safe allocator in memcpy_h2d

* remove wait

* add guard

* fix

* test=document_fix

* Rearranged Eager AutoCodeGen directory structure

* Removed USE_OP in Eager AutoCodeGen

* add trt_mobilenet demo test

* only deliver trt_root in run.sh

* refine a test case, test=develop

* publish python c api for eager, test=develop

* revert modify about test_allclose_layer.py, test=develop

* refine, test=develop

* refine, test=develop

* refine, test=develop

* refine, test=develop

* refine, test=develop

* refine, test=develop

* delete numpy includes, use pybind11 numpy.h, test=develop

* refine, test=develop

* refine, test=develop

* refine, test=develop

* suport eager error msg, and add grad test case, test=develop

* refine, test=develop

* refine, test=develop

* add code-gen file

* add api-gen in cmake

* adjust the code format

* temp save the code

* add genen-api module into pten

* merge the develop code

* fix merge conflict

* fix code conflict with develop

* support reduce_mean/sum

* fix the CI requirement

* fix requirement problem of CI

* remove original api code

* fix bug caused by removing original api

* add inplace op adaptation

* optimize inplace logic and fix bugs when run kernel that has args of vector<DenseTensor>

* refactor logic that transform variable to densetensor

* update func name

* [NPU] add int64 support for scatter op

* [NPU] delete debug codes

* [NPU] optimize codes

* first commit

* more uts

* file name duplicated

* timeout

* Update CMakeLists.txt

change TIMEOUT from 120 to 240

* Update CMakeLists.txt

more time

* Update CMakeLists.txt

timeout

* Update CMakeLists.txt

60s

* Handled dispensable tensors in AutoCodeGen for Eager Dygraph

* Enabled Eager Dygraph AutoCodeGen for 500+ existing ops

* fix inplace addto pass

* update

* fix ut

* improve ci coverage

* fix musl ci compile error

* optimizer __call__ to make dygraph faster

* fix return type

* remove cpp Layer

* add align for WorkQueue

* add spinlock

* merge develop

* merge

* Add EventsWaiter

* Revert "Add EventsWaiter"

This reverts commit e206173aa9be7401b83a53581627bfaf557c8fb2.

* update HostEventTracer

* update HostEventTracer

* fix c++17

* update

* update

* update

* update

* fix bug
Co-authored-by: Nliutiexing <liutiexing@google.com>

* add prior_box for kunlun

* update

* update CMakeLists

* fix fc_fuse

* modify cmake notest,test=windows_ci

* retrigger all the ci

* add angle_op

Delete pylint for ci

Modify ShareTensorWithCinnBuffer by callback to save memory

* refactoring matmul hierarchy

* review fix

* review fix

* review_FIX-part2

* Add new unittests

* Replace I with O channel for filter groups

* Undo changes affecting other operators

* Fix oneDNN namespace typo

* Fix code format error