Add 3d Parallelism
Co-authored-by: NWangXi <wangxi16@baidu.com>
Co-authored-by: NJZ-LIANG <jianzhongliang10@gmail.com>
Co-authored-by: Nroot <root@yq01-sys-hic-k8s-v100-box-a225-0562.yq01.baidu.com>

* fix gather grad kernel diff

* fix gather grad kernel diff

* fix gather review bug

* fix softmax

* fix mean

* fix lookup_table_v2

* change transpose to transpose2

* fix bug

* rename npu op file

* fix reshape

* add topk op

* add cmake

* update topk npu op

* refactor func

* fix test not go npu TopKD bug

* NPUPlace(4) to NPUPlace(0)

* update comment
Co-authored-by: Noyjxer <1728722986@qq.com>

* add increment

* fix

* update test increment op inplace

* update increment op

* increment b = 2
Co-authored-by: Noyjxer <1728722986@qq.com>

* fix shape of dx

* refine code

* [npu] support npu kernel  for `expand`

* update unittest

* add TensorCopy in npu grad kernel

This reverts commit 468ac699.

* update mean op

* update mean op

* give a better test activation
Co-authored-by: Noyjxer <1728722986@qq.com>

* init

* fix bugs

* add mul

* add test mul

* add npu kernel for adam

* refine code

* disable test

* modify atol

* add reduce_sum

* fix broadcastd

* fix test

* fix

* add unsqueeze in reduce_sum

* add template

* add unittest for keep_dim

* test reduce_all
Co-authored-by: Nfrankwhzhang <frankwhzhang@126.com>

Co-authored-by: Nfrankwhzhang <frankwhzhang@126.com>

* Support npu kernel scatter op

* Add more test

* [npu] support npu kernel for `less than`

* remove int* kernel

* cleanup

* [npu] support npu kernel `table_lookup_v2`

* clean up

* +python test

* +cmake

* clean up

* remove int8 kernel
+ python unitest for fp16

* clean up

* Support npu op elementwise_div and elementwise_div_grad

* Support npu op elementwise_div and elementwise_div_grad

* Support npu op elementwise_div and elementwise_div_grad

* add range op

* fix codestyle; call GetSize directly
Co-authored-by: Noyjxer <1728722986@qq.com>

* Support npu op gelu and gelu_grad

* Support npu op gelu and gelu_grad