* add matmul_flops

* add dropout,layer_norm ...

* add dropout,layer_norm ...

* add elementwise_flops

* add dict check

* add unitests

* add equation for flops computation

* regularized annotations

* clear fluid api: warpctc, nce, identity_loss

* fix test_layers.py __init__.py

* fix loss.py

* change __init__.py and api calling method

* fix nce

* fix nce

* fix fluid.data

* delete warpctc api document

* fix loss.py

* fix ctc_loss

* fix test_warpctc_op.py

* fix test_layers.py

* fix some bug

* fix conflict

* fix ci bug

* Empty Commit test=allcase

* fix ci bug

* add_gather_nd_

* add_gather_nd_

* add_gather_nd_

* fix expand as op

* fix bug

* remove fluid.reduce_sum

* remove fluid.reduce_sum

* modify axis and import paddle

* modify keepdim and out_name

* modift unittest

* modift unittest

* modify CI_static and loss.py

* modify test_mse_loss

* modify static ci

* modify static ci datatype

* add import paddle in test

* fix conflict

* fix conflict

* modify ci

* modify ci

* fix_conflict

* fix bug

* code_style

* Update communicator.cc

* Update communicator.cc

* remove LoDTensor

* remove LoDTensor and Tensor

* hot fix

* fix compile

* merge develop

* follow comments

* fix loopup_table plugin deserialize size error

* for xpu multi thread bug test

* fix

remove random_crop which is not used in Paddle 2.0

* support xpu scalar inplace

* sharding for xpu

* update

* update
Co-authored-by: Nheyanru <81976792+heyanru01@users.noreply.github.com>

* refactor: move all_gather

* add isort config

* isort all files

* group norm fp16 support

* Clean fluid resize_linear API

* Clean fluid image_resize_short API

* add image_resize back

* attr ready

* op ip ready

* start dynamic

* end2end ok

* input shape to map, stat by op

* layer wip

* first version ready

* fix proto depds

* fix profiler deps

* fix flops typo, rm tuple shape

* Move stream_anayzer to interpreter

* Refactor StreamAnalyzer

* Refactor RunNextInstructionList

* Remove no_data_transform_index

* Fix typos

* Fix data_transfer OpFuncType error

* Add event for depend_op

* Update transfer OpFuncType for heter place

* support xpu scalar inplace

* sharding for xpu
Co-authored-by: Nheyanru <81976792+heyanru01@users.noreply.github.com>

* add bfloat16 support for more ops

* fix ci compile

* fix windows compile error

* fix windows compile error

* fix rocm compile error

* fix ROCM compile error