test=develop

test=develop

test=develop

* add check for opt op

* fix opt op
test=develop

* fix test fail
test=develop

* fix optimization doc
test=develop

* test=develop

* add strategy doc
test=develop

* fix doc
test=develop

* add ParallelExecutor arg doc
test=develop

test=develop

* fix layers.uniform_random

* fix uniform_random
test=develop

* remove var type set
test=develop

* fix similar error
test=develop

test=develop

test=develop

This can cause a lot of problem:
1. Wrong operator implementation, Op can get a wrong type without failure.
2. Anytype can be Get without defined in VarType.

Also fix wrong STEP_SCOPE usage.

test=develop

* optimize depthwise conv by register memory
* test=develop

test=develop

test=develop

* profiler infor merge thread statistic information

* update profiler

* fix bug

* add merge thread msg to report

* optimize report

* statistic the time of ops in each thread but not all

* optimize report format

* optimize profile report

* optimize profile report
test=develop

test=develop

  1. Accelerate SelectedRows MergeAdd functor

  2. Add SelectedRowsSumTo functor to support MergeAdd multiple SelectedRows into one

test=develop

test=develop

* Fix truncated normal.

* test=develop

test=develop

test=develop

test=develop

test=develop

* set the right shape of selected_rows
test=develop

* enhance check

* fix activation_op

* remove cast

* use ShareDimInfo replace SetDim and ShareLod

* use ShareDimAndLod
test=develop

* follow comment

test=develop

* check whether the input has lod
test=develop

* Split ShareDimAndLod

test=develop

* checkout clip.py
test=develop

test=develop

* Fix bug in reduce_op caused by PR #13534
* Fix output shape and enhance unit test.
test=develop

test=develop

* "avoid copy back to cpu"

* "add infinity support"

* "fix ci"

* "add cpu macro"

* rerun ci; test=develop

* "fix api"
test=develop

* test=develop

* test=develop

* test=develop

* test=develop

* test=develop

test=develop

review fix

review from hshen14 fix

test=develop

fix error in broadcast and code cleanup

rename bias -> eltwise and added macro to shorten code

formatting

test=develop

test=develop

test=develop

- Work in progress on unit test for fused_embedding_fc_lstm op

- Added bias caching and ref x computing

- Small update unit test

- temporary storage

- Fix to batchcompute

- Cosmetic fixes

- Style fixes