* fix nccl2 lars dist support

* put lars in momentum op

* add tests lars

* fix ci

* fix cpu kernel

* soft warning

* remove lars in test_recognize_digits.py

* move to another op

* add file

* update api.spec test=develop

* update test=develop

* fix api.spec test=develop

* wip

* wip, finish grad merge ops

* wip, finish graph build

* wip test running

* work on 1 gpu

* workable version

* update

* fix tests

* fuse broadcast op

* fix compile failed

* refine

* add batch merge test mnist

* fix CI test=develop

* fix build

* use independent bn params for batch merge test=develop

* update api.spec

* follow comments and for test

* wip

* refine tests test=develop

* follow comments test=develop

* remove startup bn modify test=develop

* follow comments test=develop

* fix merge test=develop

test=develop

test=develop

test=develop

* fix conv doc
test=develop

* fix seq_conv doc
test=develop

* fix simple_img_conv_pool
test=develop

* update API.spec

* update parameter doc
test=develop

* follow comment
test=develop

* fix other layer
test=develop

* fix lstm bias_attr doc
test=develop

* Add affine channel op.
* Update code and add Python API.
test=develop
* Update API.spec
test=develop

test=develop

test=develop

test=develop

test=develop

test=develop

test=develop

* "avoid copy back to cpu"

* "add infinity support"

* "fix ci"

* "add cpu macro"

* rerun ci; test=develop

* "fix api"
test=develop

* test=develop

* test=develop

* test=develop

* test=develop

* test=develop

Add API.spec

test=develop

* show detail error log on ci

* test

* fix memopt and dist

* update apispec

* will fix different batch issue test=develop

test=develop

test=develop

* add distributed auc

* add attr "is distributed" and config it

* add distributed auc

* add batch auc and code format

* code format

* auc optimize

* metric_op optimize

* code clean

* bug fix and code clean

* bug fix and code clean

* code optimize

* code optimize

* api spec update

* Comments optimized

* add mutex

* Revert: add mutex

* remove distribute metric

* remove distribute metric

* spec modifyed

* add annotation, test=develop

* keep API compatibility
test=develop

* hide operator API

* update

* update api.spec

* fix merge

* fix test

* add nccl2 dist api

* update apispec

* update

* update api spec