Fix Mac Python3 CI job

Max Sequence pool optimization

remove with_inference option

test=develop

test=develop

* feat(platform): lazy initialization of devicecontext in pool

Use std::async(deferer, []{...}) to lazy initialize DeviceContext in Pool

test=develop

* Add future includes

test=develop

test=develop

test=develop

increase test timeout coverage.

1.add position encoding  2.logloss in nn.py

test=develop

test=develop

Fix inference model not found on Mac CI

* fix sum_op's GetExpectedKernelType
test=develop

* fix ci fail
test=develop

test=develop

test=develop

test=develop

generate proposal labels doc

Refine/jit/crf decoding

Fix import plot in py3

disable some tests

[1.1] fix cmake warning when ON_INFER=false

OrderSet default is mutableSet, not set.

fix xxhash compile on macos

[1.1] Cpu for 1.1 merge with shape

test=develop

- Added rough profiling

- Profiled maxpool itself

- First draft of max seqpool optimization (is_test added)

- Added unit tests to seqpool

- Cosmetic fixes

- Fix to UT of Seq pool

Disabled grad checking for sequence max pool when is_test is set to True

-Cosmetic fix to comment

test=develop

- Fix to GPU build

test=develop

- yet another GPU fix for sequence max pool

- Fix to comment

test=develop

- Change to API of sequence_pool

test=develop

- Yet another API spec change

test=develop

test=develop

test=develop

[1.1]Fix op_role value

test=release/1.1

test=develop

fix test resnet50 multi-threading on mkldnn