* back fl

* delete ssl cert

* .

* make warning

* .

* unittest paral degree

* solve unittest

* heter & multi cloud commm ready

* .

* .

* arm_brpc compile

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* only output is ok

* base is ok

* .

* .

* .

* .

* .

* .

* .

* .

* add switch server bin

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* adapt brpc ssl

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* fix heter_server & heter_client

* .

* .

* int->int64_t

* .

* safe map in multithread

* fix heter unitest

* .

* fix code_style

* .

* fix bug

* .

* - shape mkldnn adapted to NHWC

- NHWC shape mkldnn ut

- fixes to UT

- Fix to UT

- Fixes to UT

- Fix of compilation

* - lint candidate fix

* added fill_constant kernel

* CI fix

* ci fix

* switched from nan to zero memory

* CI FIX

* ci fixes

* CI rerun

* ci fix

* minor change

* CI rerun

* Create elementwise_heaviside_op.cc

* add ElementwiseHeavisideFunctor

* Create test_elementwise_heaviside_op.py

* 增加heaviside的python接口

* add heaviside in white list

* 增加heaviside的签名

* 增加heaviside的核函数

* 增加heaviside梯度的核函数

* 增加heaviside梯度的注册

* 调整代码格式

* Update elementwise_sig.cc

* add heaviside in __all__

* Update heaviside docs

* Update math.py

* Update math.py

* Update math.py

* print mem

* refine

* refine

* refine

* refine

* fix adamw unittest

* tiny fix

* fix param name

* pdnode_compare

* panode compare

* pdnode_compare

Co-authored-by: Nyaozhixin <522190855@qq.com>

* [Eager]Fix tensor.name is empty behavior

* fix unittest

* refine pylayer

* refine

* auto_cast; test=document_fix

* static.save; test=document_fix

* cuda_places; test=document_fix

* Add AdamW jit kernel

* Second implementation

* Add missing header

* Correct number of jit kernels in the test

* - fix to crash

- more fixes

- added diagnostic

- matmul output fixes.

- compilation fix

- stop rotating too small shapes

* - Added enabling of matmul_V2 onednn test

* add abs double grad yaml and test case

* add pool2d double grad yaml

* add pool2d dygraph double grad test case

* polish grad details

* polish detail by comment

* [Eager] fix sharding under eager mode

* [Eager] fix several sharding test under eager mode

* corrcoef commit

* corrcoef commit

* Update test_corr.py

* Update linalg.py

* Update test_corr.py

* Update test_corr.py

* Update test_corr.py

* Update test_corr.py

* Update test_corr.py

* Update test_corr.py

* Update test_corr.py

* Update test_corr.py

* Update test_corr.py

* Update test_corr.py

* Update linalg.py

* Update linalg.py

* Update linalg.py

* Update test_corr.py

* Update test_corr.py

* Update test_corr.py

* Update test_corr.py

* Update test_corr.py

* Update test_corr.py

* Update test_corr.py

* Update test_corr.py

* Update test_corr.py

* Update test_corr.py

* Update test_corr.py

* Update test_corr.py

* Update test_corr.py

* Support Gradient Accumulation for sr

* add ut

* change ut to fit small vector

* put_record_event_in_python_on_timeline_python

* fix

* the copy type of data transform for gpu_pinned to gpu change from syna to async

* refactor code

* add cuda11.5 manylinux docker

* build.sh

* fix

* fix

* support cu113 and cu114

* add --no-check-certificate when wget sqlite-autoconf-3250300

* change cuda11.4.2 to cuda11.4.3

* add cu116

* [Auto Parallel] Replace the old planner by the new partition tuner

* [Auto Parallel] Improve the completion and distributed context

* [Auto Parallel] Fix some bugs of the compatible check of some dist ops

* [Auto Parallel] Fix some bugs

* add cuda11.4 develop docker

* change default python from 2.7 to 3.7

* change base image for cpu docker

* fix gcc bug

* fix whl package name

* update go version and delete useless package in dockerfile

* fix release18 error

* fix wget sqlite problem

* update go version

* update go version in dev dockerfile

* fix CI error

* install zstd

* fix CI error

* add --no-check-certificate when install go

* python2.7 do not install requirements

* fix CI Coverage error

* coverage==5.5

* fix test_activation ut

* let numpy < 1.22 to pass test_activation_op unittest

* fix test_python_bf16_numpy_datatype unittest

* change paddle-bfloat==0.1.3

* recover version of paddle-bfloat