* support margin loss (arcface, cosface, sphereface)

* first test version

* add test exec;

* add data transfer; test=develop

* add new exec head;

* add memcpy; test=develop

* add python fetch

* add new test

* add graph node; test=develop

* remove useless new executor test; test=develop

* remove gperf dependency; test=develop

* fix compile bugs; test=develop

* remove useless code; test=develop

* remove useless code; test=develop

* add uni test; test=develop

* polish code; test=develop

* polish code; test=develop

* add interpreter cmakefile; test=develop

* remove useless code; test=develop

* add fix op run order pass

* add ut for fix_op_run_order

* fix ci error

* improve coverage

* improve coverge again and fix cpu test case

* follow some comments

* Support C++ import python on windows for paddle

* Support C++ import python on windows for paddle

* pass found_inf to adam

* add unittest

* fix bug

* refine unittest

* change unit test's directory

* disable unittest on cpu

* dygraph sharding

* update unitest hybrid_parallel_communicate_group

* fix c_split bug

* fix utest

* add c_embedding for tensorparallel

* fix pipeline

* fix mp pp dp

* fix utest of hybrid parallel

* add utest for tuple

* add raw program, test=develop

* add alltoall api, test=develop

* add sendrecv, test=develop

* fix model parallel

* rm parallel_help.py

* add embedding

* add pp dygraph, test=develop

* Dygraph reocmpute

* unitest for Dygraph reocmpute

* dy recompute remove unitest for win and mac

* add pipeline layer

* update

* fix tc trt shape

* fix fc dynamic shape

* add fc shape assert

* update

* add c_identity op, test=develop

* add c_concat op

* add clip/check

* add amp & clip grad in dygraph

* add logging

* support save/load binary format tensor

* Fix error when create cudaplace

* Fix error when create cudaplace

* Fix error when create cudaplace

* get devive context from pool.

* move define of 'SerializeToStream' and 'DeserializeFromStream' to 'lod_tensor.cc' and 'selected_rows.cc'.

* improve coverage.

* improve coverage.

* polish API

* deal with conflict

* disable save/load large file in unnittest

* split unnittest.

* add model parallel support in dygraph

* pscore support heterps

* fleet cmake

* fleet wrapper

* macro

* solve conflict

* solve conflict

* add unitest

* paddle enforce

* unitest

* unitest

* unitest