Change-Id: I6210ce9c60bed48f3323c47b16500302b66cedf2

* add ps table (#29463)

* add ps table

Change-Id: I468a04bd071d21ff52654926fcf4d5f3da19e178

* add service (#29560)

* add service, remove ut on mac

* fix heter_profiler & add heter stop method

* fix code style

* test=develop, optimize global_step

* fix distributed error info

* bug fix; notest

* error info refine

* update error info

* update error info

* update error info

* bug fix

* bug fix

* bug fix

* bug fix

* test=develop, optimize geo communicator 

* use iwyu clean include, test=develop, test=win

* compilation error, test=develop

* fix compilation error2, test=develop

* fix compilation error3, test=develop

* fix compilation error4, test=develop

* fix compilation error5, test=develop

* fix compilation error6, test=develop

* fix compilation error7, test=develop

* fix compilation error8, test=develop

* fix compilation error8, test=develop

* fix compilation error10, test=develop

* fix compilation error11, test=develop

* rename communicator meet->BatchesCounter

* fix parame recv for sparse

* geo sparse init from pserver

* optimize init from pserver

* add large scale optimizer fuse(SGD/ADAM)

* rectification init_worker and exe.run startup program

Integrated Trainer of Parameter Server (API add `fluid.contrib.layers.sparse_embedding` only) (#22957)

* Integrated Trainer of Parameter Server

* fix communicator when breaking under PyReader mode, test=develop
* revert some vlog level to 0, test=develop

* add sync communicator and implement

* add half_async in the communicator
* fix DistributedStrategy

* add distributed_strategy

* test=develop, speed dense calc & communication

* remove -Wno-error=sign-compare, make warning as error

test=develop test=document_fix

* fix exist compile warning

test=develop

* update pserver decay blocks

* update distributed notify handler

* test=develop, communicator_is_sgd_optimizer flags

* delete debug vlog & add rpc function & fix word2vec bug & speed GEO-SGD

* refector geo sgd & communicator

* add a base class for the Communicator
* add AsyncCommunicator Impl for async distributed training

* test=develop,  communicator merge add => merge average

* fix correctness of the communicator

* fix a bug in send thread when sending var context is empty, test=develop

* add lookup_table_prefetch_op and prefetch optimize, test=develop

* remove remote prefetch GPU supported

* word2vec force with CPU, test=develop

* test dist remote lookup table force with CPU, test=develop

* add is_runnning in communicator, test=develop

Async exe support communicator