* fix arm fp16 compile error

* polish macro impl

* fix select_input with different shape errors:
1. select_input_with_buildin_type directly return non-undefinedvar branch when meeting undefined var
2. the output shape of select_input is inferred from inputs.

* reverse the logic in select_input

* fix distributed_fused_lamb nan

* remove CUDA_ASSERT

* add reduce_mean,reduce_sum primitive ops

* add ne_p gt_p primitive operators

* add ge_p abs_p primitive oparators

* normalize yaml op label

* revert op_compat yaml change

* fix prelu and rnn compat problem

* replace api by op

* optimize executor log

* delete log in new exe

* add log for old executor

* use LOG_FIRST_N(INFO, 1)

* clear extra attr of activation op in opmaker

* fix syntax bug

* fix mkldnn kernel

* fix merge conflict

* fix bug

* add softmax infer kernel

* support deco

* fix deco ast type

* arg_str

* 1

* support callable deco

* code style

* codestyle

* test_error

* fix decos in another file

* recover conflict codes

* back fl

* delete ssl cert

* .

* make warning

* .

* unittest paral degree

* solve unittest

* heter & multi cloud commm ready

* .

* .

* adapt for nn fl-ps

* Enable standalone executor for single-GPU training

* Disable CompiledProgram._graph

* Fix CI errors

* adapt gradient merge

* fix op_role

* fix strategy

* add scope cache & reuse

* add gc scope for end of each train step

* del scope reuse for jit

* refine code

* test

* make memcpy op to support custom device

* fix bug

paddle::platform::CudaAtomicAdd
https://github.com/PaddlePaddle/Paddle/issues/45881

* fix softmax int64

* follow comments

* fix split bug in static mode

* modify code style

* modify code style

* add unit test for split

* Allow manaully set py_reader name in standalone executor

* Fix CI errors

* add paddle vsplit api

* update unittest and fix a typo

* update

* add vsplit to __all__

* update unit test and description of x

* fix typo