* add reference of lbfgs

* add reference of lbfgs

* modify concat kernel choose

* modify ci

* rename fluid to base

* fix setup and rename paddle.fluid

* fix protobuf generated paddle.fluid

* fix some errors

* fix cmake depends

* fix some error

* try to fix cache error

* fix codestyle && some doc error

* remove build change

* fix some error

---------
Co-authored-by: NXiangGao <jeff41404@gmail.com>

* refine save numpy

* fix doc typo

* fix doc typo and missing part

* complex op logsigmoid

* fix 2023-08-31

* [NewIR]Update send recv infermeta and add unittest

* rm new ir flag

* rm fluid api

* skip runing startup prog

* update flag name

* update recv_v2 yaml

* fix conflict

* unittest only for pp

* fix cmakelist

* unittest check precision

* control random

* fix cmakelist

* 8.30下午

# doctest: +REQUIRES(env:GPU)这个不清楚怎么改，还请帮忙看一下

* Update softmax_mask_fuse.py

修改了相关内容

* Update graph_reindex.py

* Update graph_sample_neighbors.py

全都测了一遍，全都是successful

* fix cases on cpu

* fix gpu cases

---------
Co-authored-by: NSigureMo <sigure.qaq@gmail.com>

[xdoctest][task 248-249,266-267,269] reformat example code with google style in `incubate/distributed/fleet/*`,`incubate/nn/layer/*` (#56772)

* [Doctest]fix No.248-249,266-267,269, test=docs_preview

* fix style

* fix

* add env:DISTRIBUTED

* fix setvalue dtype error when using dy2st and amp O2

* add one test

* remove test share_buffer since win/linux have different number

* fix bug

* fix bug

* div passed v1.0

* IrChange->IrGuard & optimize static input dtype

* clean

* remove IrChange and optimize IrGuard

* 更改相关文件

* Update ir.py

* 恢复相关文件

* Update ir.py

* Delete python/paddle/incubate/optimizer/modelaverage.py

* Delete modelaverage.py

* 尝试恢复文件

* Revert "尝试恢复文件"

This reverts commit 8a263cfd4642614a48a30f648c61fc801331e550.

* Revert "恢复相关文件"

This reverts commit 24249b8191fb3901681ffa9d0e1ad79ef43454de.

* Revert "Revert "尝试恢复文件""

This reverts commit 1b833d623770a851f202c68fff51e77723121a9d.

* Revert "Revert "Revert "尝试恢复文件"""

This reverts commit 64b3a816d1f0fef5ee9100480b8354749005a463.

* Revert "Delete python/paddle/incubate/optimizer/modelaverage.py"

This reverts commit 61986296bf48f7b9bef878bed6890c5dc2971481.

* Revert "更改相关文件"

This reverts commit a5ba675a948534401247b779d6a0fba0581d0628.

* Apply suggestions from code review

---------
Co-authored-by: NNyakku Shigure <sigure.qaq@gmail.com>

[xdoctest][task 268] reformat example code with google style in `/incubate/nn/layer/fused_transformer.py` (#56965)

* [Doctest]fix No.268, test=docs_preview

* Apply suggestions from code review

---------
Co-authored-by: NNyakku Shigure <sigure.qaq@gmail.com>

[xdoctest][task 79] reformat example code with google style in  `python/paddle/nn/functional/loss.py` (#56901)

* [Doctest] fix No.79, test=docs_preview

* Apply suggestions from code review

* fix gpu

* fix

* fix

---------
Co-authored-by: NNyakku Shigure <sigure.qaq@gmail.com>

* test=docs_preview

* test=docs_preview

* test=docs_preview

* test=docs_preview

* test=docs_preview

* test=docs_preview

* fix

* test=docs_preview

* test=docs_preview

* fix

* move stmts under imports

---------
Co-authored-by: NSigureMo <sigure.qaq@gmail.com>

* sep group

* add test

* test ok

* polish

* test cmake script generated

* add sep group

* format

* polish

* polish

* fix static_build for pp

* add mannual_event to support streams across progs

* revert static_build.sh

* fix coverage-ci

* modify the method to name events

* change code according to review

* fix addn infermeta

* fix rule bug

* replace amp.use_pure_fp16 with amp.dtype and amp.level

* old api still use use_pure_fp16

* test_fuse_adamw_pass still use use_pure_fp16

* add test case tuning recompute with amp(float16,o2)

* reset new test case properties TIMEOUT 60

* set smaller value of batch_size and batch_num

* deepcopy dist_context fix _rename_input problem

* fix loss name after cast

* set tuning.enable=True and use engine._tune()

* restore some changes in _rename_input()/_rename_output()

* add self.amp_dtype for _cast_loss() in auto_parallel_amp.py

* fix insert op index in _cast_loss()

[xdoctest][task 184-185] reformat example code with google style in `distributed/auto_parallel/static/*` (#56666)

* [Doctest]fix No.184,185, test=docs_preview

* add env skip

* fix @staticmethod

* fix

* add xdoctest for v2

* fix

* Fix styles of code

* update the GPU option

* add the GPU setup

* remove the note

* update the code

* add docx

* fix conversation

* fix

* fix code style

* fix code style

* Thank SigureMo

* finished?

* add ... and fix line

* add skip doctest

* Update private_helper_function.py

* xdoc

* Apply suggestions from code review

* format and skip a to_static case

* add a missing space

---------
Co-authored-by: NSigureMo <sigure.qaq@gmail.com>

[xdoctest][task 224-225] reformat example code with google style in `python/paddle/distributed/fleet` (#56815)

* [Doctest]fix No.224-225, test=docs_preview

* fix the AttributeError

* add rotate_half in fused_rope

* add position_ids in fused_rope

* modified examples about fused_rope

* add set_device in examples

* add code

* add code

* refine code

* add code

* fix bug

* fix bug

* fix bug

* add code

* add ut

* polish code

* fix bug

* refine code

* fix bug

* refine code

* fix bug

* refine code

* fix bug

* refine code

* fix bug

* refine code

* add code

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* refine code

* add reference of lbfgs

* add reference of lbfgs

* new ir op test v1.0

* fix new ir optest bug1.0

* modify two testcase bug

* add new ir white list & pass test_mean_op.py

* rename white list

* add new_ir_guard

* new ir sum op test all pass

* rename backward.grad as ir_backward.grad

* check place for new ir

* fix test_build_model env bug

* fix test_prim_program backward bug

* change backward to ir_backward in check_appr

* add check_new_ir flag for mkldnn

* clean

---------
Co-authored-by: Nwangruting <wangruting@baidu.com>

* support index_select op

* index_sample in cpu

* support index_sample in gpu

* change data_transform

* fix api gen and use skip_transform in yaml

[xdoctest][task 291] reformat example code with google style in `python/paddle/incubate/operators/unzip.py` (#56826)

* [Doctest] fix No.291, test=docs_preview

* fix

* Update python/paddle/incubate/operators/unzip.py

* switch to gpu

---------
Co-authored-by: NNyakku Shigure <sigure.qaq@gmail.com>

* add complex support for isclose

* add complex test for isclose

* fix template complie issue

* fix cuda compilation error

* fix type typo

* fix error for complex's abs

* add complex dtype into input

* fix ut