* Add new API: paddle.prod

test=develop

align expand_as op to expand.

* add set/get default dtype

* expose and unify the Tensor concepts to the user

* expose tensor to user

* add copy place for Tensor

* add copy place for Tensor

* add note

* add macro PADDLE_WITH_CUDA

* remove RUN_TYPE=DIST

* fix some error

* add tile_op, test=develop

* Upgrade `no_grad` decorator

test=develop

- match torch decorator usage (i.e., with parenthesis)
- handle generator functions
- add `paddle.no_grad` alias

* Switch from `functools` to `decorator`

preserves signature

* Reword decorator usage note

* fixed static module

* solve conflict

* remove original name for alias API

* move paddle.fleet to paddle.distributed.fleet

* Add the max, min, maximum, minimum api for the API 2.0, test=develop

* Directory migration, test=develop

* Change imperative from paddle init to paddle framework, test=develop

* Fixed jit bug, test=develop

* default static mode, test=develop

* fixed format and create parameter belongs to framework, test=develop

* Fixed import package, test=develop

* fix __init__ format, test=develop

* fixed alias problem

* fixed paddle.enable_imperative problems, test=develop

* Add unittest

* delete install_check comment

* Fixed unittest timeout

* fixed unittest error

* move Program default_xx_program to static package

* optimize unittest method

* fixed framework __init__ format

* fixed jit path

* delete alias

* move jit to paddle

* Fixed unittest format

* fixed paddle.default_main_program

* Fixed save load API in paddle __init__.py

* fixed ci paddle.imperative.to_variable

Update the code for the compare_ops, update the api and doc 

* New features, add sinh and cosh op, test=develop

* remove duplicate test function and remove out paramters, test=develop

* Add out paramters temporary, remove later. test=develop

* remove out args, PR 25570, test=develop

* remove TestParameter, test=developx

* add test api for static dygraph, test=develop

* add backword unittests for sinh and cosh, test=develop

* add op multiply, delete op elementwise_mul from math.py. test=develop,test=document_fix

* bug fix. test=develop,test=document_fix

* bug fix. test=develop,test=document_fix

* bug fix. test=develop,test=document_fix

* bug fix. test=develop,test=document_fix

* add unittest for multiply op. test=develop.

* fix code style. test=develop

* use random input. test=develop

* add test error case for static computation graph. test=develop

* add np.random.seed(7)

* increase input ndarray size. test=develop

* change float32 to float64. test=develop

* delete mul op. test=develop,test=document_fix

* bug fix. test=develop,test=document_fix

According to paddle 2.0 standard
1, change flip api attr name 'dim' to 'axis'.
2, support empty axis
3, change example code to imperative mode.

* add paddle.fleet.DistributedStrategy for 2.0

* add histc operator, test=develop

* update english doc to 2.0 API, test=develop

* update API from histc to histogram, test=develop
Co-authored-by: Nroot <root@yq01-gpu-255-129-15-00.epc.baidu.com>

* add alias in paddle.nn and paddle.tensor test=develop

* add alias in paddle.nn and paddle.tensor dir test=develop

* fix same conflict manually test=develop

* update fc and dygraph alias test=develop

* fix initalizer.py typo test=develop

* add base name alias; test=develop

* fix embedding bug; test=develop

* fix io error; test=develop

* add metric; test=develop

* add import palce; test=develop

* add setup; test=develop

* fix incubate reader; test=develop

* fix initializer error; test=develop

* Merge hapi into Paddle

Hapi is a high level API for training and inference.
The main modules include Model, Loss, Metrics, Dataset.
Also includes common modules and models in NLP and computer vision, such as BERT, ResNet.

These modules are developed by:
0YuanZhang0, guoshengCS heavengate, LielinJiang, qingqing01, xyzhou-puck huangjun12, wangxiao1021, zhangyang.

* copy dygraph api to paddle.imperative, test=develop

* polish the code, test=develop

* polish code, test=develop

* polish code, test=develop

* move paddle.imperative.Layer to paddle.nn.Layer, test=develop

* Move complex into dir incubate, test=develop

* Fix imports, test=develop

* Fix docs, test=develop

* Forbid import functions from paddle.incubate directly, test=develop

* add trace op, test=develop

* Optimized the implementation of trace op, test=develop

* fix a bug of include in trace_op.h, test=develop

* move trace API from creation to math, test=develop

* modified en doc. test=develop

* add complex trace api

* add complex sum api, test=develop

* modified en doc of complex sum and trace, test=develop

* modified doc and trace API, test=develop

* modified en doc of trace and sum, test=develop

* modified comment in complex kron API, test=develop

* OP Should Not Have Unused Input, test=develop

* add GetExpectedKernelType, test=develop

* define fluid alias in paddle.tensor and paddle.nn dir test=develop

* from layer import loss in paddle.nn dir test=develop

* add kron op and its python API, doc and unittests.
* add kron in paddle.complex

* Add cholesky_op forward part. test=develop

* Complete cholesky_op forward part. test=develop

* Add cholesky_op backward part. test=develop

* Complete cholesky_op backward part. test=develop

* Refine cholesky_op error check and docs. test=develop

* Add grad_check unit test for cholesky_op. test=develop

* Fix sample code in cholesky doc. test=develop

* Refine some error messages of cholesky_op. test=develop

* Refine some error messages of cholesky_op. test=develop

* Remove unused input in cholesky_grad. test=develop

* Remove unused input in cholesky_grad. test=develop

* Fix stream for cusolverDnSetStream. test=develop

* Update PADDLE_ENFORCE_CUDA_SUCCESS from cholesky_op to adapt to latest code.
test=develop

* Add CUSOLVER ERROR in enforce.h
test=develop

* Fix the missing return value in cholesky. test=develop

* Init complex number neural network, test=develop

* Improve doc writing, test=develop

* Fix elementwise add & sub, test=develop

* Fix elementwise mul act, test=develop

* a) add ut for complex variable; b) remove arg act in elementwise_ops. test=develop

* add gather split squeeze stack unsqueeze api test=develop

* add gather split squeeze stack unsqueeze api test=develop

* fix bug test=develop

* fix bug test=develop

* fix bug test=develop

* fix bug test=develop

* fix bug test=develop

* upload code for tensor.rand

* fix import

* update example, change paddle.tensor.rand to paddle.rand

* change 'variable' to 'Variable',  test=develop

change 'variable' to 'Variable' in description,  test=develop

* add pre-commit check

* add pre-commit check

* pre-commit check, test=develop

* add more unittest code

* trigger ci, test=develop

* pre-commit check, test=develop

* update api and test comment, test=develop

* update api and test comment, test=develop

* add more type check, test=develop

* add detail error info for device, test=develop

* add unnittest, test=develop

* resolve conflict and pre-commit check, test=develop

* add clamp api, test=develop

* test=develop
Co-authored-by: Nwuxing03 <wuxing03@baidu.com>

* add gradient check to reduce ops

* add skip gradient check to reduce ops test=develop

* modify stack api test=develop

* add bmm op and move serval ops from fluid.layers to tensor test=develop

* add paddle.tensor
test=develop

* polish gpu where codes
test=develop

* polish test code
test=develop

* add addcmul, test=develop