infer deploy:fix trt keypointbatchsize; lite deploy: update total pipeline time from per person to per image (#4339)

* update picodet inference deploy

* add keypoint top-down cpp infer; total:5ms,pre:0.7ms,infer:3.8ms,post:0.01ms

* add dark_pose support

Revert "add keypoint top-down cpp infer; total:5ms,pre:0.7ms,infer:3.8ms,post:0.01ms (#4058)" (#4216)

This reverts commit 08619b4e.

* fix not find dirent.h on windows

* using cv::glob replace fileststem, fileststem need std++17

* fix bug when benchmark=True

* split warmup and repeat

* support xpu inference

* Automatically set use_dynamic_shape

* fix batch_size when trt infer

* bs>1 for YOLO

* s2anet fix export and deploy

* remove redundant code

* fix cpp for s2anet deploy

* fix bug of get_categories

* rename poly_to_rbox to poly2rbox

* add some comment for function

* add inference benchmark

* fix paddle inference name problem, and update doc

* set default value

* fix inference lib name in static

* update deploy doc, fix build error of windows

* add annotation of PADDLE_LIB_NAME

* set min_subgraph_size=33 as default, fix bug of fcos_dcn_r50_fpn_1x

* TensorRT support dynamic shape

* add TensorRT doc

* update model visual tool, test=fix_document

* python support trt6

* cpp support trt6

* fix code error

* clean code

* python trt dynamic shape and fix code style

* disable log and update doc style

* update opencv lib url

* solov2 trt support dynamic shape

* support tensorrt_int8

* add TensorRT int8 calib data for ppyolo

* set workspace_size=1 << 30 as default

* remove content

* remove some content, and fix code style

* remove images

* update doc style

Merge dygraph branch into master branch.
Co-authored-by: NFDInSky <48318485+FDInSky@users.noreply.github.com>
Co-authored-by: Nsunxl1988 <47514455+sunxl1988@users.noreply.github.com>
Co-authored-by: Nwangguanzhong <jerrywgz@126.com>
Co-authored-by: Nwangxinxin08 <69842442+wangxinxin08@users.noreply.github.com>
Co-authored-by: Nwanghuancoder <wanghuancoder@163.com>
Co-authored-by: Ncnn <liuhui29@baidu.com>
Co-authored-by: NGuanghua Yu <742925032@qq.com>
Co-authored-by: NKaipeng Deng <dengkaipeng@baidu.com>
Co-authored-by: Nroot <root@bjyz-sys-gpu-kongming0.bjyz.baidu.com>

* add benchmark on win10 cpp finer, fix bug of _mkdir on windows VS2019 Release bulig

* win cpp use Predictor to inference

* 测试环境描述更加详细

* modify cpp output path

* fix compile error

* modify docs for windows

fix compile error in code
modify code for inference

* deploy code support camera

* Add TesnorRT support in cpp deployment
* Change putText style

* deploy/cpp : Update cpp ineference solution

* add README.md to deploy

* deploy/cpp : add PadStride

* deploy/cpp : add output visualization

* deploy/cpp: add video support

* fix coding style problem

* deploy/cpp : add README.md

* deploy/cpp : update docs

* deploy/cpp : update linux build scripts

* deploy/cpp : update linux build docs

* udpate docs

* deploy/cpp : update windows build docs

* depoy/cpp: fix coding style

* fix coding style

* Create CMakeSettings.json

* Update README.md

* Update windows_vs2019_build.md

* Update CMakeLists.txt

* Update linux_build.md

* Update CMakeLists.txt

* deploy/cpp : update linux build script

* update doc structures and support arch Face