MODEL_ZOO_en.md 8.9 KB
Newer Older
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18
# Model Zoos and Baselines

# Content
- [Basic Settings](#Basic-Settings)
    - [Test Environment](#Test-Environment)
    - [General Settings](#General-Settings)
    - [Training strategy](#Training-strategy)
    - [ImageNet pretraining model](#ImageNet-pretraining-model)
- [Baseline](#Baseline)
    - [Object Detection](#Object-Detection)
    - [Instance Segmentation](#Instance-Segmentation)
    - [PaddleYOLO](#PaddleYOLO)
    - [Face Detection](#Face-Detection)
    - [Rotated Object detection](#Rotated-Object-detection)
    - [KeyPoint Detection](#KeyPoint-Detection)
    - [Multi Object Tracking](#Multi-Object-Tracking)

# Basic Settings
qq_30618961's avatar
qq_30618961 已提交
19 20 21 22 23 24 25 26 27 28 29 30

## Test Environment

- Python 3.7
- PaddlePaddle Daily version
- CUDA 10.1
- cuDNN 7.5
- NCCL 2.4.8

## General Settings

- All models were trained and tested in the COCO17 dataset.
31
- The codes of [YOLOv5](https://github.com/PaddlePaddle/PaddleYOLO/tree/develop/configs/yolov5),[YOLOv6](https://github.com/PaddlePaddle/PaddleYOLO/tree/develop/configs/yolov6),[YOLOv7](https://github.com/PaddlePaddle/PaddleYOLO/tree/develop/configs/yolov7) and [YOLOv8](https://github.com/PaddlePaddle/PaddleYOLO/tree/develop/configs/yolov8) can be found in [PaddleYOLO](https://github.com/PaddlePaddle/PaddleYOLO). Note that **the LICENSE of PaddleYOLO is GPL 3.0**.
qq_30618961's avatar
qq_30618961 已提交
32 33 34 35 36 37 38
- Unless special instructions, all the ResNet backbone network using [ResNet-B](https://arxiv.org/pdf/1812.01187) structure.
- **Inference time (FPS)**: The reasoning time was calculated on a Tesla V100 GPU by `tools/eval.py` testing all validation sets in FPS (number of pictures/second). CuDNN version is 7.5, including data loading, network forward execution and post-processing, and Batch size is 1.

## Training strategy

- We adopt and [Detectron](https://github.com/facebookresearch/Detectron/blob/master/MODEL_ZOO.md#training-schedules) in the same training strategy.
- 1x strategy indicates that when the total batch size is 8, the initial learning rate is 0.01, and the learning rate decreases by 10 times after 8 epoch and 11 epoch, respectively, and the final training is 12 epoch.
39
- 2x strategy is twice as much as strategy 1x, and the learning rate adjustment position of epochs is twice as much as strategy 1x.
qq_30618961's avatar
qq_30618961 已提交
40 41

## ImageNet pretraining model
42
Paddle provides a skeleton network pretraining model based on ImageNet. All pre-training models were trained by standard Imagenet 1K dataset. ResNet and MobileNet are high-precision pre-training models obtained by cosine learning rate adjustment strategy or SSLD knowledge distillation training. Model details are available at [PaddleClas](https://github.com/PaddlePaddle/PaddleClas).
qq_30618961's avatar
qq_30618961 已提交
43 44


45 46 47
# Baseline

## Object Detection
qq_30618961's avatar
qq_30618961 已提交
48 49 50

### Faster R-CNN

51
Please refer to [Faster R-CNN](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/faster_rcnn/)
qq_30618961's avatar
qq_30618961 已提交
52

53
### YOLOv3
qq_30618961's avatar
qq_30618961 已提交
54

55
Please refer to [YOLOv3](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/yolov3/)
qq_30618961's avatar
qq_30618961 已提交
56

57
### PP-YOLOE/PP-YOLOE+
qq_30618961's avatar
qq_30618961 已提交
58

59
Please refer to [PP-YOLOE](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/ppyoloe/)
qq_30618961's avatar
qq_30618961 已提交
60

61
### PP-YOLO/PP-YOLOv2
qq_30618961's avatar
qq_30618961 已提交
62

63
Please refer to [PP-YOLO](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/ppyolo/)
qq_30618961's avatar
qq_30618961 已提交
64

65
### PicoDet
qq_30618961's avatar
qq_30618961 已提交
66

67
Please refer to [PicoDet](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/picodet)
qq_30618961's avatar
qq_30618961 已提交
68

69
### RetinaNet
qq_30618961's avatar
qq_30618961 已提交
70

71
Please refer to [RetinaNet](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/retinanet/)
qq_30618961's avatar
qq_30618961 已提交
72

73 74 75 76 77 78 79
### Cascade R-CNN

Please refer to [Cascade R-CNN](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/cascade_rcnn)

### SSD/SSDLite

Please refer to [SSD](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/ssd/)
qq_30618961's avatar
qq_30618961 已提交
80

81 82 83
### FCOS

Please refer to [FCOS](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/fcos/)
qq_30618961's avatar
qq_30618961 已提交
84

85
### CenterNet
qq_30618961's avatar
qq_30618961 已提交
86

87
Please refer to [CenterNet](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/centernet/)
qq_30618961's avatar
qq_30618961 已提交
88

89
### TTFNet/PAFNet
qq_30618961's avatar
qq_30618961 已提交
90

91
Please refer to [TTFNet](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/ttfnet/)
qq_30618961's avatar
qq_30618961 已提交
92 93 94

### Group Normalization

95
Please refer to [Group Normalization](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/gn/)
qq_30618961's avatar
qq_30618961 已提交
96 97 98

### Deformable ConvNets v2

99
Please refer to [Deformable ConvNets v2](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/dcn/)
qq_30618961's avatar
qq_30618961 已提交
100 101 102

### HRNets

103
Please refer to [HRNets](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/hrnet/)
qq_30618961's avatar
qq_30618961 已提交
104 105 106

### Res2Net

107 108 109 110 111
Please refer to [Res2Net](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/res2net/)

### ConvNeXt

Please refer to [ConvNeXt](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/convnext/)
qq_30618961's avatar
qq_30618961 已提交
112 113 114

### GFL

115
Please refer to [GFL](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/gfl)
qq_30618961's avatar
qq_30618961 已提交
116

117 118 119 120 121 122 123 124 125 126 127 128 129 130 131
### TOOD

Please refer to [TOOD](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/tood)

### PSS-DET(RCNN-Enhance)

Please refer to [PSS-DET](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/rcnn_enhance)

### DETR

Please refer to [DETR](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/detr)

### Deformable DETR

Please refer to [Deformable DETR](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/deformable_detr)
qq_30618961's avatar
qq_30618961 已提交
132

133
### Sparse R-CNN
qq_30618961's avatar
qq_30618961 已提交
134

135
Please refer to [Sparse R-CNN](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/sparse_rcnn)
F
Feng Ni 已提交
136

137 138 139
###  Vision Transformer

Please refer to [Vision Transformer](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/vitdet)
F
Feng Ni 已提交
140 141 142

### YOLOX

143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163
Please refer to [YOLOX](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/yolox)


## Instance-Segmentation

### Mask R-CNN

Please refer to [Mask R-CNN](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/mask_rcnn/)

### Cascade R-CNN

Please refer to [Cascade R-CNN](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/cascade_rcnn)

### SOLOv2

Please refer to [SOLOv2](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/solov2/)


## [PaddleYOLO](https://github.com/PaddlePaddle/PaddleYOLO)

Please refer to [Model Zoo for PaddleYOLO](https://github.com/PaddlePaddle/PaddleYOLO/tree/develop/docs/MODEL_ZOO_en.md)
164 165 166

### YOLOv5

167
Please refer to [YOLOv5](https://github.com/PaddlePaddle/PaddleYOLO/tree/develop/configs/yolov5)
168

169
### YOLOv6(v3.0)
170

171
Please refer to [YOLOv6](https://github.com/PaddlePaddle/PaddleYOLO/tree/develop/configs/yolov6)
172 173 174

### YOLOv7

175 176
Please refer to [YOLOv7](https://github.com/PaddlePaddle/PaddleYOLO/tree/develop/configs/yolov7)

177 178 179 180
### YOLOv8

Please refer to [YOLOv7](https://github.com/PaddlePaddle/PaddleYOLO/tree/develop/configs/yolov8)

181 182 183 184 185 186 187 188 189 190 191 192
### RTMDet

Please refer to [RTMDet](https://github.com/PaddlePaddle/PaddleYOLO/tree/develop/configs/rtmdet)


## Face Detection

Please refer to [Model Zoo for Face Detection](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/face_detection)

### BlazeFace

Please refer to [BlazeFace](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/face_detection/)
F
Feng Ni 已提交
193

qq_30618961's avatar
qq_30618961 已提交
194

W
wangxinxin08 已提交
195
## Rotated Object detection
qq_30618961's avatar
qq_30618961 已提交
196

197 198 199 200 201 202 203 204 205 206 207 208 209
Please refer to [Model Zoo for Rotated Object Detection](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/rotate)

### PP-YOLOE-R

Please refer to [PP-YOLOE-R](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/rotate/ppyoloe_r)

### FCOSR

Please refer to [FCOSR](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/rotate/fcosr)

### S2ANet

Please refer to [S2ANet](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/rotate/s2anet)
W
wangguanzhong 已提交
210

F
Feng Ni 已提交
211

W
wangguanzhong 已提交
212 213
## KeyPoint Detection

214 215
Please refer to [Model Zoo for KeyPoint Detection](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/keypoint)

W
wangguanzhong 已提交
216 217
### PP-TinyPose

218 219 220 221 222
Please refer to [PP-TinyPose](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/keypoint/tiny_pose)

### HRNet

Please refer to [HRNet](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/keypoint/hrnet)
W
wangguanzhong 已提交
223

224
### Lite-HRNet
W
wangguanzhong 已提交
225

226
Please refer to [Lite-HRNet](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/keypoint/lite_hrnet)
W
wangguanzhong 已提交
227

228
### HigherHRNet
W
wangguanzhong 已提交
229

230
Please refer to [HigherHRNet](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/keypoint/higherhrnet)
W
wangguanzhong 已提交
231

F
Feng Ni 已提交
232

W
wangguanzhong 已提交
233 234
## Multi-Object Tracking

235 236
Please refer to [Model Zoo for Multi-Object Tracking](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/mot)

F
Feng Ni 已提交
237
### DeepSORT
W
wangguanzhong 已提交
238

239
Please refer to [DeepSORT](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/mot/deepsort)
W
wangguanzhong 已提交
240

241
### ByteTrack
W
wangguanzhong 已提交
242

243
Please refer to [ByteTrack](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/mot/bytetrack)
W
wangguanzhong 已提交
244

245
### OC-SORT
F
Feng Ni 已提交
246

247
Please refer to [OC-SORT](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/mot/ocsort)
F
Feng Ni 已提交
248

249 250 251 252 253
### FairMOT/MC-FairMOT

Please refer to [FairMOT](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/mot/fairmot)

### JDE
W
wangguanzhong 已提交
254

255
Please refer to [JDE](https://github.com/PaddlePaddle/PaddleDetection/tree/develop/configs/mot/jde)