提交 c932e072 编写于 作者: L lizz

Merge branch 'change_description' into 'master'

Add commit id in benchmark

See merge request open-mmlab/mmaction-lite!373
......@@ -5,18 +5,22 @@ We compare our results with some popular frameworks and official releases in ter
## Comparision Rules
Here we compare our MMAction repo with other video understanding toolboxes in the same data and model settings
by the training time per iteration.
by the training time per iteration. We use the
commit id [7f3490d](https://github.com/open-mmlab/mmaction/tree/7f3490d3db6a67fe7b87bfef238b757403b670e3)(1/5/2020) of MMAction V0.1,
commit id [8d53d6f](https://github.com/mit-han-lab/temporal-shift-module/tree/8d53d6fda40bea2f1b37a6095279c4b454d672bd) of Temporal-Shift-Module,
commit id [133e40f](https://github.com/facebookresearch/SlowFast/tree/133e40f8349ce37b0e6168639da0811a413579c8) of PySlowFast,
commit id [f13707f](https://github.com/wzmsltw/BSN-boundary-sensitive-network/tree/f13707fbc362486e93178c39f9c4d398afe2cb2f)(12/12/2018) of BSN(boundary sensitive network).
To ensure the fairness of the comparison, the comparison experiments were conducted under the same hardware environment and using the same dataset.
For each model setting, we kept the same data preprocessing methods to make sure the same feature input.
In addition, we also used MemCache, a distributed cached system, to load the data for the same IO time.
The time we measured is the average training time for an iteration, including data processing and model training.
The training speed is measure with s/iter. The lower, the better.
## Recognizers
| Model | MMAction (s/iter) | MMAction V0.1 (s/iter) | [Temporal-Shift-Module](https://github.com/mit-han-lab/temporal-shift-module) (s/iter) | [PySlowFast](https://github.com/facebookresearch/SlowFast) (s/iter) |
| Model | MMAction (s/iter) | MMAction V0.1 (s/iter) | Temporal-Shift-Module (s/iter) | PySlowFast (s/iter) |
| :--- | :---------------: | :--------------------: | :----------------------------: | :-----------------: |
| TSN ([tsn_r50_1x1x3_100e_kinetics400_rgb](/configs/recognition/tsn/tsn_r50_1x1x3_100e_kinetics400_rgb.py)) | **0.29** | 0.36 | 0.45 | x |
| I3D ([i3d_r50_32x2x1_100e_kinetics400_rgb](/configs/recognition/i3d/i3d_r50_32x2x1_100e_kinetics400_rgb.py)) | **0.45** | 0.58 | x | x |
......@@ -30,7 +34,7 @@ The time we measured is the average training time for an iteration, including da
## Localizers
| Model | MMAction (s/iter) | [BSN(boundary sensitive network)](https://github.com/wzmsltw/BSN-boundary-sensitive-network) (s/iter) |
| Model | MMAction (s/iter) | BSN(boundary sensitive network) (s/iter) |
| :--- | :---------------: | :-------------------------------------: |
| BSN ([TEM + PEM + PGM](/configs/localization/bsn)) | **0.074(TEM)+0.040(PEM)** | 0.101(TEM)+0.040(PEM) |
| BMN ([bmn_400x100_2x8_9e_activitynet_feature](/configs/localization/bmn/bmn_400x100_2x8_9e_activitynet_feature.py)) | **3.27** | 3.30 |
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册