diff --git a/docs/benchmark.md b/docs/benchmark.md index 014c9ea83b37c5cfd67652c21d85277cc562316a..aaae2fa3ef4844ea0c8f5ab9fd1d02f2d84e627c 100644 --- a/docs/benchmark.md +++ b/docs/benchmark.md @@ -7,11 +7,14 @@ We compare our results with some other popular frameworks in terms of speed and | Model | Dataset | Setting | Framework | Iter time | Memory | log | | ---------- | ----------- | -------- | ------------- | --------- | ------ | ---------- | | TSN | Kinetics400 | tsn_r50_1x1x3_100e_kinetics400_rgb | mmaction-lite |0.2966(0.0030)|8339| | +| | Kinetics400 | tsn_r50_1x1x3_100e_kinetics400_rgb(video) | mmaction-lite |0.4165(0.0098)|8339| | | | Kinetics400 | tsn_r50_1x1x3_100e_kinetics400_rgb | open-mmaction |0.3659(0.0102)|8245| | | I3D | Kinetics400 | i3d_r50_32x2x1_100e_kinetics400_rgb| mmaction-lite |0.4528(0.1458)|5169| | +| | Kinetics400 | i3d_r50_32x2x1_100e_kinetics400_rgb(video)| mmaction-lite |0.4795(0.0032)|5169| | | | Kinetics400 | i3d_r50_fast32x2x1_100e_kinetics400_rgb| mmaction-lite |0.3886(0.3733)|5169| | | | Kinetics400 | i3d_r50_32x2x1_100e_kinetics400_rgb| open-mmaction |0.5873(0.0867)|5065| | | TSM | Kinetics400 | tsm_r50_1x1x8_100e_kinetics400_rgb | mmaction-lite |0.3052(0.0095)|7077| | +| | Kinetics400 | tsm_r50_1x1x8_100e_kinetics400_rgb(video) | mmaction-lite |0.3027(0.0089)|7077| | | | Kinetics400 | tsm_r50_1x1x8_100e_kinetics400_rgb | HAN |0.3843(0.0143)|9337| | | Slowfast | Kinetics400 | slowfast_r50_4x16x1_256e_kinetics400_rgb(video) | mmaction-lite |0.80|6203|ready| | | Kinetics400 | slowfast_r50_4x16x1_256e_kinetics400_rgb(video) | PySlowfast |1.40|6850|ready| @@ -23,6 +26,7 @@ We compare our results with some other popular frameworks in terms of speed and | | Kinetics400 | slowonly_r50_8x8x1_256e_kinetics400_rgb(video)| PySlowfast |1.29|6400|ready| | R(2+1)D | Kinetics400 | r2plus1d_r34_8x8x1_180e_kinetics400_rgb(frame) | mmaction-lite |0.48|3998|ready| | | Kinetics400 | r2plus1d_r34_8x8x1_180e_kinetics400_rgb(frame) | mmaction-lite |1.29|12974|ready| +| | Kinetics400 | r2plus1d_r34_8x8x1_180e_kinetics400_rgb(video) | mmaction-lite |0.8340(0.0725)|10339| | ### Localizers