tests analysers stops display values of fps and accuracy
Created by: pmajchrzak
The most probably this commit: https://github.com/PaddlePaddle/Paddle/commit/122b37ce62b0192dab18a228dc8ad42c8d4b8229 causes test analysers: test_analyzer_image_classification, test_analyzer_int8_image_classification, etc. stops to display pieces of information about test results: accuracy and fps.
now is:
PROFILE: interrupts/evictions/bytes = 491/24/27656
[ OK ] Analyzer_int8_image_classification.quantization (10843 ms)
[----------] 1 test from Analyzer_int8_image_classification (10843 ms total)
[----------] Global test environment tear-down
[==========] 1 test from 1 test case ran. (10843 ms total)
[ PASSED ] 1 test.
but should be:
PROFILE: interrupts/evictions/bytes = 2017/141/75104
I1203 20:07:59.107672 49943 helper.h:322] ====== threads: 1, thread id: 0 ======
I1203 20:07:59.107692 49943 helper.h:324] ====== batch size: 1, iterations: 1000, repetitions: 1 ======
I1203 20:07:59.107695 49943 helper.h:326] ====== batch latency: 20.1677ms, number of samples: 1000, sample latency: 20.1677ms, fps: 49.5842, data type: int8_t ======
I1203 20:07:59.113900 49943 tester_helper.h:520] INT8: avg fps: 49.5842, avg latency: 20.1677 ms
I1203 20:07:59.113971 49943 tester_helper.h:506] --- Accuracy summary ---
I1203 20:07:59.113976 49943 tester_helper.h:507] Accepted top1_accuracy drop threshold: 0.01. (condition: (FP32_top1_accuracy - INT8_top1_accuracy ) <= threshold)
I1203 20:07:59.113979 49943 tester_helper.h:511] FP32: avg top1_accuracy 0.0000
I1203 20:07:59.113982 49943 tester_helper.h:513] INT8: avg top1_accuracy 0.7630
[ OK ] Analyzer_int8_image_classification.quantization (35896 ms)
[----------] 1 test from Analyzer_int8_image_classification (35896 ms total)
[----------] Global test environment tear-down
[==========] 1 test from 1 test case ran. (35896 ms total)
[ PASSED ] 1 test.