Created by: chenwhql
In order to record which errors were triggered during the user's use of Paddle, find high-frequency trigger errors, optimize the high-frequency error information, and add the function of storing and parsing error logs.
- log saving path:
~/.cache/paddle/paddle-error-summary-2020-XX-XX.log
- save format example:
λ yq01-gpu-255-137-12-00 /work/paddle/tools {develop} cat ~/.cache/paddle/paddle-error-summary-2020-01-14.log
FileLine: /work/paddle/paddle/fluid/operators/mul_op.cc:90
Summary: InvalidArgumentError: After flatten the input tensor X and Y to 2-D dimensions matrix X1 and Y1, the matrix X1's width must be equal with matrix Y1's height. But received X's shape = [10, 13], X1's shape = [10, 13], X1's width = 13; Y's shape = [12, 1], Y1's shape = [12, 1], Y1's height = 12.
[Hint: Expected x_mat_dims[1] == y_mat_dims[0], but received x_mat_dims[1]:13 != y_mat_dims[0]:12.]
FileLine: /work/paddle/paddle/fluid/operators/mul_op.cc:90
Summary: InvalidArgumentError: After flatten the input tensor X and Y to 2-D dimensions matrix X1 and Y1, the matrix X1's width must be equal with matrix Y1's height. But received X's shape = [10, 13], X1's shape = [10, 13], X1's width = 13; Y's shape = [12, 1], Y1's shape = [12, 1], Y1's height = 12.
[Hint: Expected x_mat_dims[1] == y_mat_dims[0], but received x_mat_dims[1]:13 != y_mat_dims[0]:12.]
FileLine: /work/paddle/paddle/fluid/operators/optimizers/sgd_op.cc:39
Summary: Error: Maybe the Input variable LearningRate has not been initialized. You may need to confirm if you put exe.run(startup_program) after optimizer.minimize function.
[Hint: Expected framework::product(lr_dims) != 0, but received framework::product(lr_dims):0 == 0:0.]
FileLine: /work/paddle/paddle/fluid/operators/sequence_ops/sequence_pool_op.cc:37
Summary: Error: The LoD level Input(X) of sequence_pool should be larger than 0.
[Hint: Expected in_lod_level > 0, but received in_lod_level:0 <= 0:0.]
- parse result example:
λ yq01-gpu-255-137-12-00 /work/paddle/tools {develop} python count_error_frequence.py
/root/.cache/paddle/paddle-error-summary-2020-01-14.log
File:Line - Error Count
paddle/fluid/operators/mul_op.cc:90 - 2
paddle/fluid/operators/optimizers/sgd_op.cc:39 - 1
paddle/fluid/operators/sequence_ops/sequence_pool_op.cc:37 - 1