Crash when training sentiment classification task using Debug build
Created by: jczaja
There is crash when trying to train sentiment classification task using any of available models with Debug PaddlePaddle build. It works fine with Release build of PaddlePaddle
Model: https://github.com/PaddlePaddle/models/tree/develop/PaddleNLP/sentiment_classification
Engine: Training on CPU (with MKL-DNN or without MKL-DNN) . GPU execution was not tested.
Operating System: Centos 7 & GCC 4.8.5 / Centos7 & GCC 7.3.1
PaddlePaddle version: develop branch (tested commit 1f032c53) , but issue occurs on older revisions as well.
PaddlePaddle configuring commandline:
cmake -DCMAKE_BUILD_TYPE=Debug -DWITH_MKLDNN=ON -DWITH_GPU=OFF -DWITH_TESTING=ON -DWITH_PYTHON=ON -DWITH_INFERENCE_API_TEST=ON
Reproduce:
- Modify https://github.com/PaddlePaddle/models/blob/develop/PaddleNLP/sentiment_classification/run.sh to use CPU : set
use_cuda false
in train section - run.sh train
More details: Crash is triggered here(read op): https://github.com/PaddlePaddle/Paddle/blob/0aed095188c032fd27bf4d11e8b6c9b569e9d41d/paddle/fluid/operators/reader/buffered_reader.cc#L169
due to some invalid data of position_
object.
Callstack: stack.txt