Created by: 1205469665

1. PaddleHub 1.5.4 PaddlePaddle 1.7.1post107
2. linux python 3.69

使用python flask 框架编写服务 文本分类服务 , 分词 在一定的时间内多个线程 多台机器只调用 文本分类 或者分词 不会报错

但是如果多个线程 有不同的线程调用文本分类 或者分类 就是两个接口都会调用 就会报错 服务还会直接挂掉

此错误会导致服务直接挂掉 W0410 17:05:46.529703 22852 init.cc:209] Warning: PaddlePaddle catches a failure signal, it may not work properly W0410 17:05:46.529724 22852 init.cc:211] You could check whether you killed PaddlePaddle thread/process accidentally or report the case to PaddlePaddle W0410 17:05:46.529728 22852 init.cc:214] The detail failure signal is:

W0410 17:05:46.529732 22852 init.cc:217] *** Aborted at 1586509546 (unix time) try "date -d @1586509546" if you are using GNU date *** W0410 17:05:46.532021 22852 init.cc:217] PC: @ 0x0 (unknown) W0410 17:05:46.532105 22852 init.cc:217] *** SIGSEGV (@0x9) received by PID 22469 (TID 0x7f29df7fe700) from PID 9; stack trace: *** W0410 17:05:46.534162 22852 init.cc:217] @ 0x7f2c44f2a5f0 (unknown) W0410 17:05:46.536512 22852 init.cc:217] @ 0x7f2bf1bc2fef std::_Sp_counted_base<>::_M_release() W0410 17:05:46.538888 22852 init.cc:217] @ 0x7f2bf1bc48bc std::vector<>::operator=() W0410 17:05:46.542672 22852 init.cc:217] @ 0x7f2bf412036d paddle::operators::FetchOp::RunImpl() W0410 17:05:46.545567 22852 init.cc:217] @ 0x7f2bf4827ed0 paddle::framework::OperatorBase::Run() W0410 17:05:46.549872 22852 init.cc:217] @ 0x7f2bf1f266c6 paddle::framework::Executor::RunPreparedContext() W0410 17:05:46.552654 22852 init.cc:217] @ 0x7f2bf1f29d8b paddle::framework::Executor::Run() W0410 17:05:46.553498 22852 init.cc:217] @ 0x7f2bf1babf8e ZZN8pybind1112cpp_function10initializeIZN6paddle6pybindL22pybind11_init_core_avxERNS_6moduleEEUlRNS2_9framework8ExecutorERKNS6_11ProgramDescEPNS6_5ScopeEibbRKSt6vectorISsSaISsEEE108_vIS8_SB_SD_ibbSI_EINS_4nameENS_9is_methodENS_7siblingEEEEvOT_PFT0_DpT1_EDpRKT2_ENUlRNS_6detail13function_callEE1_4_FUNES10 W0410 17:05:46.555279 22852 init.cc:217] @ 0x7f2bf1c00461 pybind11::cpp_function::dispatcher() W0410 17:05:46.555611 22852 init.cc:217] @ 0x55d258db1c54 _PyCFunction_FastCallDict W0410 17:05:46.555817 22852 init.cc:217] @ 0x55d258e39c0e call_function W0410 17:05:46.556154 22852 init.cc:217] @ 0x55d258e5c75a _PyEval_EvalFrameDefault W0410 17:05:46.556355 22852 init.cc:217] @ 0x55d258e32e66 _PyEval_EvalCodeWithName W0410 17:05:46.556551 22852 init.cc:217] @ 0x55d258e33ed6 fast_function W0410 17:05:46.556752 22852 init.cc:217] @ 0x55d258e39b95 call_function W0410 17:05:46.557062 22852 init.cc:217] @ 0x55d258e5d51c _PyEval_EvalFrameDefault W0410 17:05:46.557279 22852 init.cc:217] @ 0x55d258e32e66 _PyEval_EvalCodeWithName W0410 17:05:46.557477 22852 init.cc:217] @ 0x55d258e33ed6 fast_function W0410 17:05:46.557678 22852 init.cc:217] @ 0x55d258e39b95 call_function W0410 17:05:46.557986 22852 init.cc:217] @ 0x55d258e5d51c _PyEval_EvalFrameDefault W0410 17:05:46.558207 22852 init.cc:217] @ 0x55d258e32e66 _PyEval_EvalCodeWithName W0410 17:05:46.558408 22852 init.cc:217] @ 0x55d258e33ed6 fast_function W0410 17:05:46.558609 22852 init.cc:217] @ 0x55d258e39b95 call_function W0410 17:05:46.558917 22852 init.cc:217] @ 0x55d258e5d51c _PyEval_EvalFrameDefault W0410 17:05:46.559137 22852 init.cc:217] @ 0x55d258e32e66 _PyEval_EvalCodeWithName W0410 17:05:46.559337 22852 init.cc:217] @ 0x55d258e33ed6 fast_function W0410 17:05:46.559538 22852 init.cc:217] @ 0x55d258e39b95 call_function W0410 17:05:46.559847 22852 init.cc:217] @ 0x55d258e5d51c _PyEval_EvalFrameDefault W0410 17:05:46.560042 22852 init.cc:217] @ 0x55d258e32e66 _PyEval_EvalCodeWithName W0410 17:05:46.560253 22852 init.cc:217] @ 0x55d258e33e73 fast_function W0410 17:05:46.560456 22852 init.cc:217] @ 0x55d258e39b95 call_function W0410 17:05:46.560765 22852 init.cc:217] @ 0x55d258e5c75a _PyEval_EvalFrameDefault ^Cbash: 行 1: 22469 段错误 (吐核)env "JETBRAINS_REMOTE_RUN"="1" "LIBRARY_ROOTS"="C:/Users/Administrator/.PyCharm2018.3/system/remote_sources/1956375958/732364776;C:/Users/Administrator/.PyCharm2018.3/system/remote_sources/1956375958/-1465301300;C:/Users/Administrator/.PyCharm2018.3/system/python_stubs/1956375958;F:/开发软件/PyCharm 2018.3.5/helpers/python-skeletons;F:/开发软件/PyCharm 2018.3.5/helpers/typeshed/stdlib/3;F:/开发软件/PyCharm 2018.3.5/helpers/typeshed/stdlib/2and3;F:/开发软件/PyCharm 2018.3.5/helpers/typeshed/third_party/3;F:/开发软件/PyCharm 2018.3.5/helpers/typeshed/third_party/2and3" "PYDEVD_LOAD_VALUES_ASYNC"="True" "PYTHONPATH"="/home/ssh-project/pwlp-judged:/root/.pycharm_helpers/pycharm_matplotlib_backend:/root/.pycharm_helpers/third_party/thriftpy:/root/.pycharm_helpers/pydev:C:/Users/Administrator/.PyCharm2018.3/system/cythonExtensions:/home/ssh-project/pwlp-judged" "PYTHONIOENCODING"="UTF-8" "PYTHONDONTWRITEBYTECODE"="1" "IPYTHONENABLE"="True" "PYCHARM_MATPLOTLIB_PORT"="51810" "PYCHARM_HOSTED"="1" "PYTHONUNBUFFERED"="1" "IDE_PROJECT_ROOTS"="/home/ssh-project/pwlp-judged" '/home/anaconda3/envs/cail/bin/python3.6' '-u' '/root/.pycharm_helpers/pydev/pydevd.py' '--multiproc' '--qt-support=auto' '--client' '0.0.0.0' '--port' '42281' '--file' '/home/ssh-project/pwlp-judged/setup.py'

此错误导致程序不能正常调用

File "/home/anaconda3/envs/cail/lib/python3.6/site-packages/flask/app.py", line 1949, in full_dispatch_request rv = self.dispatch_request() File "/home/anaconda3/envs/cail/lib/python3.6/site-packages/flask/app.py", line 1935, in dispatch_request return self.view_functionsrule.endpoint File "/home/ssh-project/pwlp-judged/controller/paddle_nlp_controller.py", line 71, in initCustomIdfCorpus utils.init_custom_idf_corpus(document_list,allowPOS=('ns', 'n', 'vn', 'v', 'a')) File "/home/ssh-project/pwlp-judged/paddlenlp/utils/utils.py", line 67, in init_custom_idf_corpus default_tfidf.init_custom_idf_corpus(sentence_list,allowPOS) File "/home/ssh-project/pwlp-judged/paddlenlp/extractkeyword/tfidf.py", line 162, in init_custom_idf_corpus words = self.seg_sentence(allowPOS, sentence) File "/home/ssh-project/pwlp-judged/paddlenlp/extractkeyword/tfidf.py", line 122, in seg_sentence wt = self.tokenizer.lexical_analysis(sentence) File "/home/ssh-project/pwlp-judged/paddlenlp/utils/utils.py", line 32, in lexical_analysis return lac.lexical_analysis(data={'text': document}, user_dict=None) File "/home/anaconda3/envs/cail/lib/python3.6/site-packages/paddlehub/module/module.py", line 543, in call return_numpy=False) File "/home/anaconda3/envs/cail/lib/python3.6/site-packages/paddle/fluid/executor.py", line 783, in run six.reraise(*sys.exc_info()) File "/home/anaconda3/envs/cail/lib/python3.6/site-packages/six.py", line 696, in reraise raise value File "/home/anaconda3/envs/cail/lib/python3.6/site-packages/paddle/fluid/executor.py", line 778, in run use_program_cache=use_program_cache) File "/home/anaconda3/envs/cail/lib/python3.6/site-packages/paddle/fluid/executor.py", line 831, in _run_impl use_program_cache=use_program_cache) File "/home/anaconda3/envs/cail/lib/python3.6/site-packages/paddle/fluid/executor.py", line 905, in _run_program fetch_var_name) paddle.fluid.core_avx.EnforceNotMet:

C++ Call Stacks (More useful to developers):

0 std::string paddle::platform::GetTraceBackString<std::string const&>(std::string const&, char const*, int) 1 paddle::platform::EnforceNotMet::EnforceNotMet(std::string const&, char const*, int) 2 paddle::operators::LookupTableKernel::Compute(paddle::framework::ExecutionContext const&) const 3 std::_Function_handler<void (paddle::framework::ExecutionContext const&), paddle::framework::OpKernelRegistrarFunctor<paddle::platform::CPUPlace, false, 0ul, paddle::operators::LookupTableKernel, paddle::operators::LookupTableKernel, paddle::operators::LookupTableKernel >::operator()(char const*, char const*, int) const::{lambda(paddle::framework::ExecutionContext const&)#1 (closed)}>::_M_invoke(std::_Any_data const&, paddle::framework::ExecutionContext const&) 4 paddle::framework::OperatorWithKernel::RunImpl(paddle::framework::Scope const&, paddle::platform::Place const&, paddle::framework::RuntimeContext*) const 5 paddle::framework::OperatorWithKernel::RunImpl(paddle::framework::Scope const&, paddle::platform::Place const&) const 6 paddle::framework::OperatorBase::Run(paddle::framework::Scope const&, paddle::platform::Place const&) 7 paddle::framework::Executor::RunPreparedContext(paddle::framework::ExecutorPrepareContext*, paddle::framework::Scope*, bool, bool, bool) 8 paddle::framework::Executor::Run(paddle::framework::ProgramDesc const&, paddle::framework::Scope*, int, bool, bool, std::vector<std::string, std::allocatorstd::string > const&, bool, bool)

Python Call Stacks (More useful to users):

Error Message Summary:

Error: Variable value (input) of OP(fluid.layers.embedding) expected >= 0 and < 20941, but got 4575161256734962900. Please check input value. [Hint: Expected ids[i] < row_number, but received ids[i]:4575161256734962900 >= row_number:20941.] at (/paddle/paddle/fluid/operators/lookup_table_op.h:94) [operator < lookup_table > error]