centos7 cuda10. 0环境下安装paddlepaddle-gpu成功后调用出现异常
Created by: gekie
-
版本、环境信息: 1)PaddlePaddle版本:paddlepaddle-gpu 1.7.2.post107 2)CPU:Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz 3)GPU:GeForce GTX 1070 Ti 4)系统环境:CentOS Linux release 7.6.1810 (Core)、Python 3.7.7
-
安装方式信息: 1)conda install paddlepaddle-gpu cudatoolkit=10.0
-
复现信息: 使用python进入python解释器, 输入import paddle.fluid, 再输入 paddle.fluid.install_check.run_check() 异常: `>>> paddle.fluid.install_check.run_check() Running Verify Paddle Program ... /data/projects/anaconda3/envs/paddle_env/lib/python3.7/site-packages/paddle/fluid/executor.py:789: UserWarning: The following exception is not an EOF exception. "The following exception is not an EOF exception.") Traceback (most recent call last): File "", line 1, in File "/data/projects/anaconda3/envs/paddle_env/lib/python3.7/site-packages/paddle/fluid/install_check.py", line 124, in run_check test_simple_exe() File "/data/projects/anaconda3/envs/paddle_env/lib/python3.7/site-packages/paddle/fluid/install_check.py", line 120, in test_simple_exe exe0.run(startup_prog) File "/data/projects/anaconda3/envs/paddle_env/lib/python3.7/site-packages/paddle/fluid/executor.py", line 790, in run six.reraise(*sys.exc_info()) File "/data/projects/anaconda3/envs/paddle_env/lib/python3.7/site-packages/six.py", line 703, in reraise raise value File "/data/projects/anaconda3/envs/paddle_env/lib/python3.7/site-packages/paddle/fluid/executor.py", line 785, in run use_program_cache=use_program_cache) File "/data/projects/anaconda3/envs/paddle_env/lib/python3.7/site-packages/paddle/fluid/executor.py", line 838, in _run_impl use_program_cache=use_program_cache) File "/data/projects/anaconda3/envs/paddle_env/lib/python3.7/site-packages/paddle/fluid/executor.py", line 912, in _run_program fetch_var_name) paddle.fluid.core_avx.EnforceNotMet:
C++ Call Stacks (More useful to developers):
0 std::string paddle::platform::GetTraceBackString<char const*>(char const*&&, char const*, int) 1 paddle::platform::EnforceNotMet::EnforceNotMet(std::__exception_ptr::exception_ptr, char const*, int) 2 paddle::platform::CublasHandleHolder::CublasHandleHolder(CUstream_st*, cublasMath_t) 3 paddle::platform::CUDADeviceContext::CUDADeviceContext(paddle::platform::CUDAPlace) 4 std::_Function_handler<std::unique_ptr<paddle::platform::DeviceContext, std::default_deletepaddle::platform::DeviceContext > (), std::reference_wrapper<std::_Bind_simple<paddle::platform::EmplaceDeviceContext<paddle::platform::CUDADeviceContext, paddle::platform::CUDAPlace>(std::map<paddle::platform::Place, std::shared_future<std::unique_ptr<paddle::platform::DeviceContext, std::default_deletepaddle::platform::DeviceContext > >, std::lesspaddle::platform::Place, std::allocator<std::pair<paddle::platform::Place const, std::shared_future<std::unique_ptr<paddle::platform::DeviceContext, std::default_deletepaddle::platform::DeviceContext > > > > >, paddle::platform::Place)::{lambda()#1 (closed)} ()> > >::_M_invoke(std::_Any_data const&) 5 std::_Function_handler<std::unique_ptr<std::__future_base::_Result_base, std::__future_base::_Result_base::_Deleter> (), std::__future_base::_Task_setter<std::unique_ptr<std::__future_base::_Result<std::unique_ptr<paddle::platform::DeviceContext, std::default_deletepaddle::platform::DeviceContext > >, std::__future_base::_Result_base::_Deleter>, std::unique_ptr<paddle::platform::DeviceContext, std::default_deletepaddle::platform::DeviceContext > > >::_M_invoke(std::_Any_data const&) 6 std::__future_base::_State_base::_M_do_set(std::function<std::unique_ptr<std::__future_base::_Result_base, std::__future_base::_Result_base::_Deleter> ()>&, bool&) 7 std::__future_base::_Deferred_state<std::_Bind_simple<paddle::platform::EmplaceDeviceContext<paddle::platform::CUDADeviceContext, paddle::platform::CUDAPlace>(std::map<paddle::platform::Place, std::shared_future<std::unique_ptr<paddle::platform::DeviceContext, std::default_deletepaddle::platform::DeviceContext > >, std::lesspaddle::platform::Place, std::allocator<std::pair<paddle::platform::Place const, std::shared_future<std::unique_ptr<paddle::platform::DeviceContext, std::default_deletepaddle::platform::DeviceContext > > > > >, paddle::platform::Place)::{lambda()#1 (closed)} ()>, std::unique_ptr<paddle::platform::DeviceContext, std::default_deletepaddle::platform::DeviceContext > >::_M_run_deferred() 8 paddle::platform::DeviceContextPool::Get(paddle::platform::Place const&) 9 paddle::framework::GarbageCollector::GarbageCollector(paddle::platform::Place const&, unsigned long) 10 paddle::framework::UnsafeFastGPUGarbageCollector::UnsafeFastGPUGarbageCollector(paddle::platform::CUDAPlace const&, unsigned long) 11 paddle::framework::Executor::RunPreparedContext(paddle::framework::ExecutorPrepareContext*, paddle::framework::Scope*, bool, bool, bool) 12 paddle::framework::Executor::Run(paddle::framework::ProgramDesc const&, paddle::framework::Scope*, int, bool, bool, std::vector<std::string, std::allocatorstd::string > const&, bool, bool)
Error Message Summary:
ExternalError: The cuBLAS library was not initialized. This is usually caused by an error in the CUDA Runtime API called by the cuBLAS routine, or an error in the hardware setup. To correct: check that the hardware, an appropriate version of the driver, and the cuBLAS library are correctly installed. [Hint: CUBLAS_STATUS_NOT_INITIALIZED] at (/paddle/paddle/fluid/platform/cuda_helper.h:39)
`