LAC模型 lexical_analysis()函数特殊字符会崩溃,建议增加参数的容错性
Created by: chaosfish
现象:
当:lac.lexical_analysis()函数接收到包含空格字符串时崩溃。
版本
➜ ~ hub version
hub 1.1.1
➜ ~ hub show lac
+-----------------+----------------------------------------------------+
| ModuleName |lac |
+-----------------+----------------------------------------------------+
| Version |1.1.1 |
+-----------------+----------------------------------------------------+
| Summary |Baidu's open-source lexical analysis tool for Chin |
| |ese, including word segmentation, part-of-speech t |
| |agging & named entity recognition |
+-----------------+----------------------------------------------------+
| Author |baidu-nlp |
+-----------------+----------------------------------------------------+
| Author-Email |nlp@baidu.com |
+-----------------+----------------------------------------------------+
| Location |/Users/yanglei/.paddlehub/modules/lac |
+-----------------+----------------------------------------------------+
重现代码
def test_lac_bug():
inputs = {"text": [" "]}
import paddlehub as hub
lac = hub.Module(name = "lac")
print(hub)
results = lac.lexical_analysis(data=inputs)
print(results)
崩溃信息
Testing started at 15:55 ...
/usr/local/bin/python3.7 /Applications/PyCharm.app/Contents/helpers/pycharm/_jb_pytest_runner.py --target test_lac_bug.py::test_lac_bug
Launching pytest with arguments test_lac_bug.py::test_lac_bug in /Users/yanglei/Documents/code/information_extraction/tests
============================= test session starts ==============================
platform darwin -- Python 3.7.3, pytest-4.3.0, py-1.8.0, pluggy-0.8.1 -- /usr/local/opt/python/bin/python3.7
cachedir: .pytest_cache
rootdir: /Users/yanglei/Documents/code/information_extraction/tests, inifile:
plugins: celery-4.3.0
collecting ... collected 1 item
test_lac_bug.py::test_lac_bug
Process finished with exit code 136 (interrupted by signal 8: SIGFPE)