Segmentation fault (core dumped) in sh script/zh_task/ernie_base/run_msra_ner.sh on CONLL 2003
Created by: petrLorenc
I run the sh script/zh_task/ernie_base/run_msra_ner.sh
which is changed a little bit (only the paths to files and false for using CUDA)
+ export FLAGS_eager_delete_tensor_gb=0
+ export FLAGS_sync_nccl_allreduce=1
+ export CUDA_VISIBLE_DEVICES=0
+ export PYTHONPATH=./ernie:
+ python -u ./ernie/run_sequence_labeling.py --use_cuda false --do_train true --do_val true --do_test true --batch_size 16 --init_pretraining_params /mnt/d/Programming/Code/Playground/ERNIE-develop/model/params --num_labels 50 --chunk_scheme IOB --label_map_config /mnt/d/Programming/Code/Playground/ERNIE-develop/data/label_map.json --train_set /mnt/d/Programming/Code/Playground/ERNIE-develop/data/eng.train.ernie.tsv --dev_set /mnt/d/Programming/Code/Playground/ERNIE-develop/data/eng.testa.ernie.tsv --test_set /mnt/d/Programming/Code/Playground/ERNIE-develop/data/eng.testb.ernie.tsv --vocab_path /mnt/d/Programming/Code/Playground/ERNIE-develop/model/vocab.txt --ernie_config_path /mnt/d/Programming/Code/Playground/ERNIE-develop/model/ernie_config.json --checkpoints ./checkpoints --save_steps 100000 --weight_decay 0.01 --warmup_proportion 0.0 --validation_steps 100 --use_fp16 false --epoch 6 --max_seq_len 256 --learning_rate 5e-5 --skip_steps 10 --num_iteration_per_drop_scope 1 --random_seed 1
Segmentation fault (core dumped)
data looks according to your format
CRICKET - LEICESTERSHIRE TAKE OVER AT TOP AFTER INNINGS VICTORY . O O I-ORG O O O O O O O O
LONDON 1996-08-30 I-LOC O
West Indian all-rounder Phil Simmons took four for 38 on Friday as Leicestershire beat Somerset by an innings and 39 runs in two days to take over at the head of the county championship . I-MISC I-MISC O I-PER I-PER O O O O O O O I-ORG O I-ORG O O O O O O O O O O O O O O O O O O O O
Their stay on top , though , may be short-lived as title rivals Essex , Derbyshire and Surrey all closed in on victory while Kent made up for lost time in their rain-affected match against Nottinghamshire . O O O O O O O O O O O O O I-ORG O I-ORG O I-ORG O O O O O O I-ORG O O O O O O O O O O I-ORG O
After bowling Somerset out for 83 on the opening morning at Grace Road , Leicestershire extended their first innings by 94 runs before being bowled out for 296 with England discard Andy Caddick taking three for 83 . O O I-ORG O O O O O O O O I-LOC I-LOC O I-ORG O O O O O O O O O O O O O O I-LOC O I-PER I-PER O O O O O
and mapping file label_map.json have this format
{
"B-LOC" : 0,
"I-LOC" : 1,
"B-ORG" : 2,
"I-ORG" : 3,
"B-MISC" : 4,
"I-MISC" : 5,
"B-PER" : 6,
"I-PER" : 7,
"O" : 8,
"UNK" : 9
}
Do you know where can be a problem or how to solve it