SpanNER: Named EntityRe-/Recognition as Span Prediction
Overview | Demo | Installation | Preprocessing | Prepare Models | Running | System Combination | Bib
This repository contains the code for our paper SpanNER: Named EntityRe-/Recognition as Span Prediction (ACL 2021).
The model designed in this work has been deployed into ExplainaBoard.
Overview
We investigate complementary advantages of systems based on different paradigms: span prediction model and sequence labeling framework. We then reveal that span prediction, simultaneously, can serve as a system combiner to re-recognize named entities from different systems’ outputs. We experimentally implement 154 systems on 11 datasets, covering three languages, comprehensive results show the effectiveness of span prediction models that both serve as base NER systems and system combiners.
Demo
We deploy SpanNER into the ExplainaBoard.
Quick Installation
python3PyTorchpytorch-lightning
Run the following script to install the dependencies,
pip3 install -r requirements.txt
Data Preprocessing
The dataset needs to be preprocessed, before running the model. We provide dataprocess/bio2spannerformat.py for reference, which gives the CoNLL-2003 as an example. First, you need to download datasets, and then convert them into BIO2 tagging format. We provided the CoNLL-2003 dataset with BIO format in data/conll03_bio folder, and its preprocessed format dataset in data/conll03 folder.
The download links of the datasets used in this work are shown as follows:
Prepare Models
For English Datasets, we use BERT-Large.
For Dutch and Spanish Datasets, we use BERT-Multilingual-Base.
How to Run?
Here, we give CoNLL-2003 as an example. You may need to change the DATA_DIR, PRETRAINED, dataname, n_class to your own dataset path, pre-trained model path, dataset name, and the number of labels in the dataset, respectively.
./run_conll03_spanner.sh
System Combination
Base Model
We provided 12 base models (result-files) of CoNLL-2003 dataset in combination/results. More base model (result-files) can be download from ExplainaBoard-download.
Combination
Put your different base models (result-files) in the data/results folder, then run:
python comb_voting.py
Here, we provided four system combination methods, including:
- SpanNER,
- Majority voting (VM),
- Weighted voting base on overall F1-score (VOF1),
- Weighted voting base on class F1-score (VCF1).
Results at a Glance
Bib
@article{fu2021spanner,
title={SpanNer: Named Entity Re-/Recognition as Span Prediction},
author={Fu, Jinlan and Huang, Xuanjing and Liu, Pengfei},
journal={arXiv preprint arXiv:2106.00641},
year={2021}
}
60 Dec 30, 2022
18 Sep 10, 2022
29 Dec 26, 2022
12 Dec 14, 2022
388 Dec 18, 2022
1 Dec 29, 2021
1 Jan 10, 2022
253 Dec 18, 2022
60 Nov 18, 2022
47 Jul 26, 2022
10 Dec 6, 2022
9 May 30, 2022
109 Dec 14, 2022
87 Dec 16, 2022
71 Dec 8, 2022
92 Jan 4, 2023
47 Dec 27, 2022
174 Dec 19, 2022