Text2Event
- An implementation for
Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event Extraction - Please contact Yaojie Lu (@luyaojie) for questions and suggestions.
Update
- [2021-08-03] Update pre-trained models
Quick links
Requirements
General
- Python (verified on 3.8)
- CUDA (verified on 11.1)
Python Packages
- see requirements.txt
conda create -n text2event python=3.8
conda activate text2event
pip install -r requirements.txt
Quick Start
Data Format
Data folder contains four files：
data/text2tree/one_ie_ace2005_subtype
├── event.schema
├── test.json
├── train.json
└── val.json
train/val/test.json are data files, and each line is a JSON instance. Each JSON instance contains text and event fields, in which text is plain text, and event is event linearized form. If you want to use other key names, it is easy to change the input format in run_seq2seq.py.
{"text": "He also owns a television and a radio station and a newspaper .", "event": "<extra_id_0> <extra_id_1>"}
{"text": "' ' For us the United Natgions is the key authority '' in resolving the Iraq crisis , Fischer told reporters opn arrival at the EU meeting .", "event": "<extra_id_0> <extra_id_0> Meet meeting <extra_id_0> Entity EU <extra_id_1> <extra_id_1> <extra_id_1>"}
Note:
-
Use the extra character of T5 as the structure indicators, such as
<extra_id_0>,<extra_id_1>, etc. -
event.schemais the event schema file for building the trie of constrained decoding. It contains three lines: the first line is event type name list, the second line is event role name list, the third line is type-to-role dictionary.["Declare-Bankruptcy", "Convict", ...] ["Plaintiff", "Target", ...] {"End-Position": ["Place", "Person", "Entity"], ...}
Model Training
Training scripts as follows:
run_seq2seq.py: Python code entry, modified from the transformers/examples/seq2seq/run_seq2seq.pyrun_seq2seq.bash: Model training script logging to the log file.run_seq2seq_verbose.bash: Same model training script asrun_seq2seq.bashbut output to the screen directly.run_seq2seq_with_pretrain.bash: Model training script for curriculum learning, which contains substructure learning and full structure learning.
The command for the training is as follows (see bash scripts and Python files for the corresponding command-line arguments):
bash run_seq2seq_verbose.bash -d 0 -f tree -m t5-base --label_smoothing 0 -l 1e-4 --lr_scheduler linear --warmup_steps 2000 -b 16
-drefers to the GPU device id.-m t5-baserefers to using T5-base.- Currently, constrained decoding algorithms do not support
use_fast_tokenizer=Trueand beam search yet.
Trained models are saved in the models/ folder.
Model Evaluation
Offset-level Evaluation
python evaluation.py -g <data-folder-path> -r <offset-folder-path> -p <model-folder-path> -f <data-format>
- This evaluation script converts the
eval_preds_seq2seq.txtandtest_preds_seq2seq.txtin the model folder<model-folder-path>into the corresponding offset prediction results for model evaluation. -f <data-format>refers todyiepporoneie
Record-level Evaluation (approximate, used in training)
bash run_eval.bash -d 0 -m <model-folder-path> -i <data-folder-path> -c -b 8
-drefers to the GPU device id.-crepresents the use of constrained decoding, otherwise not apply-b 8representsbatch_size=8
How to expand to other tasks
- prepare the corresponding data format
- Writ the code for reading corresponding data format:
elif data_args.task.startswith("event")inseq2seq.py - Writ the code for evaluating the corresponding task result:
def compute_metrics(eval_preds)inseq2seq.py
Completing the above process can finish the simple Seq2Seq training and inference process.
If you need to use constrained decoding, you need to write the corresponding decoding mode (decoding_format), refer to extraction.extract_constraint.get_constraint_decoder
Pre-trained Model
You can find the pre-trained models as following google drive links or download models using command gdown (pip install gdown).
gdown --id 1_fOmnSatNfceL9DZPxpof5AT9Oo7vTrC && unzip dyiepp_ace2005_en_t5_base.zip
dyiepp_ace2005_en_t5_large.zip
gdown --id 10iY1obkbgJtTKwfoOFevqL5AwG-hLvhU && unzip dyiepp_ace2005_en_t5_large.zip
gdown --id 1zwnptRbdZntPT4ucqSANeaJ3vvwKliUe && unzip oneie_ace2005_en_t5_large.zip
gdown --id 1WG7-pTZ3K49VMbQIONaDq_0pUXAcoXrZ && unzip oneie_ere_en_t5_large.zip
Event Datasets Preprocessing
We first refer to the following code and environments [dygiepp] and [oneie v0.4.7] for data preprocessing. Thanks to them！
After data preprocessing and we get the following data files:
$ tree data/raw_data/
data/raw_data/
├── ace05-EN
│ ├── dev.oneie.json
│ ├── test.oneie.json
│ └── train.oneie.json
├── dyiepp_ace2005
│ ├── dev.json
│ ├── test.json
│ └── train.json
└── ERE-EN
├── dev.oneie.json
├── test.oneie.json
└── train.oneie.json
We then convert the above data files to tree format. The following scripts generate the corresponding data folder in data/text2tree. The conversion will automatically generate train/dev/test JSON files and event.schema file.
bash scripts/processing_data.bash
data/text2tree
├── dyiepp_ace2005_subtype
│ ├── event.schema
│ ├── test.json
│ ├── train.json
│ └── val.json
├── dyiepp_ace2005_subtype_span
│ ├── event.schema
│ ├── test.json
│ ├── train.json
│ └── val.json
├── one_ie_ace2005_subtype
│ ├── event.schema
│ ├── test.json
│ ├── train.json
│ └── val.json
├── one_ie_ace2005_subtype_span
│ ├── event.schema
│ ├── test.json
│ ├── train.json
│ └── val.json
├── one_ie_ere_en_subtype
│ ├── event.schema
│ ├── test.json
│ ├── train.json
│ └── val.json
└── one_ie_ere_en_subtype_span
├── event.schema
├── test.json
├── train.json
└── val.json
dyiepp_ace2005_subtypefor Full Structure Learning anddyiepp_ace2005_subtype_spanfor Substructure Learning.
Citation
If this repository helps you, please cite this paper:
Yaojie Lu, Hongyu Lin, Jin Xu, Xianpei Han, Jialong Tang, Annan Li, Le Sun, Meng Liao, Shaoyi Chen. Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event Extraction. The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021).
@inproceedings{lu-etal-2021-text2event,
title = "{T}ext2{E}vent: Controllable Sequence-to-Structure Generation for End-to-end Event Extraction",
author = "Lu, Yaojie and
Lin, Hongyu and
Xu, Jin and
Han, Xianpei and
Tang, Jialong and
Li, Annan and
Sun, Le and
Liao, Meng and
Chen, Shaoyi",
booktitle = "Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)",
month = aug,
year = "2021",
address = "Online",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2021.acl-long.217",
pages = "2795--2806",
abstract = "Event extraction is challenging due to the complex structure of event records and the semantic gap between text and event. Traditional methods usually extract event records by decomposing the complex structure prediction task into multiple subtasks. In this paper, we propose Text2Event, a sequence-to-structure generation paradigm that can directly extract events from the text in an end-to-end manner. Specifically, we design a sequence-to-structure network for unified event extraction, a constrained decoding algorithm for event knowledge injection during inference, and a curriculum learning algorithm for efficient model learning. Experimental results show that, by uniformly modeling all tasks in a single model and universally predicting different labels, our method can achieve competitive performance using only record-level annotations in both supervised learning and transfer learning settings.",
}
101 Dec 16, 2022
20 Dec 6, 2022
628 Dec 28, 2022
261 Jan 9, 2023
4 Aug 28, 2022
112 Dec 16, 2022
195 Dec 17, 2022
47 Nov 22, 2022
5 Oct 30, 2022
3 Mar 9, 2022
657 Jan 9, 2023
69 Nov 15, 2022
261 Dec 14, 2022
161 Dec 8, 2022
22 Nov 25, 2022
897 Jan 5, 2023
708 Dec 19, 2022