🎵
MuSiQue: Multi-hop Questions via Single-hop Question Composition
This is the repository for our paper "MuSiQue: Multi-hop Questions via Single-hop Question Composition". We'll release the more data and code here.
Installation
conda create -n musique python=3.8 -y && conda activate musique
Data
You can run the following script or download it manually from here.
bash download_data.sh
The result will be stored in data/
directory. It contains train and dev sets of MuSiQue-Ans
and MuSiQue-Full
and their sample predictions files.
Evaluation
You can use evaluate_v0.1.py
to evaluate your predictions against ground-truths. For eg.:
python evaluate_v0.1.py data/musique_ans_v0.1_dev_sample_prediction.jsonl data/musique_ans_v0.1_dev.jsonl
Citation
If you use this in your work, please cite use:
@article{trivedi2021musique,
title={MuSiQue: Multi-hop Questions via Single-hop Question Composition},
author={Trivedi, Harsh and Balasubramanian, Niranjan and Khot, Tushar and Sabharwal, Ashish},
journal={arXiv preprint arXiv:2108.00573},
year={2021}
}