Existing Medical QA & VQA Datasets
Multimodal Question Answering (QA) in the Medical Domain: A summary of Existing Datasets and Systems
-
I prepared this summary for my CMU/LTI talk on multimodal QA. My slides are available at https://www.slideshare.net/benabacha/multimodal-question-answering-in-the-medical-domain-cmulti-2020
-
This list is not exhaustive. You can email me links and references of relevant medical QA datasets and systems and I'll update the list asap. Also, several challenge-related datasets are not publicly available anymore. You can contact the organizers to have the data.
*** Two Main Tasks: Medical Question Answering (QA) & Visual Question Answering (VQA) ***
I) Medical QA Datasets:
- Corpus for Evidence Based Medicine Summarization (Mollá, 2010): https://sourceforge.net/projects/ebmsumcorpus
- CLEF QA4MRE Alzheimer’s task (Peñas et al, 2012).
- BioASK datasets (2012-2020): Challenge Overview | bioasq.org
- TREC LiveQA-Med (Ben Abacha et al, 2017): https://github.com/abachaa/LiveQA_MedicalTask_TREC2017
- MEDIQA-2019 datasets on NLI, RQE, and QA (Ben Abacha et al., 2019): https://github.com/abachaa/MEDIQA2019
- MEDIQA-AnS dataset of question-driven summaries of answers (Savery et al., 2020): https://osf.io/fyg46/ Paper: Question-driven summarization of answers to consumer health questions | Scientific Data
- MedQuaD Collection of 47k QA pairs (Ben Abacha and Demner-Fushman, 2019): GitHub - abachaa/MedQuAD: Medical Question Answering Dataset of 47,457 QA pairs created from 12 NIH websites
- Medication QA Collection (Ben Abacha et al., 2019): https://github.com/abachaa/Medication_QA_MedInfo2019
- Consumer Health Question Summarization (Ben Abacha and Demner-Fushman, 2019): https://github.com/abachaa/MeQSum
- emrQA: QA on Electronic Medical Records (Pampari et al., 2018). Scripts to generate emrQA from i2b2 data: https://github.com/panushri25/emrQA
- EPIC-QA dataset on COVID-19 (Goodwin et al., 2020): Epidemic QA at TAC 2020
- BiQA Corpus (Lamurias et al., 2020): https://github.com/lasigeBioTM/BiQA Paper:Generating Biomedical Question Answering Corpora From Q&A Forums | IEEE Journals & Magazine | IEEE Xplore
- HealthQA Dataset (Zhu et al., 2019): https://github.com/mingzhu0527/HAR Paper: https://dmkd.cs.vt.edu/papers/WWW19.pdf
- MASH-QA Dataset on Multiple Answer Spans Healthcare Question Answering, with 35k QA pairs (Zhu et al., 2020): https://github.com/mingzhu0527/MASHQA Paper: https://www.aclweb.org/anthology/2020.findings-emnlp.342.pdf
- MedMCQA: A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answering. (Pal et al., CHIL, PMLR 2022): GitHub - medmcqa/medmcqa: A large-scale (194k), Multiple-Choice Question Answering (MCQA) dataset designed to address realworld medical entrance exam questions. Paper: MedMCQA: A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answering
II) Medical VQA Datasets (Radiology):
- VQA-RAD (Lau et al. 2018): https://osf.io/89kps
- VQA-Med 2018 (Hasan et al. 2018): AIcrowd | ImageCLEF 2018 VQA-Med | Challenges
- VQA-Med 2019 (Ben Abacha et al. 2019): https://github.com/abachaa/VQA-Med-2019
- VQA-Med 2020 (Ben Abacha et al. 2020): https://github.com/abachaa/VQA-Med-2020
III) Online QA Systems:
-- I searched and tested several systems (e.g. AskHERMES, MiPACQ, SimQ). This list includes only the systems that are still maintained.
- CHiQA (Consumer Health Question Answering System): chiqa.nlm.nih.gov
- Neural Covidex: covidex.ai
IV) Medical Datasets Relevant to Question Answering:
- i2b2 shared tasks (2006-2016): www.i2b2.org/NLP
- n2c2 NLP clinical challenges (2018-2019): https://n2c2.dbmi.hms.harvard.edu https://dbmi.hms.harvard.edu/programs/national-nlp-clinical-challenges-n2c2
- TREC Medical Records Track (2012-2013).
- TREC Clinical Decision Support Track (2014-2016): http://www.trec-cds.org
- TREC Precision Medicine Track (2017-2019): http://www.trec-cds.org
- CLEF eHealth (2013-2020): https://clefehealth.imag.fr
- COVID dataset (CORD-19): https://www.kaggle.com/allen-institute-for-ai/CORD-19-research-challenge
V) Medical Datasets Relevant to VQA:
- ImageCLEF Medical Automatic Image Annotation (2008-2009): Image 2008: Medical Automatic Image Annotation Task | ImageCLEF / LifeCLEF - Multimedia Retrieval in CLEF and ImageCLEF 2009 lung nodule detection and medical annotation task | ImageCLEF / LifeCLEF - Multimedia Retrieval in CLEF
- ImageCLEF Medical User-oriented Image Retrieval Task (2011): Practical showcase of medical image retrieval systems | ImageCLEF / LifeCLEF - Multimedia Retrieval in CLEF
- ImageCLEF Medical Retrieval Task (2008-2012): Medical Image Classification and Retrieval 2012 | ImageCLEF / LifeCLEF - Multimedia Retrieval in CLEF
- ImageCLEF AMIA: Medical task (2013): AMIA: Medical task | ImageCLEF / LifeCLEF - Multimedia Retrieval in CLEF
- ImageCLEFmed: Medical classification (2015): ImageCLEFmed: Medical classification | ImageCLEF / LifeCLEF - Multimedia Retrieval in CLEF
- ImageCLEF Medical Clustering (2015): Medical Clustering | ImageCLEF / LifeCLEF - Multimedia Retrieval in CLEF
- ImageCLEFmed (2016): ImageCLEFmed: The Medical Task 2016 | ImageCLEF / LifeCLEF - Multimedia Retrieval in CLEF
- ImageCLEFcaption (2017-2020): ImageCLEFcaption | ImageCLEF / LifeCLEF - Multimedia Retrieval in CLEF
- ImageCLEFmedical tasks (2019-2020): ImageCLEFmedical | ImageCLEF / LifeCLEF - Multimedia Retrieval in CLEF and ImageCLEFmedical | ImageCLEF / LifeCLEF - Multimedia Retrieval in CLEF
- MIMIC-CXR Database (2019): MIMIC-CXR Database v2.0.0