In today's computerized and information-based society, people are inundated with vast amounts of text data, ranging from news articles, social media post, scientific publications, to a wide range of textual information from various domains (corporate reports, advertisements, legal acts, medical reports). How to turn such massive unstructured text data into structured, actionable knowledge, and how to enable effective and user-friendly access to such knowledge is a grand challenge to the research community.
In the first half of the tutorial, we introduce data-driven methods on mining structured facts (i.e., entities and their relations for types of interest) from massive text corpora to construct knowledge bases, with a focus on methods that are minimally-supervised, domain-independent, and language-independent for timely knowledge base construction across various application domains (news, social media, biomedical, business). In the second half of the tutorial, we discuss the challenges of querying large-scale knowledge bases, and give a systematic discussion on several emerging schema-agnostic querying paradigms for knowledge bases, including keyword query, graph query, natural language query (i.e., question answering), and query by example, which allows users to easily query knowledge bases without writing complex structured queries like SPARQL.
University of Southern California1, University of California, Santa Barbara2
- Overview of Knowledge Base Construction and Querying [slides]
- Effort-light Knowledge Base Construction [slides]
- Phrase Mining from Massive Text Corpora
- Entity Recognition and Typing
- Fine-grained Entity Typing
- Co-extraction of Entities and Relationships
- Keyword Query: Query like Search Engine
- Graph Query: Add a Little Structure
- Natural Language Query: As Natural as You Want
- Query by Example: Just Show Me Examples
ProjectsMulti-tasking sequence labeling [project]Learning with Heterogeneous Supervision [project]Learning with Indirection Supervision [project]
Code & DataSequence Tagging: [LM-LSTM-CRF]Phrase Mining: [AutoPhrase]Entity Typing: [PLE] [AFET]Relation Extraction: [ReHession] [ReQuest]Co-extraction of Entities and Relations: [CoType]Knowledge-based Question Answering: [GraphQuestions]
Indirect Supervision for Relation Extraction using Question-Answer Pairs
Ellen Wu, Xiang Ren, Frank Xu, Ji Li, Jiawei Han.
ACM International Conference on Web Search and Data Mining (WSDM), 2018.
Empower Sequence Labeling with Task-Aware Neural Language Model
Liyuan Liu, Jingbo Shang, Xiang Ren, Frank Xu, Huan Gui, Jian Peng, Jiawei Han.
The AAAI Conference on Artificial Intelligence (AAAI), 2018.
[Github] [Project] [Documents]
Heterogeneous Supervision for Relation Extraction: A Representation Learning Approach
Liyuan Liu*, Xiang Ren*, Qi Zhu, Shi Zhi, Huan Gui, Heng Ji, Jiawei Han.
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2017. [Project] [Github]
CoType: Joint Extraction of Typed Entities and Relations with Knowledge Bases
Xiang Ren, Zeqiu Wu, Wenqi He, Meng Qu, Clare R. Voss, Heng Ji,
Tarek F. Abdelzaher, Jiawei Han.
International World-Wide Web Conference (WWW), 2017.
[Github] [slides] [arxiv]
Label Noise Reduction in Entity Typing by Heterogeneous Partial-Label Embedding
Xiang Ren*, Wenqi He*, Meng Qu, Heng Ji, Clare R. Voss, Jiawei Han.
ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 2016. [Github] [video]
Cross-domain Semantic Parsing via Paraphrasing
Yu Su, Xifeng Yan.
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2017.
On Generating Characteristic-rich Question Sets for QA Evaluation
Yu Su, Huan Sun, Brian Sadler, Mudhakar Srivatsa, Izzeddin Gur, Zenghui Yan, Xifeng Yan.
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2016.
Exploiting Relevance Feedback in Knowledge Graph Search
Yu Su, Shengqi Yang, Huan Sun, Mudhakar Srivatsa, Sue Kase, Michelle Vanni, Xifeng Yan.
ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), 2015.
Querying Knowledge Graphs by Example Entity Tuples
Nandish Jayaram, Arijit Khan, Chengkai Li, Xifeng Yan, Ramez Elmasri.
IEEE Transactions on Knowledge and Data Engineering (TKDE), 2015.
Schemaless and Structureless Graph Querying
Shengqi Yang, Yinghui Wu, Huan Sun, Xifeng Yan.
International Conference on Very Large Databases (VLDB), 2014.