【论文泛读】Enhanced LSTM for Natural Language Inference

论文链接：https://arxiv.org/pdf/1609.06038.pdf

Abstract

Reasoning and inference are central to human and artificial intelligence. Modelinginference in human language is very challenging. With the availability of large annotated data (Bowman et al., 2015), it has recently become feasible to train neural network based inference models, which have shown to be very effective. In this paper, we present a new state-of-the-art result, achieving the accuracy of 88.6% on the Stanford Natural Language Inference Dataset. Unlike the previous top models that use very complicated network architectures, we first demonstrate that carefully designing sequential inference models based on chain LSTMs can outperform all previous models. Based on this, we further show that by explicitly considering recursive architectures in both local inference modeling and inference composition, we achieve additional improvement. Particularly, incorporating syntactic parsing information contributes to our best result—it further improves the performance even when added to the already very strong model.

model

We propose neural network models for natural language inference, which achieve the best results
reported on the SNLI benchmark. The results are
first achieved through our enhanced sequential inference model, which outperformed the previous
models, including those employing more complicated network architectures, suggesting that the
potential of sequential inference models have not
been fully exploited yet. Based on this, we further
show that by explicitly considering recursive architectures in both local inference modeling and
inference composition, we achieve additional improvement. Particularly, incorporating syntactic
parsing information contributes to our best result: it
further improves the performance even when added
to the already very strong model.
Future work interesting to us includes exploring
the usefulness of external resources such as WordNet and contrasting-meaning embedding (Chen
et al., 2015) to help increase the coverage of wordlevel inference relations. Modeling negation more
closely within neural network frameworks (Socher
et al., 2013; Zhu et al., 2014) may help contradiction detection.ZG4ubmV0L3FxXzQ0NTQzNzc0,size_16,color_FFFFFF,t_70)