论文笔记-supervised and semi-supervised text categorization using LSTM for region embedding

Rie Johnson, Tong Zhang, 2016

摘要——
用LSTM代替CNN实现’region embedding + pooling’设计，在全监督和半监督中都可以用。

Introduction——
1.text categorization is the task of assigning labels to documents written in a natural language. state-of-the-art has long been bow+SVM model.
2.One-hot CNN:
a document is represented as a sequence of one-hot vectors,
a convolution layer converts all small regions of document to low-dimensional vectors at every location (region embedding).
a pooling layer aggregates the region embedding results to a document vector.
the top layer classifies a document vector with a linear model.
缺点：region size的确定。
因此用LSTM实现可变的区域长度。

——模型
综合One-hot CNN和LSTM

得到双向的one-hot LSTM