《Web安全之机器学习入门》笔记：第十六章 16.3 恶意评论识别（一）

本文链接：https://blog.csdn.net/mooyuan/article/details/122768508

本小节通过RNN识别恶意评论。

1、数据集获取

本小节通过Movie Review Data数据集（共1000条正面评论、1000条负面评论）来识别恶意评论。

# IMDB Dataset loading
train, test, _ = imdb.load_data(path='imdb.pkl', n_words=10000,
                                valid_portion=0.1)
trainX, trainY = train
testX, testY = test

2、数据特征化处理

# Data preprocessing
# Sequence padding
trainX = pad_sequences(trainX, maxlen=100, value=0.)
testX = pad_sequences(testX, maxlen=100, value=0.)
# Converting labels to binary vectors
trainY = to_categorical(trainY, nb_classes=2)
testY = to_categorical(testY, nb_classes=2)

3、模型构建

# Network building
net = tflearn.input_data([None, 100])
net = tflearn.embedding(net, input_dim=10000, output_dim=128)
net = tflearn.lstm(net, 128, dropout=0.8)
net = tflearn.fully_connected(net, 2, activation='softmax')
net = tflearn.regression(net, optimizer='adam', learning_rate=0.001,
                         loss='categorical_crossentropy')

4、模型训练

# Training
model = tflearn.DNN(net, tensorboard_verbose=0)
model.fit(trainX, trainY, validation_set=(testX, testY), show_metric=True,
          batch_size=32)

5、测试结果

Training Step: 7040  | total loss: 0.10070 | time: 80.854s
| Adam | epoch: 010 | loss: 0.10070 - acc: 0.9819

| val_loss: 0.63764 - val_acc: 0.8040 -- iter: 22500/22500