![](https://img-blog.csdnimg.cn/20201014180756922.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
NLP
如果曾经拥有
这个作者很懒,什么都没留下…
展开
-
NLP预处理 - 将序列处理成embedding - 方法4
此代码演示了如何处理 文本数据,然后feed到神经网络。Preprocessing can be further divided into two parts: ①data process and ②label process.① In this code, the input data is transfered into one-hot format:cautious: inpu...转载 2020-01-29 11:07:06 · 682 阅读 · 2 评论 -
NLP预处理 - 将序列处理成embedding - 方法2 - 字符级LSTM
Case 2 - 字符级LSTM - 字符序列二分类上一篇笔记,介绍了调用keras函数来padding;此篇笔记,介绍了手动padding,补齐序列,使得序列长度相同,便于feed成为维度规整的array。cautious:处理的数据不是文本数据,普适性不大。另外,代码中,记录了每个sequence的长度,存入到一个list中(seqlen),最后传到tf.cont...原创 2019-12-29 16:21:24 · 1076 阅读 · 0 评论 -
NLP预处理 - 将序列处理成embedding - 方法1 - keras调包
I will use several examples to show the data processing methods.Apart from generating embedding, the process of training model in epoch level and generating batch data is also useful.Case 1 ...原创 2019-12-28 18:25:45 · 947 阅读 · 0 评论 -
NLP预处理 - 将序列处理成embedding - 方法3
Case 3 - token embedding & char embeddingdef _pad_sequences(sequences, pad_tok, max_length): """ Args: sequences: a generator of list or tuple pad_tok: the char to pad with Returns: a list of list where each subl原创 2020-06-17 21:15:00 · 539 阅读 · 0 评论 -
NLP - 加载预训练embedding示例
Sentimental analysis on text (a binary classification model based on Keras)# -*- coding: utf-8 -*-import osfrom keras.preprocessing.text import Tokenizerfrom keras.preprocessing.sequence import ...原创 2020-01-30 17:19:13 · 1600 阅读 · 0 评论