UnicodeDecodeError: ‘gbk’ codec can’t decode byte 0x9d in position 1793: illegal multibyte sequence问题解决方法
最近在写一个用RNN进行文本生成,总结一下遇到的文件读取问题,闲蛋少说。
代码如下:
代码块
!/usr/bin/python
-- coding: utf-8 --
import numpy
from keras.models import Sequential
from keras.layers import Dense
from keras.layers import Dropout
from keras.layers import LSTM
from keras.callbacks import ModelCheckpoint
from keras.utils import np_utils
raw_text = open(u’F:/深度学习资料/自然语言处理班/自然语言处理-8课时/6/DLinNLP/DLinNLP/input/Winston_Churchil.txt’).read().decode(‘utf-8’)
raw_text = raw_text.lower()
print (raw_text)
###错误脚注
生成一个脚注.
UnicodeDecodeError: 'gbk' codec can't decode byte 0x9d in position 1793: illegal multibyte sequence
如:
raw_text = open(u'F:/深度学习资料/自然语言处理班/自然语言处理-8课时/6/DLinNLP/DLinNLP/input/Winston_Churchil.txt'***,encoding='UTF-8'***).read()
2、OSError: Initializing from file failed问题
代码:
encoding: UTF-8
import os
import pandas as pd
import numpy as np
from sklearn.metrics import roc_auc_score
from datetime import date
data = pd.read_csv(“F:/深度学习资料/自然语言处理班/自然语言处理-8课时/6/DLinNLP/DLinNLP/input/Combined_News_DJIA.csv”)
print (data.head())
注脚:OSError: Initializing from file failed
解决方案:
import os
os.chdir(os.path.dirname(“F:/深度学习资料/自然语言处理班/自然语言处理-8课时/6/DLinNLP/DLinNLP/input/Combined_News_DJIA.csv”))
data = pd.read_csv(os.path.basename(“F:/深度学习资料/自然语言处理班/自然语言处理-8课时/6/DLinNLP/DLinNLP/input/Combined_News_DJIA.csv”))
print (data.head())
“`