用Python读取UTF8CSV文件
我试图用Python读取带有重音字符的CSV文件(只有法语和/或西班牙语字符)。基于用于csvReader的Python2.5文档(http://docs.python.org/library/csv.html),我想出了下面的代码来读取CSV文件,因为csvReader只支持ASCII。def unicode_csv_reader(unicode_csv_data, dialect=csv.excel, **kwargs):
# csv.py doesn't do Unicode; encode temporarily as UTF-8:
csv_reader = csv.reader(utf_8_encoder(unicode_csv_data),
dialect=dialect, **kwargs)
for row in csv_reader:
# decode UTF-8 back to Unicode, cell by cell:
yield [unicode(cell, 'utf-8') for cell in row]def utf_8_encoder(unicode_csv_data):
for line in unicode_csv_data:
yield line.encode('utf-8')filename = 'output.csv'reader = unicode_csv_reader(open(filename))try:
products = []
for field1, field2, field3 in reader:
...
下面是我正在读的CSV文件的摘录:0665000FS10120684,SD1200IS,Appareil photo numérique PowerShot de 10 Mpx de Canon avec trépied (SD1200IS)
- Bleu0665000FS10120689,SD1200IS,Appareil photo numérique PowerShot de 10 Mpx de Canon avec trépied (SD1200IS) -
Gris0665000FS10120687,SD1200IS,Appareil photo numérique PowerShot de 10 Mpx de Canon avec trépied (SD1200IS) - Vert...
尽管我试图对UTF-8进行编码/解码,但我仍然得到以下异常:Traceback (most recent call last):
File ".\Test.py", line 53, in
for field1, field2, field3 in reader:
File ".\Test.py", line 40, in unicode_csv_reader for row in csv_reader:
File ".\Test.py", line 46, in utf_8_encoder yield line.encode('utf-8', 'ignore')UnicodeDecodeError:
'ascii' codec can't decode byte 0xc3 in position 68: ordinal not in range(128)
我该怎么解决这个问题?