python读取csv指定列,使用python读取csv中的特定列

I have a csv file that look like this:

+-----+-----+-----+-----+-----+-----+-----+-----+

| AAA | bbb | ccc | DDD | eee | FFF | GGG | hhh |

+-----+-----+-----+-----+-----+-----+-----+-----+

| 1 | 2 | 3 | 4 | 50 | 3 | 20 | 4 |

| 2 | 1 | 3 | 5 | 24 | 2 | 23 | 5 |

| 4 | 1 | 3 | 6 | 34 | 1 | 22 | 5 |

| 2 | 1 | 3 | 5 | 24 | 2 | 23 | 5 |

| 2 | 1 | 3 | 5 | 24 | 2 | 23 | 5 |

+-----+-----+-----+-----+-----+-----+-----+-----+

...

How can I only read the columns "AAA,DDD,FFF,GGG" in python and skip the headers?

The output I want is a list of tuples that looks like this:

[(1,4,3,20),(2,5,2,23),(4,6,1,22)]. I'm thinking to write these data to a SQLdatabase later.

I referred to this post:Read specific columns from a csv file with csv module?.

But I don't think it is helpful in my case. Since my .csv is pretty big with whole bunch of columns, I hope I can tell python the column names I want, so python can read the specific columns row by row for me.

解决方案def read_csv(file, columns, type_name="Row"):

try:

row_type = namedtuple(type_name, columns)

except ValueError:

row_type = tuple

rows = iter(csv.reader(file))

header = rows.next()

mapping = [header.index(x) for x in columns]

for row in rows:

row = row_type(*[row[i] for i in mapping])

yield row

Example:

>>> import csv

>>> from collections import namedtuple

>>> from StringIO import StringIO

>>> def read_csv(file, columns, type_name="Row"):

... try:

... row_type = namedtuple(type_name, columns)

... except ValueError:

... row_type = tuple

... rows = iter(csv.reader(file))

... header = rows.next()

... mapping = [header.index(x) for x in columns]

... for row in rows:

... row = row_type(*[row[i] for i in mapping])

... yield row

...

>>> testdata = """\

... AAA,bbb,ccc,DDD,eee,FFF,GGG,hhh

... 1,2,3,4,50,3,20,4

... 2,1,3,5,24,2,23,5

... 4,1,3,6,34,1,22,5

... 2,1,3,5,24,2,23,5

... 2,1,3,5,24,2,23,5

... """

>>> testfile = StringIO(testdata)

>>> for row in read_csv(testfile, "AAA GGG DDD".split()):

... print row

...

Row(AAA='1', GGG='20', DDD='4')

Row(AAA='2', GGG='23', DDD='5')

Row(AAA='4', GGG='22', DDD='6')

Row(AAA='2', GGG='23', DDD='5')

Row(AAA='2', GGG='23', DDD='5')