我的输入是一个很大的csv文件,其行如:
"7807371008","Sat Jan 16 00:07:46 +0000 2010","@bigg_robb welcome to the party life of politics","T 33.417474,-86.705343","al","23845121","1381","502","Wed Mar 11 22:38:27 +0000 2009","2468"
我想要的输出是一个新文件,第一列和第三列只删除了所有特殊字符:
7807371008, bigg robb welcome to the party life of politics
但是在文本之间有一些换行符,即使它在技术上并不是该行的结尾。在这种情况下,我收到错误:
IndexError: list index out of range
此类行的示例是:
"7807376607","Sat Jan 16 00:07:57 +0000 2010","RT @CBS8News:The commander of Gov. Riley's task
force on illegal gambling resigns after winning $2,300 at a MS casino.
gt;#conflictofinterest","Montgomery, Alabama","al","33358058","84","164","Mon Apr 20 00:48:37 +0000 2009","4509"
我的代码是:
import csv
import sys
import re
with open('al.csv') as f:
for line in f:
j = next(csv.reader([line]))
id1 = j[0]
id2 = re.sub('[^A-Za-z0-9\.]+',' ',id1)
tt1 = j[2]
tt2 = re.sub('[^A-Za-z0-9\.]+',' ',tt1)
print id2.strip()+", "+tt2.lower()
我该如何解决这个问题?请帮忙。
答案 0 :(得分:1)
您应该将逗号,
指定为csv文件分隔符(或基于您的文件的正确分隔符),csv reader对象没有您循环的行,您需要通过它来访问行循环遍历reader
对象(spamreader
):
>>> import csv
>>> with open('al.csv', 'rb') as csvfile:
... spamreader = csv.reader(csvfile, delimiter=',')
... for row in spamreader:
print re.sub('[^A-Za-z0-9\.]+',' ',row[2]) + row[0]