Question

我正在尝试使用Pandas解析以下CSV文件。我看到read_csv失败的问题，因为csv列中有逗号分隔值。这些是http＆＃34;用户代理＆＃34;信息。有人可以帮忙解决这个问题吗？

1）我尝试了＃quot; quotchar＆＃39;这对我没什么帮助 2）我没有看到花括号的任何quotechar。

csv文件：

path = "/root"
dataAll = glob.glob(path + "/*.csv")
frame = pd.DataFrame()
files = []
for file_ in dataAll:
    print (file_)
    df = pd.read_csv(file_)
    files.append(df)
frame = pd.concat(files)
frame

代码块：

    ---------------------------------------------------------------------------
ParserError                               Traceback (most recent call last)
<ipython-input-38-e39305246059> in <module>()
      6 for file_ in dataAll:
      7     #df = pd.read_csv(file_, names = ['StartTime','ClientIP','ClientPort','ServerIP','ServerPort','HttpMethod','RequestHeader.Host','HttpURI','RequestHeader.User-Agent','RequestHeader.Referrer','ResponseHeader.Content-Type','RequestHeader.DNT_x-do-not-track','DownloadContentLength','UploadContentLength','ResponseCode','Duration','RequestActualByteCount','ResponseActualByteCount'
----> 8     df = pd.read_csv(file_)
      9     files.append(df)
     10 frame = pd.concat(files)

~/anaconda3/lib/python3.6/site-packages/pandas/io/parsers.py in parser_f(filepath_or_buffer, sep, delimiter, header, names, index_col, usecols, squeeze, prefix, mangle_dupe_cols, dtype, engine, converters, true_values, false_values, skipinitialspace, skiprows, nrows, na_values, keep_default_na, na_filter, verbose, skip_blank_lines, parse_dates, infer_datetime_format, keep_date_col, date_parser, dayfirst, iterator, chunksize, compression, thousands, decimal, lineterminator, quotechar, quoting, escapechar, comment, encoding, dialect, tupleize_cols, error_bad_lines, warn_bad_lines, skipfooter, doublequote, delim_whitespace, low_memory, memory_map, float_precision)
    676                     skip_blank_lines=skip_blank_lines)
    677 
--> 678         return _read(filepath_or_buffer, kwds)
    679 
    680     parser_f.__name__ = name

~/anaconda3/lib/python3.6/site-packages/pandas/io/parsers.py in _read(filepath_or_buffer, kwds)
    444 
    445     try:
--> 446         data = parser.read(nrows)
    447     finally:
    448         parser.close()

~/anaconda3/lib/python3.6/site-packages/pandas/io/parsers.py in read(self, nrows)
   1034                 raise ValueError('skipfooter not supported for iteration')
   1035 
-> 1036         ret = self._engine.read(nrows)
   1037 
   1038         # May alter columns / col_dict

~/anaconda3/lib/python3.6/site-packages/pandas/io/parsers.py in read(self, nrows)
   1846     def read(self, nrows=None):
   1847         try:
-> 1848             data = self._reader.read(nrows)
   1849         except StopIteration:
   1850             if self._first_chunk:

pandas/_libs/parsers.pyx in pandas._libs.parsers.TextReader.read()

pandas/_libs/parsers.pyx in pandas._libs.parsers.TextReader._read_low_memory()

pandas/_libs/parsers.pyx in pandas._libs.parsers.TextReader._read_rows()

pandas/_libs/parsers.pyx in pandas._libs.parsers.TextReader._tokenize_rows()

pandas/_libs/parsers.pyx in pandas._libs.parsers.raise_parser_error()

ParserError: Error tokenizing data. C error: Expected 18 fields in line 5, saw 33

错误代码段：

Save

Answer 1

您的文件已损坏。您需要用逗号将字段引起来。您的输入不执行该操作。修正您的输入。

对于包含逗号的列，Pandas.read_csv失败

1 个答案: