ParserError:标记数据时出错。 C错误:行y中的预期x字段,看到z

时间:2017-10-31 16:18:37

标签: pandas parsing encoding

我是python的新手。尝试将几十个zip文件读入一个信号时,请尝试以下错误。每个zip文件都包含一个csv文件。我在堆栈溢出上进行了大量搜索,但尚未找到解决方案。我怀疑这个csv包含中文字符和网址。 我的代码:

import os
import zipfile
import pandas as pd
import glob
file_path = os.getcwd() #obtain file path
allFiles = glob.glob(file_path + "/*.zip") #return list of all file names
list_ = []
for file in allFiles:
    with zipfile.ZipFile(file) as f:
        df = pd.read_csv(f.open(f.namelist()[0]),encoding='latin-1',header=None)
        list_.append(df)
        df = pd.concat(list_)
df

以下是错误消息:

ParserError                               Traceback (most recent call last)
<ipython-input-25-471e9d0ab709> in <module>()
      6 for file in allFiles:
      7     with zipfile.ZipFile(file) as f:
----> 8         df = pd.read_csv(f.open(f.namelist()[0]),encoding='latin-1',skiprows=[0, 1],header=None)
      9         list_.append(df)
     10         df = pd.concat(list_)

D:\anaconda\lib\site-packages\pandas\io\parsers.py in parser_f(filepath_or_buffer, sep, delimiter, header, names, index_col, usecols, squeeze, prefix, mangle_dupe_cols, dtype, engine, converters, true_values, false_values, skipinitialspace, skiprows, nrows, na_values, keep_default_na, na_filter, verbose, skip_blank_lines, parse_dates, infer_datetime_format, keep_date_col, date_parser, dayfirst, iterator, chunksize, compression, thousands, decimal, lineterminator, quotechar, quoting, escapechar, comment, encoding, dialect, tupleize_cols, error_bad_lines, warn_bad_lines, skipfooter, skip_footer, doublequote, delim_whitespace, as_recarray, compact_ints, use_unsigned, low_memory, buffer_lines, memory_map, float_precision)
    653                     skip_blank_lines=skip_blank_lines)
    654 
--> 655         return _read(filepath_or_buffer, kwds)
    656 
    657     parser_f.__name__ = name

D:\anaconda\lib\site-packages\pandas\io\parsers.py in _read(filepath_or_buffer, kwds)
    409 
    410     try:
--> 411         data = parser.read(nrows)
    412     finally:
    413         parser.close()

D:\anaconda\lib\site-packages\pandas\io\parsers.py in read(self, nrows)
   1003                 raise ValueError('skipfooter not supported for iteration')
   1004 
-> 1005         ret = self._engine.read(nrows)
   1006 
   1007         if self.options.get('as_recarray'):

D:\anaconda\lib\site-packages\pandas\io\parsers.py in read(self, nrows)
   1746     def read(self, nrows=None):
   1747         try:
-> 1748             data = self._reader.read(nrows)
   1749         except StopIteration:
   1750             if self._first_chunk:

pandas\_libs\parsers.pyx in pandas._libs.parsers.TextReader.read (pandas\_libs\parsers.c:10862)()

pandas\_libs\parsers.pyx in pandas._libs.parsers.TextReader._read_low_memory (pandas\_libs\parsers.c:11138)()

pandas\_libs\parsers.pyx in pandas._libs.parsers.TextReader._read_rows (pandas\_libs\parsers.c:11884)()

pandas\_libs\parsers.pyx in pandas._libs.parsers.TextReader._tokenize_rows (pandas\_libs\parsers.c:11755)()

pandas\_libs\parsers.pyx in pandas._libs.parsers.raise_parser_error (pandas\_libs\parsers.c:28765)()

ParserError: Error tokenizing data. C error: Expected 1 fields in line 9, saw 2

1 个答案:

答案 0 :(得分:0)

我尝试使用&#34; error_bad_line = False&#34;,但它又返回了另一个错误。

最终,我设法通过重命名zip文件标题和CSV文件标题来传递此问题,仅保留数字供我自己参考。并将read_csv编码更改为&#34; latin-1&#34;。