Question

从数据框中选择所需行的代码。原始数据为Excel格式，我将其放在此处的数据框中。

我想选择“ Test Date”中所有属于“ 201506”和“ 201508”的行，并将它们写入Excel文件。线路工作正常。

import pandas as pd

data_short = {'Contract_type' : ["Other", "Other", "Type-I", "Type-I", "Type-I", "Type-II", "Type-II", "Type-III", "Type-III", "Part-time"],
'Test Date': ["20150816", "20150601", "20150204", "20150609", "20150204", "20150806", "20150201", "20150615", "20150822", "20150236" ],
'Test_time' : ["16:26", "07:39", "18:48", "22:32", "03:54", "03:30", "04:00", "22:02", "13:43", "10:29"],
}

df = pd.DataFrame(data_short)

data_201508 = df[df['Test Date'].astype(str).str.startswith('201508')]
data_201506 = df[df['Test Date'].astype(str).str.startswith('201506')]

data_68 = data_201506.append(data_201508)

writer = pd.ExcelWriter("C:\\test-output.xlsx", engine = 'openpyxl')
data_68.to_excel(writer, "Sheet1", index = False)
writer.save()

但是，当我将它们应用于更大的文件时，大约有600,000行25列（文件大小为65 MB），它返回如下错误消息：

Traceback (most recent call last):
  File "C:\Python27\Working Scripts\LL move pick wanted ATA in months.py", line 15, in <module>
    writer.save()
  File "C:\Python27\lib\site-packages\pandas\io\excel.py", line 732, in save
    return self.book.save(self.path)
  File "C:\Python27\lib\site-packages\openpyxl\workbook\workbook.py", line 263, in save
    save_workbook(self, filename)
  File "C:\Python27\lib\site-packages\openpyxl\writer\excel.py", line 239, in save_workbook
    writer.save(filename, as_template=as_template)
  File "C:\Python27\lib\site-packages\openpyxl\writer\excel.py", line 222, in save
    self.write_data(archive, as_template=as_template)
  File "C:\Python27\lib\site-packages\openpyxl\writer\excel.py", line 80, in write_data
    self._write_worksheets(archive)
  File "C:\Python27\lib\site-packages\openpyxl\writer\excel.py", line 163, in _write_worksheets
    xml = sheet._write(self.workbook.shared_strings)
  File "C:\Python27\lib\site-packages\openpyxl\worksheet\worksheet.py", line 776, in _write
    return write_worksheet(self, shared_strings)
  File "C:\Python27\lib\site-packages\openpyxl\writer\worksheet.py", line 263, in write_worksheet
    xf.write(worksheet.page_breaks.to_tree())
  File "src/lxml/serializer.pxi", line 1016, in lxml.etree._FileWriterElement.__exit__ (src\lxml\lxml.etree.c:142025)
  File "src/lxml/serializer.pxi", line 904, in lxml.etree._IncrementalFileWriter._write_end_element (src\lxml\lxml.etree.c:140218)
  File "src/lxml/serializer.pxi", line 999, in lxml.etree._IncrementalFileWriter._handle_error (src\lxml\lxml.etree.c:141711)
  File "src/lxml/serializer.pxi", line 195, in lxml.etree._raiseSerialisationError (src\lxml\lxml.etree.c:131087)
lxml.etree.SerialisationError: IO_WRITE

这是否意味着计算机不够好（8GB，Win10）？有没有一种方法可以优化代码（例如，消耗更少的内存）？谢谢。

btw：问题与I/O Error while saving Excel file - Python类似，但没有解决方案...

Answer 1

找到一个解决方案：将输出写入csv（无论如何也可以在Excel中打开）

data_wanted_all.to_csv("C:\\test-output.csv", index=False)

在此处发布，以防万一有人遇到相同的问题。让我知道是否应删除此问题。：）

Python，Pandas写入数据框lxml.etree.SerialisationError：IO_WRITE

1 个答案: