带文件描述符的gzip

时间:2015-11-25 21:15:43

标签: python python-2.7 file-io gzip

我需要能够使用文件描述符打开一个gzip压缩文件。当我执行以下操作时(这是仍然触发错误的简化代码):

file_path = r"E39O6KS6J8MIZW.00.0f6db4e5.gz"
fd = os.open(file_path, os.O_RDONLY, os.O_BINARY)
# ...
file_object = gzip.GzipFile(fileobj=io.FileIO(fd, mode='rb'))
reader = csv.reader(io.BufferedReader(file_object))
for row in reader:
    print row

我收到CRC校验错误:

Traceback (most recent call last):
  File "./log_processing_scripts/dev.py", line 40, in <module>
    post()
  File "./log_processing_scripts/dev.py", line 36, in post
    for row in reader:
  File "C:\Python27\lib\gzip.py", line 252, in read
    self._read(readsize)
  File "C:\Python27\lib\gzip.py", line 299, in _read
    self._read_eof()
  File "C:\Python27\lib\gzip.py", line 338, in _read_eof
    hex(self.crc)))
IOError: CRC check failed 0x4b77635f != 0xbe13716L

文件没有(!)损坏,我只能使用gzip.open(file_path)来处理它。

我错过了什么?

1 个答案:

答案 0 :(得分:2)

O_RDONLY和O_BINARY标志应该或者一起使用,如下所示:

fd = os.open(file_path, os.O_RDONLY | os.O_BINARY)

参考:https://docs.python.org/2/library/os.html#open-constants