Question

我正在尝试从bz2文件中提取10＆000; 000第一行。

   import bz2       
   file = "file.bz2"
   file_10000 = "file.txt"

   output_file = codecs.open(file_10000,'w+','utf-8')

   source_file = bz2.open(file, "r")
   count = 0
   for line in source_file:
       count += 1
       if count < 10000:
           output_file.writerow(line)

但我收到错误＆＃34;＆＃39;模块＆＃39;对象没有属性＆＃39; open＆＃39;＆＃34;。你有什么想法？或者我可以通过其他方式将10＆＃000; 000第一行保存到txt文件中？我在Windows上。

Answer 1

这是一个完整的工作示例，包括编写和读取比10000行小得多的测试文件。很高兴在问题中提供工作示例，以便我们可以轻松测试。

import bz2
import itertools
import codecs

file = "file.bz2"
file_10000 = "file.txt"

# write test file with 9 lines
with bz2.BZ2File(file, "w") as fp:
    fp.write('\n'.join('123456789'))

# the original script using BZ2File ... and 3 lines for test
# ...and fixing bugs:
#     1) it only writes 9999 instead of 10000
#     2) files don't do writerow
#     3) close the files

output_file = codecs.open(file_10000,'w+','utf-8')

source_file = bz2.BZ2File(file, "r")
count = 0
for line in source_file:
    count += 1
    if count <= 3:
       output_file.write(line)
source_file.close()
output_file.close()

# show what you got
print('---- Test 1 ----')
print(repr(open(file_10000).read()))

更有效的方法是在读取所需的行后跳出for循环。您甚至可以利用迭代器来细化代码：

# a faster way to read first 3 lines
with bz2.BZ2File(file) as source_file,\
        codecs.open(file_10000,'w+','utf-8') as output_file:
    output_file.writelines(itertools.islice(source_file, 3))

# show what you got
print('---- Test 2 ----')
print(repr(open(file_10000).read()))

Answer 2

这绝对是一种比其他答案更简单的方法，但在Python2 / 3中这是一种简单的方法。此外，如果您没有＆gt; = 10,000行，它会短路。

from bz2 import BZ2File as bzopen

# writing to a file
with bzopen("file.bz2", "w") as bzfout:
    for i in range(123456):
        bzfout.write(b"%i\n" % i)

# reading a bz2 archive
with bzopen("file.bz2", "r") as bzfin:
    """ Handle lines here """
    lines = []
    for i, line in enumerate(bzfin):
        if i == 10000: break
        lines.append(line.rstrip())

print(lines)

Answer 3

只是另一种变体。

Answer 4

这对我有用：

sudo apt-get install python-dev
sudo pip install backports.lzma

在python中读取bz2文件的第一行

4 个答案: