提取压缩文件

时间:2011-05-20 20:23:53

标签: python tar compression

以下代码允许我提取.tgz文件。然而,它在大约两个级别下降后停止提取;还有其他子文件夹具有需要提取的.tgz文件。另外,当我提取文件时,我必须手动将其移动到另一个路径,否则它将被我提取到该位置的其他.tgz文件覆盖(我正在使用的所有.tgz具有相同的文件结构/文件夹名称一旦提取)。任何帮助表示赞赏。谢谢!

import os, sys, tarfile

def extract(tar_url, extract_path='.'):
    print tar_url
    tar = tarfile.open(tar_url, 'r')
    for item in tar:
        tar.extract(item, extract_path)
        if item.name.find(".tgz") != -1 or item.name.find(".tar") != -1:
            extract(item.name, "./" + item.name[:item.name.rfind('/')])
try:

    extract(sys.argv[1] + '.tgz')
    print 'Done.'
except:
    name = os.path.basename(sys.argv[0])
    print name[:name.rfind('.')], '<filename>'

1 个答案:

答案 0 :(得分:4)

如果我没有错误地误解你的问题,那么这就是你想做的事情 -

  • 提取可能有的.tgz文件 其中需要更多的.tgz文件 提取(等等......)
  • 在解压缩时,您需要注意不要替换文件夹中现有的目录。

如果我已正确解释您的问题,那么......
这是我的代码所做的 -

  • 将每个.tgz文件(递归地)提取到一个单独的文件夹中,该文件夹与.tgz文件(没有扩展名)在同一目录中同名。
  • 在解压缩时,确保不会覆盖/替换任何已存在的文件/文件夹。

因此,如果这是.tgz文件的目录结构 -

parent/
    xyz.tgz/
        a
        b
        c
        d.tgz/
            x
            y
            z
        a.tgz/                  # note if I extract this directly, it will replace/overwrite contents of the folder 'a'
            m
            n
            o
            p

提取后,目录结构将是 -

parent/
    xyz.tgz
    xyz/
        a
        b
        c
        d/
            x
            y
            z
        a 1/                  # it extracts 'a.tgz' to the folder 'a 1' as folder 'a' already exists in the same folder.
            m
            n
            o
            p

虽然我在下面的代码中提供了大量文档,但我只想简要介绍一下我的程序结构。以下是我定义的函数 -

FileExtension --> returns the extension of a file
AppropriateFolderName --> helps in preventing overwriting/replacing of already existing folders (how? you will see it in the program)
Extract --> extracts a .tgz file (safely)
WalkTreeAndExtract - walks down a directory (passed as parameter) and extracts all .tgz files(recursively) on the way down.

我不能建议改变你所做的事情,因为我的方法有点不同。我已经使用了extractall模块的tarfile方法,而不是使用了比特复杂的extract方法。 (只需看一眼 - http://docs.python.org/library/tarfile.html#tarfile.TarFile.extractall并阅读与使用extractall方法相关的警告。我不认为我们会遇到任何此类问题,但请记住这一点。)< / p>

所以这里的代码对我有用 -
(我尝试嵌套5级深度的.tar个文件(.tar .tar .tar .tgz# extracting_nested_tars.py import os import re import tarfile file_extensions = ('tar', 'tgz') # Edit this according to the archive types you want to extract. Keep in # mind that these should be extractable by the tarfile module. def FileExtension(file_name): """Return the file extension of file 'file' should be a string. It can be either the full path of the file or just its name (or any string as long it contains the file extension.) Examples: input (file) --> 'abc.tar' return value --> 'tar' """ match = re.compile(r"^.*[.](?P<ext>\w+)$", re.VERBOSE|re.IGNORECASE).match(file_name) if match: # if match != None: ext = match.group('ext') return ext else: return '' # there is no file extension to file_name def AppropriateFolderName(folder_name, parent_fullpath): """Return a folder name such that it can be safely created in parent_fullpath without replacing any existing folder in it. Check if a folder named folder_name exists in parent_fullpath. If no, return folder_name (without changing, because it can be safely created without replacing any already existing folder). If yes, append an appropriate number to the folder_name such that this new folder_name can be safely created in the folder parent_fullpath. Examples: folder_name = 'untitled folder' return value = 'untitled folder' (if no such folder already exists in parent_fullpath.) folder_name = 'untitled folder' return value = 'untitled folder 1' (if a folder named 'untitled folder' already exists but no folder named 'untitled folder 1' exists in parent_fullpath.) folder_name = 'untitled folder' return value = 'untitled folder 2' (if folders named 'untitled folder' and 'untitled folder 1' both already exist but no folder named 'untitled folder 2' exists in parent_fullpath.) """ if os.path.exists(os.path.join(parent_fullpath,folder_name)): match = re.compile(r'^(?P<name>.*)[ ](?P<num>\d+)$').match(folder_name) if match: # if match != None: name = match.group('name') number = match.group('num') new_folder_name = '%s %d' %(name, int(number)+1) return AppropriateFolderName(new_folder_name, parent_fullpath) # Recursively call itself so that it can be check whether a # folder named new_folder_name already exists in parent_fullpath # or not. else: new_folder_name = '%s 1' %folder_name return AppropriateFolderName(new_folder_name, parent_fullpath) # Recursively call itself so that it can be check whether a # folder named new_folder_name already exists in parent_fullpath # or not. else: return folder_name def Extract(tarfile_fullpath, delete_tar_file=True): """Extract the tarfile_fullpath to an appropriate* folder of the same name as the tar file (without an extension) and return the path of this folder. If delete_tar_file is True, it will delete the tar file after its extraction; if False, it won`t. Default value is True as you would normally want to delete the (nested) tar files after extraction. Pass a False, if you don`t want to delete the tar file (after its extraction) you are passing. """ tarfile_name = os.path.basename(tarfile_fullpath) parent_dir = os.path.dirname(tarfile_fullpath) extract_folder_name = AppropriateFolderName(tarfile_name[:\ -1*len(FileExtension(tarfile_name))-1], parent_dir) # (the slicing is to remove the extension (.tar) from the file name.) # Get a folder name (from the function AppropriateFolderName) # in which the contents of the tar file can be extracted, # so that it doesn't replace an already existing folder. extract_folder_fullpath = os.path.join(parent_dir, extract_folder_name) # The full path to this new folder. try: tar = tarfile.open(tarfile_fullpath) tar.extractall(extract_folder_fullpath) tar.close() if delete_tar_file: os.remove(tarfile_fullpath) return extract_folder_name except Exception as e: # Exceptions can occur while opening a damaged tar file. print 'Error occured while extracting %s\n'\ 'Reason: %s' %(tarfile_fullpath, e) return def WalkTreeAndExtract(parent_dir): """Recursively descend the directory tree rooted at parent_dir and extract each tar file on the way down (recursively). """ try: dir_contents = os.listdir(parent_dir) except OSError as e: # Exception can occur if trying to open some folder whose # permissions this program does not have. print 'Error occured. Could not open folder %s\n'\ 'Reason: %s' %(parent_dir, e) return for content in dir_contents: content_fullpath = os.path.join(parent_dir, content) if os.path.isdir(content_fullpath): # If content is a folder, walk it down completely. WalkTreeAndExtract(content_fullpath) elif os.path.isfile(content_fullpath): # If content is a file, check if it is a tar file. # If so, extract its contents to a new folder. if FileExtension(content_fullpath) in file_extensions: extract_folder_name = Extract(content_fullpath) if extract_folder_name: # if extract_folder_name != None: dir_contents.append(extract_folder_name) # Append the newly extracted folder to dir_contents # so that it can be later searched for more tar files # to extract. else: # Unknown file type. print 'Skipping %s. <Neither file nor folder>' % content_fullpath if __name__ == '__main__': tarfile_fullpath = 'fullpath_path_of_your_tarfile' # pass the path of your tar file here. extract_folder_name = Extract(tarfile_fullpath, False) # tarfile_fullpath is extracted to extract_folder_name. Now descend # down its directory structure and extract all other tar files # (recursively). extract_folder_fullpath = os.path.join(os.path.dirname(tarfile_fullpath), extract_folder_name) WalkTreeAndExtract(extract_folder_fullpath) # If you want to extract all tar files in a dir, just execute the above # line and nothing else. ,但它应该适用于任何深度*和{也适用于{{1}}个文件。)

{{1}}

我没有添加命令行界面。我猜你可以添加它,如果你发现它有用。

以上是上述程序的稍好版本 -
http://guanidene.blogspot.com/2011/06/nested-tar-archives-extractor.html