TrueZip压缩需要花费太多时间

时间:2015-04-14 16:49:25

标签: java compression truezip

我正在使用TrueZip进行压缩。这是我的代码看起来像

  public String compress() throws IOException {
    if (logLocations.isEmpty()) {
      throw new IllegalStateException("no logs provided to compress");
    }

    removeDestinationIfExists(desiredArchive);

    final TFile destinationArchive = new TFile(desiredArchive + "/diagnostics");
    for (final String logLocation : logLocations) {
      final TFile log = new TFile(logLocation);
      if (!log.exists()) {
        LOGGER.debug("{} does not exist, ignoring.");
        continue;
      }
      if (log.isDirectory()) {
        log.cp_r(destinationArchive);
      } else {
        final String newLogLocation =
            new TFile(destinationArchive.getAbsolutePath()) + SLASH +
            getLogNameFromPath(logLocation);
        log.cp(new TFile(newLogLocation));
      }
    }
    return destinationArchive.getEnclArchive().getAbsolutePath();
  }

和我的测试

@Test
  public void testBenchMarkWithHprof() throws IOException {
    final FileWriter logLocations;
    String logLocationPath = "/Users/harit/Downloads/tmp/logLocations.txt";
    {
      logLocations = new FileWriter(logLocationPath);
      logLocations.write("Test3");
      logLocations.write("\n");
      logLocations.close();
    }
    final LPLogCompressor compressor = new LPLogCompressor("/Users/harit/Downloads/tmp",
                                                           new File(logLocationPath),
                                                           "/Users/harit/Downloads/tmp/TestOut");
    final long startTime = System.currentTimeMillis();
    compressor.compress();
    System.out.println("Time taken (msec): " + (System.currentTimeMillis() - startTime));
  }

我的数据目录Test3看起来像

Test3/
      java_pid1748.hprof

文件大小为2.83GB 当我进行测试时,它接管了 22分钟 但是,当我使用Native OSX compress (right click -> compress)压缩同一文件时,只需 2分钟

为什么会有这么大的差异?

由于

更新

根据@Satnam的推荐,我附上了一个调试器,看看发生了什么,这就是我找到的

enter image description here enter image description here

没有TrueZip线程正在运行?真?道歉我是第一次使用分析器

1 个答案:

答案 0 :(得分:1)

本案例中的原因是使用Deflater.BEST_COMPRESSION的默认Deflater

我将ZipDriver类重写为

级别
import de.schlichtherle.truezip.fs.archive.zip.ZipDriver;
import de.schlichtherle.truezip.socket.IOPoolProvider;

import java.util.zip.Deflater;

public class OverrideZipDriver extends ZipDriver {

  public OverrideZipDriver(final IOPoolProvider ioPoolProvider) {
    super(ioPoolProvider);
  }

  @Override
  public int getLevel() {
    return Deflater.DEFAULT_COMPRESSION;
  }
}

然后在我的Compressor课程中,我做了

public LPLogCompressor(final String logProcessorInstallPath, final File logLocationsSource,
                         final String desiredArchive) throws IOException {
    this.desiredArchive = desiredArchive + DOT + getDateTimeStampFormat() + ZIP;
    logLocations = getLogLocations(logProcessorInstallPath, logLocationsSource);
    enableLogCompression();
  }

  private static void enableLogCompression() {
    TConfig.get().setArchiveDetector(
        new TArchiveDetector(TArchiveDetector.NULL, new Object[][]{
            {"zip", new OverrideZipDriver(IOPoolLocator.SINGLETON)},}));
    TConfig.push();
  }

您可以阅读帖子here