JMH:如何避免从抽象基态共享状态?

时间:2018-04-03 23:24:47

标签: java benchmarking microbenchmark jmh

我是对Spring Boot应用启动时间进行基准测试的。完整项目为here,即WIP,但相关类别如下。

抽象基础状态:

public abstract class BootAbstractState {
    private Process started;

    private boolean isStarted() {
        return Objects.nonNull(started) && started.isAlive();
    }

    protected void start() {
        if (isStarted()) {
            throw new IllegalStateException("Already started");
        } else {
            ProcessBuilder pb = new ProcessBuilder(getCommand());
            try {
                started = pb
                        .inheritIO()
                        .start();
            } catch (IOException e) {
                throw new UncheckedIOException(e);
            }
        }
    }

    protected void stop() {
        if (isStarted()) {
            try {
                started.destroyForcibly().waitFor();
            } catch (InterruptedException e) {
                throw new RuntimeException(e);
            } finally {
                started = null;
            }
        }
    }

    protected abstract String[] getCommand();
}

具体状态:

public class JarLauncherBenchmark {

    @Benchmark
    public void benchmark(JarLauncherState state) {
        state.start();
    }

    @State(Scope.Benchmark)
    public static class JarLauncherState extends BootAbstractState {
        private static final String MAIN_CLASS = "org.springframework.boot.loader.JarLauncher";

        @TearDown(Level.Iteration)
        public void tearDown() {
            stop();
        }

        @Override
        protected String[] getCommand() {
            return new String[]{"java", "-cp", System.getProperty("java.class.path"), MAIN_CLASS};
        }
    }
}

我构建了一个阴影JAR,并运行如下:

java -jar minimal-benchmark/build/libs/minimal-benchmark-0.0.1-SNAPSHOT-all.jar \
  -bm avgt -f 1 -foe true -i 5 -wi 1 -tu ms

上述情况失败,但有以下异常:

# JMH version: 1.20
# VM version: JDK 1.8.0_66, VM 25.66-b17
# VM invoker: /Library/Java/JavaVirtualMachines/jdk1.8.0_66.jdk/Contents/Home/jre/bin/java
# VM options: <none>
# Warmup: 1 iterations, 1 s each
# Measurement: 5 iterations, 1 s each
# Timeout: 10 min per iteration
# Threads: 1 thread, will synchronize iterations
# Benchmark mode: Average time, time/op
# Benchmark: mypackage.JarLauncherBenchmark.benchmark

# Run progress: 0.00% complete, ETA 00:00:06
# Fork: 1 of 1
# Warmup Iteration   1: <failure>
<failure>

java.lang.IllegalStateException: Already started
        at mypackage.BootAbstractState.start(BootAbstractState.java:22)
        at mypackage.JarLauncherBenchmark.benchmark(JarLauncherBenchmark.java:13)

显然,它并没有像我想象的那样工作,并且每个迭代都没有实例化新的状态。我还尝试使用Thread范围,并运行多个线程(-t命令行选项),但这没有帮助。

1 个答案:

答案 0 :(得分:1)

“迭代”不是“@Benchmark调用” - 它在整个API中由树级别(试验,迭代,调用)捕获。它将是@Setup(Level.Iteration) - &gt; @Benchmark(多次,直到迭代时间在avgt模式下到期) - &gt; @TearDown(Level.Iteration)。因此,@Benchmark的第二次调用会让你得到这样的异常,因为之前确实调用了started()

拥有不平衡的@Setup / @TearDown对通常是一个坏主意。由于您正在执行@TearDown(Level.Iteration),因此您应该在@Setup(Level.Iteration)进行start(),并在那里进行apply