编年史队列大小确定

时间:2018-09-05 21:42:02

标签: chronicle chronicle-queue

如果我们需要将编年史队列的总大小限制为1GB或10GB。最好的方法是什么?

我们将缓冲区存储为字节,因此我试图仅通过对缓冲区大小求和来计算总大小,但是似乎没有简单的方法将其与队列的实际大小相关联。一种方法是每5分钟左右使用文件utils计算目录的总大小,但是如果间隔中有大量数据并且可能会溢出

,则容易出错

2 个答案:

答案 0 :(得分:1)

您必须将每个cq4文件的大小加起来

writePosition提供了每个cq4文件的长度(以字节为单位)

public class Example {

    public static void main(String[] args) throws FileNotFoundException {
        SingleChronicleQueue q = SingleChronicleQueueBuilder.builder().path("tmp").build();

        ExcerptAppender appender = q.createAppender();

        try (DocumentContext dc = appender.writingDocument()) {
            long l = dc.wire().bytes().writePosition();
            dc.wire().write().text("lastx");
        }

       DumpQueueMain.dump(q.fileAbsolutePath());

    }
}

输出以下内容

--- !!meta-data #binary
header: !SCQStore {
  writePosition: [
    131328,
    564049465049088
  ],
  indexing: !SCQSIndexing {
    indexCount: !short 8192,
    indexSpacing: 64,
    index2Index: 184,
    lastIndex: 64
  }
}

# position: 184, header: -1
--- !!meta-data #binary
index2index: [
  # length: 8192, used: 1
  65760 # truncated trailing zeros
]
# position: 65760, header: -1
--- !!meta-data #binary
index: [
  # length: 8192, used: 1
  131328 # truncated trailing zeros
]
# position: 131328, header: 0
--- !!data #binary
"": lastx

...
# 83754737 bytes remaining

--- !!meta-data #binary
header: !STStore {
  wireType: !WireType BINARY_LIGHT,
  recovery: !TimedStoreRecovery {
    timeStamp: 0
  },
  metadata: !SCQMeta {
    roll: !SCQSRoll { length: !int 86400000, format: yyyyMMdd, epoch: 0 },
    deltaCheckpointInterval: 64,
    sourceId: 0
  }
}

# position: 225, header: 0
--- !!data #binary
listing.highestCycle: 17780

# position: 264, header: 1
--- !!data #binary
listing.lowestCycle: 17780

# position: 304, header: 2
--- !!data #binary
listing.modCount: 1

# position: 336, header: 3
--- !!data #binary
chronicle.write.lock: -9223372036854775808

# position: 376, header: 4
--- !!data #binary
chronicle.lastIndexReplicated: -1

# position: 432, header: 5
--- !!data #binary
chronicle.lastAcknowledgedIndexReplicated: -1

...
# 65044 bytes remaining

.cq4文件的长度由定义时

writePosition: [
    131328,
     ....
  ],

换句话说 131328 个字节

答案 1 :(得分:0)

编年史队列文件根据时间而不是文件大小滚动。为什么要限制.cq4文件的大小?

如果希望,可以通过更改滚动周期每分钟滚动队列文件。