监视HDFS接收器连接器延迟

时间:2018-05-30 12:49:52

标签: apache-kafka hdfs apache-kafka-connect confluent

在HDFS Sink连接器的新版本中,偏移存储已更改。在旧版本中,我能够使用Kafka工具监控连接器延迟,以便进行消费者监控(例如' kafka-consumer-groups')。

但现在,我在日志中注意到这条消息:

   log.info("HDFS connector does not commit consumer offsets to Kafka. Upon startup, HDFS "
        + "Connector restores offsets from filenames in HDFS. In the absence of files in HDFS, "
        + "the connector will attempt to find offsets for its consumer group in the "
        + "'__consumer_offsets' topic. If offsets are not found, the consumer will "
        + "rely on the reset policy specified in the 'consumer.auto.offset.reset' property to "
        + "start exporting data to HDFS.");

所以我的问题是,我们怎样才能监控这个连接器?

0 个答案:

没有答案