在HDFS Sink连接器的新版本中,偏移存储已更改。在旧版本中,我能够使用Kafka工具监控连接器延迟,以便进行消费者监控(例如' kafka-consumer-groups')。
但现在,我在日志中注意到这条消息:
log.info("HDFS connector does not commit consumer offsets to Kafka. Upon startup, HDFS "
+ "Connector restores offsets from filenames in HDFS. In the absence of files in HDFS, "
+ "the connector will attempt to find offsets for its consumer group in the "
+ "'__consumer_offsets' topic. If offsets are not found, the consumer will "
+ "rely on the reset policy specified in the 'consumer.auto.offset.reset' property to "
+ "start exporting data to HDFS.");
所以我的问题是,我们怎样才能监控这个连接器?