将GraphiteReporter添加到Kafka Connect集群

时间:2019-07-17 17:10:42

标签: apache-kafka apache-kafka-connect

我无法让Kafka Connect将指标kafka.consumer:*kafka.connect:*发送给Graphite。在此处找到列表:https://kafka.apache.org/documentation/#connect_monitoring

到目前为止,我已经在/usr/share/java/kafka-graphite-clients-0.10.2.jar中构建并添加了此JAR

https://github.com/apakulov/kafka-graphite

并通过将其发布到connect rest api来更新worker配置:

{ 
    "metric.reporters": "org.apache.kafka.common.metrics.GraphiteReporter",
    "kafka.graphite.metrics.reporter.enabled": true,
    "kafka.graphite.metrics.host": "my.graphite.host",
    "kafka.graphite.metrics.prefix": "my.prefix",
    "connector.class": "io.confluent.connect.s3.S3SinkConnector",
    "tasks.max": "10",
    "topics": "topic1,topic2",
    "s3.region": "us-east-1",
    "s3.bucket.name": "my-bucket",
    "s3.part.size": "5242880",
    "s3.compression.type": "gzip",
    "timezone": "UTC",
    "rotate.schedule.interval.ms": "900000",
    "flush.size": "1000000",
    "storage.class": "io.confluent.connect.s3.storage.S3Storage",
    "format.class": "io.confluent.connect.s3.format.bytearray.ByteArrayFormat",
    "partitioner.class": "io.confluent.connect.storage.partitioner.DefaultPartitioner",
    "schema.compatibility": "NONE",
    "name": "s3-sink"
}

我似乎无法选择GraphiteReporter,但我不确定为什么。这不是将这些指标引入Graphite的正确方法吗?

1 个答案:

答案 0 :(得分:0)

如果有人需要这个,我们通过将它放在

下成功地运行了相同的报告器实现

/usr/share/java/kafka/