我正在使用石墨水槽来存储Spark作业发送的所有指标。 使用以下选项执行spark命令时:
--files=/local/shprin/metrics.properties
--conf spark.metrics.conf=metrics.properties
我能够接收执行程序指标,但没有任何驱动程序指标。
metrics.properties文件如下所示:
# Enable Graphite
*.sink.graphite.class=org.apache.spark.metrics.sink.GraphiteSink
*.sink.graphite.host=<graphite host>
*.sink.graphite.port=<graphite port>
*.sink.graphite.period=10
*.sink.graphite.unit=seconds
# Enable jvm source for instance master, worker, driver and executor
master.source.jvm.class=org.apache.spark.metrics.source.JvmSource
worker.source.jvm.class=org.apache.spark.metrics.source.JvmSource
driver.source.jvm.class=org.apache.spark.metrics.source.JvmSource
executor.source.jvm.class=org.apache.spark.metrics.source.JvmSource
任何想法,我想念什么?