激发石墨工作指标

时间:2018-08-08 06:47:27

标签: apache-spark profiling spark-streaming graphite

我正在使用石墨水槽来存储Spark作业发送的所有指标。 使用以下选项执行spark命令时:

--files=/local/shprin/metrics.properties 
--conf spark.metrics.conf=metrics.properties

我能够接收执行程序指标,但没有任何驱动程序指标。

metrics.properties文件如下所示:

# Enable Graphite
*.sink.graphite.class=org.apache.spark.metrics.sink.GraphiteSink
*.sink.graphite.host=<graphite host>
*.sink.graphite.port=<graphite port>
*.sink.graphite.period=10
*.sink.graphite.unit=seconds

# Enable jvm source for instance master, worker, driver and executor
master.source.jvm.class=org.apache.spark.metrics.source.JvmSource
worker.source.jvm.class=org.apache.spark.metrics.source.JvmSource
driver.source.jvm.class=org.apache.spark.metrics.source.JvmSource
executor.source.jvm.class=org.apache.spark.metrics.source.JvmSource

任何想法,我想念什么?

0 个答案:

没有答案