Flink作业成功运行,但未在EMR环境的jconsole中创建指标mbean。
相同的作业会在本地环境上创建Mbean,如下面提供的屏幕截图所示:https://i.stack.imgur.com/GJC6m.png
我在本地下载了flink-1.8.0-bin-scala_2.11来运行flink作业,本地环境(lib和opt文件夹)中存在指标jar,如下图所示:
opt文件夹:https://i.stack.imgur.com/MjkI2.png
Lib文件夹:https://i.stack.imgur.com/vkeUc.png
Details of softwares used:
1) AWS EMR version- 5.24.1
2) FLink version - 1.8.0
3) jdk version 1.8.0_31
Tried adding below libraries didn't helped:
flink-metrics-core-1.8.1.jar
flink-metrics-statsd-1.8.1.jar
configured flink-conf.yaml with below on both local and EMR environment:
metrics.reporters: jmx
metrics.reporter.jmx.class: org.apache.flink.metrics.jmx.JMXReporter
metrics.reporter.jmx.port: Portno( 9000)