Question

我正在尝试通过EMR步骤在纱线会话中提交作业。当我这样做时，我会遇到以下错误

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/lib/flink/lib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Command exiting with ret '1'

您能否请我解决这个问题

Step Configuration
Name= Custom jar
Jar location = command-runner.jar
Arguments = flink run -c com.comcast.dhome.xh.timeline.events.ProcessKafkaStream s3://aws-logs-518000940535-us-east-1/dh-xh-event-subscriber.jar --region us-east-1
Action on failure = continue

EMR配置

EMR = 5.15.0
FLINK 1.4.2

Answer 1

您需要在本地下载我们的应用程序JAR，即aws s3 cp s3://aws-logs-518000940535-us-east-1/dh-xh-event-subscriber.jar .，然后指向本地jar flink run -c com.comcast.dhome.xh.timeline.events.ProcessKafkaStream dh-xh-event-subscriber.jar --region us-east-1。您不能直接使用放置在s3上的文件。

无法使用EMR步骤在EMR中运行flink作业

1 个答案: