Flink CLI卡在正在运行的作业上

时间:2017-11-24 12:11:50

标签: apache-flink flink-streaming

我正在使用CLI运行Flink流媒体作业。客户与Flink的职位经理在同一地点。

CLI在启动作业时停滞不前,超时到期失败:

Submitting job with JobID: ca3b6a2931605146a7449d9ff33f4c04. Waiting for job completion.
Connected to JobManager at Actor[akka.tcp://flink@jobmanager:6123/user/jobmanager#927320081] with leader session id 00000000-0000-0000-0000-000000000000.

------------------------------------------------------------
 The program finished with the following exception:

org.apache.flink.client.program.ProgramInvocationException: The program execution failed: Couldn't retrieve the JobExecutionResult from the JobManager.

    [...] // ask if you want the complete trace

Caused by: org.apache.flink.runtime.client.JobClientActorSubmissionTimeoutException: Job submission to the JobManager timed out.
You may increase 'akka.client.timeout' in case the JobManager needs more time to configure and confirm the job submission.
    at org.apache.flink.runtime.client.JobSubmissionClientActor.handleCustomMessage(JobSubmissionClientActor.java:119)
    at org.apache.flink.runtime.client.JobClientActor.handleMessage(JobClientActor.java:251)
    at org.apache.flink.runtime.akka.FlinkUntypedActor.handleLeaderSessionID(FlinkUntypedActor.java:89)
    at org.apache.flink.runtime.akka.FlinkUntypedActor.onReceive(FlinkUntypedActor.java:68)
    at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:167)
    at akka.actor.Actor$class.aroundReceive(Actor.scala:467)
    at akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:97)
    at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
    at akka.actor.ActorCell.invoke(ActorCell.scala:487)
    at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)
    at akka.dispatch.Mailbox.run(Mailbox.scala:220)
    at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
    at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
    at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
    at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
    at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

我觉得有趣的是,如果我使用网络用户界面手动提交作业,一切顺利!

这项工作有很大的管道和大量的任务,我对较小的管道没有同样的问题。但是我不明白为什么Web UI和CLI之间存在差异......

你能告诉我我错过了什么吗?

如果唯一的解决方案是使用网页用户界面,那么我是否可以通过这种方式以编程方式提交工作?

提前谢谢

0 个答案:

没有答案