无法成功部署Spring Cloud Data Flow中的流或任务

时间:2017-02-04 09:34:39

标签: apache-spark yarn spring-cloud-dataflow

我在纱线模式下有一个火花簇,我直接在主节点上安装了Spring Cloud Data Flow,按照文档的简单步骤,一切顺利。
我创建了简单的流和任务,部署它们,没有发生任何事情 stream create ticktock --definition “time | log” --deploy
task create --name pi --definition "spark-yarn --spark.app-jar=<spark-example.jar> --spark.assembly-jar=<spark-assembly-jar-in-hdfs> --spark.app-class=org.apache.spark.examples.SparkPi"

在webUI中,我可以看到流已部署且任务处于未知状态。但是在纱线服务器的控制台中,出现了异常打印的内容如下:
2017-02-04 02:26:14.736 INFO 4940 --- [nio-9393-exec-8] o.s.c.d.s.y.DefaultYarnCloudAppService : Cachekey STREAMnull found YarnCloudAppServiceApplication org.springframework.cloud.deployer.spi.yarn.YarnCloudAppServiceApplication@72feb9aa 2017-02-04 02:26:14.737 INFO 4940 --- [nio-9393-exec-8] o.s.c.d.s.y.DefaultYarnCloudAppService : Cachekey STREAMnull found YarnCloudAppServiceApplication org.springframework.cloud.deployer.spi.yarn.YarnCloudAppServiceApplication@72feb9aa 2017-02-04 02:26:14.738 INFO 4940 --- [nio-9393-exec-8] o.s.c.d.s.y.DefaultYarnCloudAppService : Cachekey STREAMnull found YarnCloudAppServiceApplication org.springframework.cloud.deployer.spi.yarn.YarnCloudAppServiceApplication@72feb9aa 2017-02-04 02:26:14.740 INFO 4940 --- [nio-9393-exec-8] o.s.c.d.s.y.DefaultYarnCloudAppService : Cachekey STREAMnull found YarnCloudAppServiceApplication org.springframework.cloud.deployer.spi.yarn.YarnCloudAppServiceApplication@72feb9aa 2017-02-04 02:26:19.998 INFO 4940 --- [nio-9393-exec-7] o.s.c.deployer.spi.yarn.YarnAppDeployer : Checking status of ticktock:time:application_1486192446476_0003 2017-02-04 02:26:19.998 INFO 4940 --- [nio-9393-exec-7] o.s.c.d.s.y.DefaultYarnCloudAppService : Cachekey STREAMnull found YarnCloudAppServiceApplication org.springframework.cloud.deployer.spi.yarn.YarnCloudAppServiceApplication@72feb9aa 2017-02-04 02:26:20.000 INFO 4940 --- [nio-9393-exec-7] o.s.c.d.s.y.DefaultYarnCloudAppService : Cachekey STREAMnull found YarnCloudAppServiceApplication org.springframework.cloud.deployer.spi.yarn.YarnCloudAppServiceApplication@72feb9aa 2017-02-04 02:26:20.005 INFO 4940 --- [nio-9393-exec-7] o.s.c.d.s.y.DefaultYarnCloudAppService : Cachekey STREAMnull found YarnCloudAppServiceApplication org.springframework.cloud.deployer.spi.yarn.YarnCloudAppServiceApplication@72feb9aa 2017-02-04 02:26:20.007 INFO 4940 --- [nio-9393-exec-7] o.s.c.d.s.y.DefaultYarnCloudAppService : Cachekey STREAMnull found YarnCloudAppServiceApplication org.springframework.cloud.deployer.spi.yarn.YarnCloudAppServiceApplication@72feb9aa 2017-02-04 02:26:20.008 INFO 4940 --- [nio-9393-exec-7] o.s.c.deployer.spi.yarn.YarnAppDeployer : Checking status of ticktock:log:application_1486192446476_0003 2017-02-04 02:26:20.009 INFO 4940 --- [nio-9393-exec-7] o.s.c.d.s.y.DefaultYarnCloudAppService : Cachekey STREAMnull found YarnCloudAppServiceApplication org.springframework.cloud.deployer.spi.yarn.YarnCloudAppServiceApplication@72feb9aa 2017-02-04 02:26:20.010 INFO 4940 --- [nio-9393-exec-7] o.s.c.d.s.y.DefaultYarnCloudAppService : Cachekey STREAMnull found YarnCloudAppServiceApplication org.springframework.cloud.deployer.spi.yarn.YarnCloudAppServiceApplication@72feb9aa 2017-02-04 02:26:20.011 INFO 4940 --- [nio-9393-exec-7] o.s.c.d.s.y.DefaultYarnCloudAppService : Cachekey STREAMnull found YarnCloudAppServiceApplication org.springframework.cloud.deployer.spi.yarn.YarnCloudAppServiceApplication@72feb9aa 2017-02-04 02:26:20.013 INFO 4940 --- [nio-9393-exec-7] o.s.c.d.s.y.DefaultYarnCloudAppService : Cachekey STREAMnull found YarnCloudAppServiceApplication org.springframework.cloud.deployer.spi.yarn.YarnCloudAppServiceApplication@72feb9aa 2017-02-04 02:26:25.268 INFO 4940 --- [nio-9393-exec-3] o.s.c.deployer.spi.yarn.YarnAppDeployer : Checking status of ticktock:time:application_1486192446476_0003 2017-02-04 02:26:25.268 INFO 4940 --- [nio-9393-exec-3] o.s.c.d.s.y.DefaultYarnCloudAppService : Cachekey STREAMnull found YarnCloudAppServiceApplication org.springframework.cloud.deployer.spi.yarn.YarnCloudAppServiceApplication@72feb9aa 2017-02-04 02:26:25.270 INFO 4940 --- [nio-9393-exec-3] o.s.c.d.s.y.DefaultYarnCloudAppService : Cachekey STREAMnull found YarnCloudAppServiceApplication org.springframework.cloud.deployer.spi.yarn.YarnCloudAppServiceApplication@72feb9aa 2017-02-04 02:26:25.274 INFO 4940 --- [nio-9393-exec-3] o.s.c.d.s.y.DefaultYarnCloudAppService : Cachekey STREAMnull found YarnCloudAppServiceApplication org.springframework.cloud.deployer.spi.yarn.YarnCloudAppServiceApplication@72feb9aa 2017-02-04 02:26:25.276 INFO 4940 --- [nio-9393-exec-3] o.s.c.d.s.y.DefaultYarnCloudAppService : Cachekey STREAMnull found YarnCloudAppServiceApplication org.springframework.cloud.deployer.spi.yarn.YarnCloudAppServiceApplication@72feb9aa 2017-02-04 02:26:25.277 INFO 4940 --- [nio-9393-exec-3] o.s.c.deployer.spi.yarn.YarnAppDeployer : Checking status of ticktock:log:application_1486192446476_0003 2017-02-04 02:26:25.277 INFO 4940 --- [nio-9393-exec-3] o.s.c.d.s.y.DefaultYarnCloudAppService : Cachekey STREAMnull found YarnCloudAppServiceApplication org.springframework.cloud.deployer.spi.yarn.YarnCloudAppServiceApplication@72feb9aa 2017-02-04 02:26:25.279 INFO 4940 --- [nio-9393-exec-3] o.s.c.d.s.y.DefaultYarnCloudAppService : Cachekey STREAMnull found YarnCloudAppServiceApplication org.springframework.cloud.deployer.spi.yarn.YarnCloudAppServiceApplication@72feb9aa 2017-02-04 02:26:25.280 INFO 4940 --- [nio-9393-exec-3] o.s.c.d.s.y.DefaultYarnCloudAppService : Cachekey STREAMnull found YarnCloudAppServiceApplication org.springframework.cloud.deployer.spi.yarn.YarnCloudAppServiceApplication@72feb9aa 2017-02-04 02:26:25.281 INFO 4940 --- [nio-9393-exec-3] o.s.c.d.s.y.DefaultYarnCloudAppService : Cachekey STREAMnull found YarnCloudAppServiceApplication org.springframework.cloud.deployer.spi.yarn.YarnCloudAppServiceApplication@72feb9aa

我认为这意味着流和任务未成功部署,对吧?如何解决这个问题呢?感谢。

0 个答案:

没有答案