Question

在spark-1.6.2集群上运行火花纱应用程序时，我在驱动程序中遇到错误：

2017-03-27 18:41:50 SIGTERM handler [INFO ] ApplicationMaster - Final app status: FAILED, exitCode: 16
2017-03-27 18:41:50 SIGTERM handler [ERROR] ApplicationMaster - RECEIVED SIGNAL 15: SIGTERM
2017-03-27 18:41:50 Driver [ERROR] SparkDriver - Failed to start the driver for TestApp
java.lang.InterruptedException
    at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2048)
    at org.apache.spark.streaming.ContextWaiter.waitForStopOrError(ContextWaiter.scala:63)
    at org.apache.spark.streaming.StreamingContext.awaitTermination(StreamingContext.scala:642)
    at org.apache.spark.streaming.api.java.JavaStreamingContext.awaitTermination(JavaStreamingContext.scala:632)
    at com.test.example.SparkDriver.submit(SparkDriver.java:119)
    at com.test.example.SparkDriver.main(SparkDriver.java:94)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)

Answer 1

此问题发生在HDP(hortonworks) Cluster，问题是HDP upgrade。 HDP环境的升级介于两者之间，此HDP群集暂停了升级。升级完成后，问题得到解决，我就可以在群集上运行spark yarn applications。

最终应用状态：FAILED，exitCode：16 RECEIVED SIGNAL 15：SIGTERM

1 个答案: