Question

当我尝试提交我的火花作业以进行测试时，我收到了以下错误信息。

jianrui@spark:~$ sudo $SPARK_HOME/bin/spark-submit --class com.test.spark.FirstScalaExample --master spark://spark.sparkstreaming.i10.internal.cloudapp.net:7077 /opt/spark/FirstScalaExample-0.0.1.jar
Exception in thread "main" java.lang.NoSuchMethodException: com.test.spark.FirstScalaExample.main([Ljava.lang.String;)
	at java.lang.Class.getMethod(Class.java:1786)
	at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:42)
	at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:879)
	at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:197)
	at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:227)
	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:136)
	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
2018-04-06 13:13:00 INFO  ShutdownHookManager:54 - Shutdown hook called
2018-04-06 13:13:00 INFO  ShutdownHookManager:54 - Deleting directory /tmp/spark-7f47cab1-f8b3-4731-bd67-e0d0ad013617

[斯卡拉版本 - 2.11.6]
[Hadoop版本 - 2.7.5]
[Spark版本 - 2.3.0]
注：
要知道我以这种方式指定了hadoop本机lib“在”spark-env.sh“中导出LD_LIBRARY_PATH = $ HADOOP_HOME / lib / native”，我只提取火花但未安装。
我不知道究竟是什么问题。

由于线程“main”java.lang.NoSuchMethodException中的Exception，spark-submit失败

0 个答案: