在Windows 10或7的Apache Zeppelin中运行Spark程序时出现错误

时间:2018-07-29 06:20:44

标签: apache-zeppelin

我是Apache Zeppelin的新手。已安装0.8.0,并使用7000端口访问Zeppelin。如下所述配置了几个路径。

JAVA_HOME:C:\ Program Files \ Java \ jdk1.8.0_144 HADOOP_HOME:C:\ winutils ZEPPELIN_HOME:C:\ zeppelin \ zeppelin-0.8.0-bin-all \ zeppelin-0.8.0-bin-all

所有这些变量都包含在路径变量和相应的bin文件夹中

试图运行spark程序并出现以下错误。尝试使用多个选项进行修复,但无法。请帮忙。

火花程序: %火花 println(sc.appName)

错误: 调试[2018-07-29 00:06:05,371]({pool-2-thread-2} RemoteInterpreterManagedProcess.java [start]:153)-callbackServer现在正在提供  INFO [2018-07-29 00:06:05,380]({pool-2-thread-2} RemoteInterpreterManagedProcess.java [start]:190)-运行解释器进程[C:\ zeppelin \ zeppelin-0.8.0-bin- all \ zeppelin-0.8.0-bin-all \ bin \ interpreter.cmd,-d,C:\ zeppelin \ zeppelin-0.8.0-bin-all \ zeppelin-0.8.0-bin-all / interpreter / spark, -c,10.120.44.23,-p,57136,-r,:,-l,C:\ zeppelin \ zeppelin-0.8.0-bin-all \ zeppelin-0.8.0-bin-all / local-repo / spark ,-g,spark] 调试[2018-07-29 00:06:09,625]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298)-警告:本地jar C:\ Users \ vvellabo \ 57136不存在,正在跳过。 调试[2018-07-29 00:06:09,626]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298)-警告:本地jar C:\ Users \ vvellabo \ 10.120.44.23不存在,正在跳过。 调试[2018-07-29 00:06:09,627]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298)-java.lang.ClassNotFoundException:org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer 调试[2018-07-29 00:06:09,628]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298)-在java.net.URLClassLoader.findClass(URLClassLoader.java:381) 调试[2018-07-29 00:06:09,630]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298)-在java.lang.ClassLoader.loadClass(ClassLoader.java:424) 调试[2018-07-29 00:06:09,632]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298)-在java.lang.ClassLoader.loadClass(ClassLoader.java:357) 调试[2018-07-29 00:06:09,633]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298)-在java.lang.Class.forName0(本机方法) 调试[2018-07-29 00:06:09,634]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298)-在java.lang.Class.forName(Class.java:348) 调试[2018-07-29 00:06:09,635]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298)-在org.apache.spark.util.Utils $ .classForName(Utils.scala:238) 调试[2018-07-29 00:06:09,641]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298)-在org.apache.spark.deploy.SparkSubmit $ .org $ apache $ spark $ deploy $ SparkSubmit $$ runMain(SparkSubmit.scala:851) 调试[2018-07-29 00:06:09,642]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298)-在org.apache.spark.deploy.SparkSubmit $ .doRunMain $ 1(SparkSubmit.scala:198) 调试[2018-07-29 00:06:09,644]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298)-在org.apache.spark.deploy.SparkSubmit $ .submit(SparkSubmit.scala:228) 调试[2018-07-29 00:06:09,645]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298)-在org.apache.spark.deploy.SparkSubmit $ .main(SparkSubmit.scala:137) 调试[2018-07-29 00:06:09,647]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298)-在org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) DEBUG [2018-07-29 00:06:09,656]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298)-2018-07-29 00:06:09 INFO ShutdownHookManager:54-调用了关闭挂钩 调试[2018-07-29 00:06:09,659]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298)-2018-07-29 00:06:09 INFO ShutdownHookManager:54-删除目录C:\ Users \ vvellabo \ AppData \ Local \ Temp \ spark-427c3202-c243-4761-86ce-ea51a27a881c  INFO [2018-07-29 00:06:09,747]({Exec Default Executor} RemoteInterpreterManagedProcess.java [onProcessFailed]:250)-解释程序失败{} org.apache.commons.exec.ExecuteException:进程退出,错误为101(退出值:101)         在org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404)         在org.apache.commons.exec.DefaultExecutor.access $ 200(DefaultExecutor.java:48)         在org.apache.commons.exec.DefaultExecutor $ 1.run(DefaultExecutor.java:200)         在java.lang.Thread.run(Thread.java:748) 错误[2018-07-29 00:07:05,382]({pool-2-thread-2} Job.java [run]:190)-作业失败 java.lang.RuntimeException:警告:本地jar C:\ Users \ vvellabo \ 57136不存在,正在跳过。 警告:本地jar C:\ Users \ vvellabo \ 10.120.44.23不存在,正在跳过。

谢谢 vvell

0 个答案:

没有答案