Spark2 Zeppelin解释器依赖导致Null指针NullPointerException

时间:2018-04-12 12:38:46

标签: apache-spark dependency-management hadoop2 apache-zeppelin apache-spark-2.0

我正在尝试在Zeppelin中向Spark2解释器添加依赖项,如下所示:

m = [[0] * 4] * 3
print(m) # --> [[0, 0, 0, 0], [0, 0, 0, 0], [0, 0, 0, 0]]
m[0][0] = 5
print(m) # --> [[5, 0, 0, 0], [5, 0, 0, 0], [5, 0, 0, 0]]

enter image description here

  • localRepo位置没有罐子。所以在我添加之后 依赖并运行一个简单的命令,如 org.bdgenomics.adam:adam-core-spark2_2.11:0.23.0 我 我得到这个NullPointerException:
  

显示java.lang.NullPointerException         在org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:861)         在org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)         at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer $ InterpretJob.jobRun(RemoteInterpreterServer.java:493)         在org.apache.zeppelin.scheduler.Job.run(Job.java:175)         在org.apache.zeppelin.scheduler.FIFOScheduler $ 1.run(FIFOScheduler.java:139)         at java.util.concurrent.Executors $ RunnableAdapter.call(Executors.java:511)         at java.util.concurrent.FutureTask.run(FutureTask.java:266)         at java.util.concurrent.ScheduledThreadPoolExecutor $ ScheduledFutureTask.access $ 201(ScheduledThreadPoolExecutor.java:180)         at java.util.concurrent.ScheduledThreadPoolExecutor $ ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)         在java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)         at java.util.concurrent.ThreadPoolExecutor $ Worker.run(ThreadPoolExecutor.java:624)         在java.lang.Thread.run(Thread.java:748)

  • 现在,println("hello world")文件夹中有很多带有jar的包 同样位于local-repo下的位置 参数local-repo/2C4U48MY3_spark2

这是zeppelin spark2解释器日志:http://pasted.co/06cbc12a

没有这种依赖,一切正常。

我无法说明为什么我会收到这份NPE。你能帮帮我吗?

0 个答案:

没有答案