构建Spark

时间:2016-08-18 17:11:09

标签: apache-spark

我从Github克隆了一个Spark的branch-2.0分支的新副本到Centos 7系统。执行suggested命令从源代码构建时,

./dev/make-distribution.sh --name custom-spark --tgz -Psparkr -Phadoop-2.4 -Phive -Phive-thriftserver -Pyarn

我收到以下错误:

[INFO] Total time: 5.368 s (Wall Clock)
[INFO] Finished at: 2016-08-18T11:56:49-05:00
[error[INFO] Final Memory: 71M/1963M
] [INFO] ------------------------------------------------------------------------
/home/rprechelt/ada/spark/common/tags/src/main/scala/org/apache/spark/annotation/Since.scala:30: error writing class Since: /home/rprechelt/ada/spark/common/tags/target/scala-2.11/classes/org/apache/spark/annotation/Since.class: /home/rprechelt/ada/spark/common/tags/target/scala-2.11/classes/org is not a directory
[error] private[spark] class Since(version: String) extends StaticAnnotation
[error]                      ^
[error] /home/rprechelt/ada/spark/common/tags/src/main/scala/org/apache/spark/annotation/package.scala:25: error writing package object annotation: /home/rprechelt/ada/spark/common/tags/target/scala-2.11/classes/org/apache/spark/annotation/package.class: /home/rprechelt/ada/spark/common/tags/target/scala-2.11/classes/org is not a directory
[error] package object annotation
[error]                ^
[error] two errors found
[error] Compile failed at Aug 18, 2016 11:56:49 AM [0.358s]
[ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on project spark-sketch_2.10: Execution scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed -> [Help 1]

我对此处可能发生的事情感到茫然 - 我尝试使用不同版本的Scala构建它,但它们都报告了相同的错误。

有没有人对我如何解决这个问题有任何建议?

1 个答案:

答案 0 :(得分:0)

我遇到了同样的问题,这是因为锌服务器是由其他一些用户启动的。尝试杀死锌然后再次开始构建。

它基本上是一个访问错误,其他用户启动的锌服务器正在尝试写入另一个目录。

sudo ps -ef | grep zinc