Spark安装错误,同时构建sbt包时抛出一些错误

时间:2014-02-13 06:36:37

标签: scala apache-spark

在spark中编译“sbt package”时,出现了以下错误。

Launching sbt from sbt/sbt-launch-0.12.4.jar
[info] Loading project definition from /home/hduser/spark-0.9.0-incubating/project/project
[info] Loading project definition from /home/hduser/spark-0.9.0-incubating/project
[info] Updating {git://github.com/ijuma/junit_xml_listener.git#fe434773255b451a38e8d889536ebc260f4225ce}default-6aef7c...
[info] Resolving org.scala-sbt#precompiled-2_10_1;0.12.4 ...
[info] Done updating.
[info] Updating {file:/home/hduser/spark-0.9.0-incubating/project/}plugins...
[info] Resolving org.scala-sbt#precompiled-2_10_1;0.12.4 ...
[info] downloading http://scalasbt.artifactoryonline.com/scalasbt/sbt-plugin-releases/com.eed3si9n/sbt-assembly/scala_2.9.2/sbt_0.12/0.9.2/jars/sbt-assembly.jar ...
[info]  [SUCCESSFUL ] com.eed3si9n#sbt-assembly;0.9.2!sbt-assembly.jar (4722ms)
[info] downloading http://repo.typesafe.com/typesafe/ivy-releases/com.typesafe.sbteclipse/sbteclipse-plugin/scala_2.9.2/sbt_0.12/2.2.0/jars/sbteclipse-plugin.jar ...
[info]  [SUCCESSFUL ] com.typesafe.sbteclipse#sbteclipse-plugin;2.2.0!sbteclipse-plugin.jar (1619ms)
[info] downloading http://repo1.maven.org/maven2/com/github/mpeltonen/sbt-idea_2.9.2_0.12/1.5.1/sbt-idea-1.5.1.jar ...
[info]  [SUCCESSFUL ] com.github.mpeltonen#sbt-idea;1.5.1!sbt-idea.jar (3725ms)
[info] downloading http://repo1.maven.org/maven2/net/virtual-void/sbt-dependency-graph_2.9.2_0.12/0.7.3/sbt-dependency-graph-0.7.3.jar ...
[info]  [SUCCESSFUL ] net.virtual-void#sbt-dependency-graph;0.7.3!sbt-dependency-graph.jar (1932ms)
[info] downloading http://repo.typesafe.com/typesafe/ivy-releases/com.typesafe.sbteclipse/sbteclipse-core/scala_2.9.2/sbt_0.12/2.2.0/jars/sbteclipse-core.jar ...
[info]  [SUCCESSFUL ] com.typesafe.sbteclipse#sbteclipse-core;2.2.0!sbteclipse-core.jar (4184ms)
[info] downloading http://repo1.maven.org/maven2/com/github/mdr/ascii-graphs_2.9.2/0.0.2/ascii-graphs_2.9.2-0.0.2.jar ...
[info]  [SUCCESSFUL ] com.github.mdr#ascii-graphs_2.9.2;0.0.2!ascii-graphs_2.9.2.jar (4871ms)
[info] Done updating.
[info] Compiling 1 Scala source to /home/hduser/.sbt/staging/90b1b0889ba1299e38f2/target/scala-2.9.2/sbt-0.12/classes...
./sbt/sbt: line 50: 10232 Killed                  java -Xmx1200m -XX:MaxPermSize=350m -XX:ReservedCodeCacheSize=256m -jar ${JAR} "$@"

我正在使用,

的Scala-2.10.3 火花0.9.0-培养 SBT-o.12.4

是否需要任何其他设置。非常乐意帮助我。

谢谢, 巴布

1 个答案:

答案 0 :(得分:1)

在打包之前设置最小和最大堆大小:

export _JAVA_OPTIONS="-Xmx1300M -Xms1300M -XX:MaxPermSize=512M -XX:ReservedCodeCacheSize=512m"

有关详细信息,请参阅以下内容: sbt manual installation