构建spark-mllib_2.10时出错

Question

我检查了apache spark项目，尝试构建mllib_2.10。但是，我收到以下错误。我错过了什么？谢谢！

然后我在eclipse中尝试：运行为 - ＆gt; Maven构建 - ＆gt;目标：打包并获得以下错误：

Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "qtp913470727-59183"

Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "sparkWorker2-akka.remote.default-remote-dispatcher-42"
Exception in thread "qtp913470727-59184" Exception in thread "qtp1386084932-462" Exception in thread "qtp1406684524-398" 
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "qtp149043988-424"
Exception in thread "qtp1386084932-59186" 
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "qtp913470727-59184"
Exception in thread "qtp1406684524-397" java.lang.OutOfMemoryError: Java heap space
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "sparkWorker2-scheduler-1"

Exception in thread "qtp1386084932-455" Exception in thread "qtp1406684524-394" Exception in thread "qtp149043988-59182" Exception in thread "qtp913470727-467" java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
Exception in thread "Timer-4" java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
Exception in thread "qtp149043988-419" java.lang.OutOfMemoryError: Java heap space

Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "sparkMaster-scheduler-1"
Exception in thread "qtp149043988-418" java.lang.OutOfMemoryError: Java heap space
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "sparkWorker1-akka.actor.default-dispatcher-52"

我已经在eclipse.ini中增加了内存，如下所示：

-XX:MaxPermSize=512m
-Xms128m
-Xmx2048m

有没有办法让这个东西在eclipse中运行？谢谢！

Answer 1

如果您可以在命令行上成功构建它，它也可以在Eclipse中使用M2Eclipse。

只需使用Run As - Maven构建......

并根据需要进行配置。

您看到的警告是关于Eclipse中的增量行为，但即使它们不完全匹配和工作，您仍然可以构建项目。

如果内存不足，可能会分配给Maven或Eclipse。使用MAVEN_OPTS环境变量为Maven设置内存。