Question

我正在尝试运行此project，按照说明提供了它们：

安装Java 1.8
获取Spark 2.2.x：下载并解压缩，然后设置环境
变量：export SPARK_HOME =
克隆TransmogrifAI存储库：git clone
https://github.com/salesforce/TransmogrifAI.git
构建项目：cd TransmogrifAI && ./gradlew compileTestScala
installDist

直到我收到此消息：

Starting a Gradle Daemon, 1 incompatible Daemon could not be reused, use --status for details

> Task :scalaStyle
Found 0 warnings
Found 0 errors

BUILD SUCCESSFUL in 43s
8 actionable tasks: 6 executed, 2 up-to-date

之后，我想尝试这里的一种模型：

https://docs.transmogrif.ai/en/stable/examples/Titanic-Binary-Classification.html

但是在运行命令期间：

cd helloworld
./gradlew compileTestScala installDist
./gradlew -q sparkSubmit -Dmain=com.salesforce.hw.OpTitanicSimple -Dargs="\
`pwd`/src/main/resources/TitanicDataset/TitanicPassengersTrainData.csv"

我收到此错误：

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sparkSubmit'.
> A problem occurred starting process 'command 'null/bin/spark-submit''

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 2s

我试图找出答案，但是对此一无所知，我该如何解决这个问题？

Answer 1

启动过程'null / bin / spark-submit'命令时发生问题

“ null / bin / spark-submit”中的“ null”部分表明未设置“ SPARK_HOME”位置。您提到在安装的第二步中设置环境变量。

那么您可以检查SPARK_HOME环境变量是否设置正确吗？

Answer 2

确保正确设置SPARK_HOME指向您提取Spark的文件夹。例如。 export SPARK_HOME="~/spark-2.2.1-bin-hadoop2.7"

TransmogrifAI：失败：构建失败，出现异常

2 个答案: