Question

我正在尝试使用Sparkling library来使用来自Clojure的Spark。然而，即使是这样一个简单的代码：

(ns sql-spark.core
  (:gen-class)
  (:require [yesql.core :refer [defquery]]
            [clojure.java.io :as io]
            [clojure.edn :as edn]
            [sparkling.conf :as conf]
            [sparkling.core :as spark]))

(defn -main []
  (println "Hi"))

结束于：

Exception in thread "main" java.lang.ClassNotFoundException: org.apache.spark.SparkConf, compiling:(sparkling/conf.clj:1:1)

我安装了Spark，并且我已经使用Scala多次使用它了。我在这里缺少什么？

修改 project.clj：

(defproject sql-spark "1.0.0"
  :description "FIXME: write description"
  :url "http://example.com/FIXME"
  :license {:name "Eclipse Public License"
            :url "http://www.eclipse.org/legal/epl-v10.html"}
  :dependencies [[org.clojure/clojure "1.8.0"]
                 [yesql "0.5.3"]
                 [mysql/mysql-connector-java "5.1.32"]
                 [gorillalabs/sparkling "1.2.5"]]
  :main ^:skip-aot sql-spark.core)

Answer 1

想出来。我在[org.apache.spark/spark-core_2.10 "1.6.1"]部分

中遗漏了:dependencies

Clojure：无法运行Sparkling

1 个答案: