我正在尝试使用Sparkling library来使用来自Clojure的Spark。然而,即使是这样一个简单的代码:
(ns sql-spark.core
(:gen-class)
(:require [yesql.core :refer [defquery]]
[clojure.java.io :as io]
[clojure.edn :as edn]
[sparkling.conf :as conf]
[sparkling.core :as spark]))
(defn -main []
(println "Hi"))
结束于:
Exception in thread "main" java.lang.ClassNotFoundException: org.apache.spark.SparkConf, compiling:(sparkling/conf.clj:1:1)
我安装了Spark,并且我已经使用Scala多次使用它了。我在这里缺少什么?
修改
project.clj
:
(defproject sql-spark "1.0.0"
:description "FIXME: write description"
:url "http://example.com/FIXME"
:license {:name "Eclipse Public License"
:url "http://www.eclipse.org/legal/epl-v10.html"}
:dependencies [[org.clojure/clojure "1.8.0"]
[yesql "0.5.3"]
[mysql/mysql-connector-java "5.1.32"]
[gorillalabs/sparkling "1.2.5"]]
:main ^:skip-aot sql-spark.core)
答案 0 :(得分:1)
想出来。我在[org.apache.spark/spark-core_2.10 "1.6.1"]
部分
:dependencies