无法初始化类org.apache.spark.rdd.RDDOperationScope-Mule ESB

时间:2018-10-28 17:45:05

标签: java apache-spark apache-spark-sql mule esb

我创建了自己的SPARK连接器(在Mule ESB中)

不幸的是,我收到错误消息:

 `Exception stack is:
Could not initialize class org.apache.spark.rdd.RDDOperationScope$ (java.lang.NoClassDefFoundError). (org.mule.api.MessagingException)
  org.apache.spark.SparkContext.withScope(SparkContext.scala:693)
  org.apache.spark.SparkContext.parallelize(SparkContext.scala:710)
  org.apache.spark.sql.execution.datasources.InMemoryFileIndex$.org$apache$spark$sql$execution$datasources$InMemoryFileIndex$$bulkListLeafFiles(InMemoryFileIndex.scala:203)
  org.apache.spark.sql.execution.datasources.InMemoryFileIndex$.org$apache$spark$sql$execution$datasources$InMemoryFileIndex$$listLeafFiles(InMemoryFileIndex.scala:289)
  org.apache.spark.sql.execution.datasources.InMemoryFileIndex$$anonfun$org$apache$spark$sql$execution$datasources$InMemoryFileIndex$$bulkListLeafFiles$1.apply(InMemoryFileIndex.scala:174)
  org.apache.spark.sql.execution.datasources.InMemoryFileIndex$$anonfun$org$apache$spark$sql$execution$datasources$InMemoryFileIndex$$bulkListLeafFiles$1.apply(InMemoryFileIndex.scala:173)
  scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
  scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
  scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
  scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
  scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
`

我使用:

  • m子esb-3.9
  • spark-core_2.11-2.3.1
  • spark-sql_2.11-2.3.1

您知道什么地方可能出问题吗?

0 个答案:

没有答案