我运行命令:./ build / mvn -DskipTests clean package
但构建Catalyst失败
[INFO] Spark Project Parent POM ........................... SUCCESS [ 2.089 s]
[INFO] Spark Project Tags ................................. SUCCESS [ 3.546 s]
[INFO] Spark Project Sketch ............................... SUCCESS [ 3.592 s]
[INFO] Spark Project Local DB ............................. SUCCESS [ 2.513 s]
[INFO] Spark Project Networking ........................... SUCCESS [ 3.968 s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 2.359 s]
[INFO] Spark Project Unsafe ............................... SUCCESS [ 4.068 s]
[INFO] Spark Project Launcher ............................. SUCCESS [ 3.777 s]
[INFO] Spark Project Core ................................. SUCCESS [01:27 min]
[INFO] Spark Project ML Local Library ..................... SUCCESS [ 4.061 s]
[INFO] Spark Project GraphX ............................... SUCCESS [ 7.270 s]
[INFO] Spark Project Streaming ............................ SUCCESS [ 18.742 s]
[INFO] Spark Project Catalyst ............................. FAILURE [ 14.085 s]
[INFO] Spark Project SQL .................................. SKIPPED
我的锌服务器已经运行,我不知道问题
失败日志是:
[error] /Users/sky/Documents/spark-master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/sql/DataFrameReader.scala:39: object v2 is not a member of package org.apache.spark.sql.sources
[error] import org.apache.spark.sql.sources.v2.{DataSourceOptions, DataSourceV2, ReadSupport, ReadSupportWithSchema}
[error] ^
[error] /Users/sky/Documents/spark-master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/sql/DataFrameReader.scala:177: not found: value DataSourceOptions
[error] option(DataSourceOptions.PATH_KEY, path).load(Seq.empty: _*)
[error] ^
[error] /Users/sky/Documents/spark-master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/sql/DataFrameReader.scala:194: not found: type DataSourceV2
[error] Error occurred in an application involving default arguments.
[error] if (classOf[DataSourceV2].isAssignableFrom(cls)) {
[error] ^
[error] /Users/sky/Documents/spark-master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/sql/DataFrameReader.scala:195: not found: type DataSourceV2
[error] Error occurred in an application involving default arguments.
[error] val ds = cls.newInstance().asInstanceOf[DataSourceV2]
[error] ^
[error] /Users/sky/Documents/spark-master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/sql/DataFrameReader.scala:196: not found: type ReadSupport
[error] Error occurred in an application involving default arguments.
[error] if (ds.isInstanceOf[ReadSupport] || ds.isInstanceOf[ReadSupportWithSchema]) {
[error] ^
[error] /Users/sky/Documents/spark-master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/sql/DataFrameReader.scala:196: not found: type ReadSupportWithSchema
[error] Error occurred in an application involving default arguments.
[error] if (ds.isInstanceOf[ReadSupport] || ds.isInstanceOf[ReadSupportWithSchema]) {
[error] source: DataSourceV2,