Question

我正在尝试使用Tez作为我的Hive执行引擎。我正在将Hive表中的实木复合地板数据文件加载。这是我用于设置Spark会话的代码

SparkSession session = SparkSession.builder().appName("ParquetReadWrite").
                config("hive.exec.dynamic.partition", "true").
                config("hive.exec.dynamic.partition.mode", "nonstrict").
                config("hive.execution.engine","spark").
                config("hive.exec.max.dynamic.partitions","400").
                config("hive.exec.max.dynamic.partitions.pernode","400").
                config("hive.enforce.bucketing","true").
                config("optimize.sort.dynamic.partitionining","true").
                config("hive.vectorized.execution.enabled","true").
                config("hive.enforce.sorting","true").
                enableHiveSupport()
                .master(args[0]).getOrCreate();

运行代码将数据加载到hive中时，出现以下错误：

java.lang.ClassNotFoundException: java.lang.NoClassDefFoundError: org/apache/tez/dag/api/SessionNotRunning when creating Hive client using classpath: <file path>

我必须将哪个罐子复制到哪个位置？

在Spark中将Tez用作Hive执行引擎时出错

0 个答案: