spark收集特定分区的列统计信息

时间:2018-07-01 20:37:17

标签: apache-spark apache-spark-sql partition cost-based-optimizer

如何告诉spark仅收集特定分区的列统计信息?

WARN SparkSqlAstBuilder: Partition specification is ignored when collecting column statistics: PARTITION(myPart='myValue')

似乎忽略了我的过滤条件:

ANALYZE TABLE ${fullyQualifiedTable}
PARTITION(${table.partitionColumn} = '$partitionVal')
COMPUTE STATISTICS
FOR COLUMNS ${co.mkString(", ")}

0 个答案:

没有答案