标签: hadoop apache-spark hdfs
我将以下属性添加到spark-defaults.conf:
spark-defaults.conf
spark.history.fs.cleaner.enabled true
spark.history.fs.cleaner.interval 1d
spark.history.fs.cleaner.maxAge 7d