Spark 2.3:泄漏:在垃圾回收之前未调用ByteBuf.release()

时间:2019-03-20 14:28:43

标签: java apache-spark

最近将逻辑从left_outer连接更新为full外连接,我开始看到此错误:

ERROR util.ResourceLeakDetector: LEAK: ByteBuf.release() was not called before it's garbage-collected. See http://netty.io/wiki/reference-counted-objects.html for more information.
 Recent access records: 
 Exception in thread "main" org.apache.spark.sql.catalyst.errors.package$TreeNodeException: execute, tree:
 Exchange SinglePartition
 +- *(7) HashAggregate(keys=[], functions=[partial_count(1)], output=[count#945L])

发现了一个类似的旧错误,但我认为现在应该修复它: https://issues.apache.org/jira/browse/SPARK-21181

对如何解决此问题一无所知。

0 个答案:

没有答案