Spark的序列化

时间:2016-11-08 11:29:50

标签: java serialization apache-spark

我有一个自己的.jar,并希望将.jar部署到Spark中。我得到了它,但现在我遇到了一些新代码的问题,其中" NumberFormat"和#34; Locale" Java clasess用作全局变量:

private NumberFormat machineLocale
private Locale locale

如果我包含这个新代码并尝试在Spark中部署,我会收到以下错误:

Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: Task 1 in stage 1.0 failed 4 times, most recent failure: Lost task 1.3 in stage 1.0 (TID 9, sparkslave4.local): java.io.IOException: com.esotericsoftware.kryo.KryoException: Error during Java deserialization.

序列化跟踪: locale(java.text.DecimalFormatSymbols) 符号(java.text.DecimalFormat) NUMBERFORMAT

拜托,有人能给我一个线索吗?我该如何处理这些课程? 非常感谢

0 个答案:

没有答案