我正在自动请求一个网站，该网站正在发送一个带有org.apache.spark.SparkException: Task not serializable
at org.apache.spark.util.ClosureCleaner$.ensureSerializable(ClosureCleaner.scala:403)
at org.apache.spark.util.ClosureCleaner$.org$apache$spark$util$ClosureCleaner$$clean(ClosureCleaner.scala:393)
at org.apache.spark.util.ClosureCleaner$.clean(ClosureCleaner.scala:162)
at org.apache.spark.SparkContext.clean(SparkContext.scala:2326)
at org.apache.spark.rdd.RDD$$anonfun$map$1.apply(RDD.scala:371)
at org.apache.spark.rdd.RDD$$anonfun$map$1.apply(RDD.scala:370)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)
at org.apache.spark.rdd.RDD.withScope(RDD.scala:363)
at org.apache.spark.rdd.RDD.map(RDD.scala:370)
... 56 elided
Caused by: java.io.NotSerializableException: org.apache.spark.SparkContext
Serialization stack:
- object not serializable (class: org.apache.spark.SparkContext, value: org.apache.spark.SparkContext@4d87e7f3)
- field (class: $iw, name: spark, type: class org.apache.spark.SparkContext)
- object (class $iw, $iw@65af4162)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@7da837af)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@54d0724f)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@389ae8f1)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@55ecf961)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@428c9250)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@d931617)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@2625c1cc)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@1231e446)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@27dbe9a3)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@63ad2a0f)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@203f41d7)
- field (class: $line19.$read, name: $iw, type: class $iw)
- object (class $line19.$read, $line19.$read@46a9af36)
- field (class: $iw, name: $line19$read, type: class $line19.$read)
- object (class $iw, $iw@19d118d5)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@5dac488d)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@1bba5848)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@4f1a6259)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@25712d03)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@750c242e)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@ad038f8)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@4ba64e36)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@223f8c82)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@ba1f5d1)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@4355f7b6)
- field (class: $line22.$read, name: $iw, type: class $iw)
- object (class $line22.$read, $line22.$read@44535df8)
- field (class: $iw, name: $line22$read, type: class $line22.$read)
- object (class $iw, $iw@32e14e55)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@5a78e7e3)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@28736857)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@16be6b36)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@211e1b51)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@1cce2194)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@7b31281b)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@63c9017b)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@e343477)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@3a182eaf)
- field (class: $iw, name: $iw, type: class $iw)
- object (class $iw, $iw@131af11d)
- field (class: $line24.$read, name: $iw, type: class $iw)
- object (class $line24.$read, $line24.$read@7cb39309)
- field (class: $iw, name: $line24$read, type: class $line24.$read)
- object (class $iw, $iw@282afe91)
- field (class: $iw, name: $outer, type: class $iw)
- object (class $iw, $iw@33592b53)
- field (class: $anonfun$1, name: $outer, type: class $iw)
- object (class $anonfun$1, <function1>)
at org.apache.spark.serializer.SerializationDebugger$.improveException(SerializationDebugger.scala:40)
at org.apache.spark.serializer.JavaSerializationStream.writeObject(JavaSerializer.scala:46)
at org.apache.spark.serializer.JavaSerializerInstance.serialize(JavaSerializer.scala:100)
at org.apache.spark.util.ClosureCleaner$.ensureSerializable(ClosureCleaner.scala:400)
... 65 more
的请求，其中包含大量数据，但我不知道它来自何处。
起初，我以为这段文字是用0000001 ********** ** * 46 39 8 5 21
0000004 ********** ** * 58 71 20 10 6
0000009 ********** ** * 60 89 33 18 6
0000003 杉山______ 26 F 30 50 71 36 30
0000007 梶川______ 42 F 50 2 33 15 62
编码的，但是并没有给我带来可读性。我希望是否有人在那里可以使用一些知识或软件来解密formData的一部分。我不太有经验，所以我不是100％肯定它是加密的，但是我有信心，因为否则它将只是一小段文本，仅此而已。
我在下面包括一个粘贴容器，它应该有两个部分“ bg：”和“ z：”。它们是单独的文本块。预先感谢您与这个问题进行互动！ Paste-bin link
base64答案 0 :(得分：2)
您在错误的位置搜索。没有神奇的软件可以解码未知的编码或加密。最多我们可以测量熵（加密或压缩的高熵点）或字母大小（64到base64等）的大小。
但是，如果您浏览器的请求中存在此编码数据，则说明该数据是在浏览器内部生成的。尝试检查页面和JavaScript，以查找如何产生此数据。为了使您的工作更加困难，可能会故意混淆代码，但是与仅仅猜测算法相比，对请求创建进行反向工程仍然更加容易。