在驱动程序中捕获异常后，如何在不执行Spark中的转换或输出操作的情况下从RDD记录数据

Question

我正在尝试记录dStream中失败的所有数据，但我得到的是异常。

Caused by: java.lang.IllegalStateException: Adding new inputs, transformations, and output operations after stopping a context is not supported
    at org.apache.spark.streaming.dstream.DStream.validateAtInit(DStream.scala:224)
    at org.apache.spark.streaming.dstream.DStream.<init>(DStream.scala:64)
    at org.apache.spark.streaming.dstream.MappedDStream.<init>(MappedDStream.scala:25)
    at org.apache.spark.streaming.dstream.DStream$$anonfun$map$1.apply(DStream.scala:528)
    at org.apache.spark.streaming.dstream.DStream$$anonfun$map$1.apply(DStream.scala:528)
    at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:147)
    at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:108)
    at org.apache.spark.SparkContext.withScope(SparkContext.scala:700)
    at org.apache.spark.streaming.StreamingContext.withScope(StreamingContext.scala:258)
    at org.apache.spark.streaming.dstream.DStream.map(DStream.scala:527)
    at org.apache.spark.streaming.api.java.JavaDStreamLike$class.map(JavaDStreamLike.scala:157)
    at org.apache.spark.streaming.api.java.AbstractJavaDStreamLike.map(JavaDStreamLike.scala:43)