我遇到属性未绑定错误,当我链接数据帧转换时会出现此错误。我正在将输入文件作为文件流读取。
这是pyspark错误还是我的代码问题?
org.apache.spark.sql.catalyst.errors.package$TreeNodeException: Binding attribute, tree: EMP_SAL#7736.
2019-03-13 15:25:53 WARN TaskSetManager:66 - Lost task 0.0 in stage 90.0 (TID 101, localhost, executor driver): org.apache.spark.SparkException: Task failed while writing rows.
at org.apache.spark.sql.execution.datasources.FileFormatWriter$.org$apache$spark$sql$execution$datasources$FileFormatWriter$$executeTask(FileFormatWriter.scala:254)
at org.apache.spark.sql.execution.datasources.FileFormatWriter$$anonfun$write$1.apply(FileFormatWriter.scala:169)
at org.apache.spark.sql.execution.datasources.FileFormatWriter$$anonfun$write$1.apply(FileFormatWriter.scala:168)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
caused by: org.apache.spark.sql.catalyst.errors.package$TreeNodeException: Binding tree: null