Pyspark .toPandas():'不支持的类文件主要版本55'

时间:2018-12-31 16:19:27

标签: pyspark

我有一个Pyspark数据框,正在将其转换为Pandas df,以便可以在其上使用seaborn。而且我得到以下错误:IllegalArgumentException:'不支持的类文件主要版本55'

我尝试了建议的here,因此我的Windows JAVA_HOME现在显示为:

C:\Users\XXXX\Downloads\jdk-11.0.1 -v 1.8

并尝试重新启动Jupyter,但无济于事。

完整的输出如下:

IllegalArgumentException                  Traceback (most recent call last)
<ipython-input-6-ac86121ca6f3> in <module>
      1 sns.set(style="white")
----> 2 df3 =df2.toPandas()
      3 g = sns.lineplot(x="TransactionDate", y="Amount", data=df3)
      4 display(g.fig)

~\Documents\2_PersonalWork\myenv\lib\site-packages\pyspark\sql\dataframe.py in toPandas(self)
   2140 
   2141         # Below is toPandas without Arrow optimization.
-> 2142         pdf = pd.DataFrame.from_records(self.collect(), columns=self.columns)
   2143 
   2144         dtype = {}

~\Documents\2_PersonalWork\myenv\lib\site-packages\pyspark\sql\dataframe.py in collect(self)
    531         """
    532         with SCCallSiteSync(self._sc) as css:
--> 533             sock_info = self._jdf.collectToPython()
    534         return list(_load_from_socket(sock_info, BatchedSerializer(PickleSerializer())))
    535 

~\Documents\2_PersonalWork\myenv\lib\site-packages\py4j\java_gateway.py in __call__(self, *args)
   1255         answer = self.gateway_client.send_command(command)
   1256         return_value = get_return_value(
-> 1257             answer, self.gateway_client, self.target_id, self.name)
   1258 
   1259         for temp_arg in temp_args:

~\Documents\2_PersonalWork\myenv\lib\site-packages\pyspark\sql\utils.py in deco(*a, **kw)
     77                 raise QueryExecutionException(s.split(': ', 1)[1], stackTrace)
     78             if s.startswith('java.lang.IllegalArgumentException: '):
---> 79                 raise IllegalArgumentException(s.split(': ', 1)[1], stackTrace)
     80             raise
     81     return deco

IllegalArgumentException: 'Unsupported class file major version 55'

0 个答案:

没有答案