Question

我只是用火花壳玩火花。我在EC2实例中用hive构建了火花。由于网络问题，我与EC2实例断开连接。

现在当我重新连接并启动spark-shell时，当我尝试创建hiveContext时，我收到以下错误

Caused by: ERROR XSDB6: Another instance of Derby may have already booted the database /home/ubuntu/work/software/spark/spark-1.2.2/metastore_db.
    at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
    at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.privGetJBMSLockOnDB(Unknown Source)
    at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.run(Unknown Source)
    at java.security.AccessController.doPrivileged(Native Method)
    at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.getJBMSLockOnDB(Unknown Source)
    at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.boot(Unknown Source)

这是因为之前的spark-shell仍在运行并且掌握了derby DB。

有没有办法找到杀死它的pid？

从here开始，我发现./bin/spark-class org.apache.spark.deploy.Client kill <driverId>会杀死火花。但是我怎样才能找到driverId？

Answer 1

您应该能够在http：//：8088连接到Web UI，然后从那里看到活动的驱动程序？

如何阻止火花从火花壳开始

1 个答案: