清理Titan base会导致超时异常(Backend = Hbase)

时间:2014-07-02 11:50:51

标签: hbase titan

我正在尝试清理我的titan数据库并导致异常。 我想我的数据库很大,它会超时但是,我怎么能在titan中配置它。我使用Hbase作为存储后端。 这是我的代码返回异常; 泰坦版本:0.4.4

g.shutdown();
TitanCleanup.clear(g);

Exception in thread "main" com.thinkaurelius.titan.core.TitanException: Unexpected exception during backend operation
    at com.thinkaurelius.titan.diskstorage.util.BackendOperation.execute(BackendOperation.java:67)
    at com.thinkaurelius.titan.core.util.TitanCleanup.clear(TitanCleanup.java:32)
    at TitanMain.main(TitanMain.java:39)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:483)
    at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)
Caused by: java.lang.RuntimeException: org.apache.hadoop.hbase.client.ScannerTimeoutException: 106728ms passed since the last invocation, timeout is currently set to 60000
    at org.apache.hadoop.hbase.client.AbstractClientScanner$1.hasNext(AbstractClientScanner.java:44)
    at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.clearStorage(HBaseStoreManager.java:358)
    at com.thinkaurelius.titan.diskstorage.Backend.clearStorage(Backend.java:465)
    at com.thinkaurelius.titan.core.util.TitanCleanup$1.call(TitanCleanup.java:35)
    at com.thinkaurelius.titan.core.util.TitanCleanup$1.call(TitanCleanup.java:32)
    at com.thinkaurelius.titan.diskstorage.util.BackendOperation.execute(BackendOperation.java:62)
    ... 7 more
Caused by: org.apache.hadoop.hbase.client.ScannerTimeoutException: 106728ms passed since the last invocation, timeout is currently set to 60000
    at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:283)
    at org.apache.hadoop.hbase.client.AbstractClientScanner$1.hasNext(AbstractClientScanner.java:41)
    ... 12 more
Caused by: org.apache.hadoop.hbase.UnknownScannerException: org.apache.hadoop.hbase.UnknownScannerException: Name: -3465920678372616028
    at org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2625)
    at sun.reflect.GeneratedMethodAccessor28.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:323)
    at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1434)

    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:408)
    at org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:96)
    at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:149)
    at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:42)
    at org.apache.hadoop.hbase.client.ServerCallable.withRetries(ServerCallable.java:163)
    at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:274)
    ... 13 more

2 个答案:

答案 0 :(得分:1)

Caused by: org.apache.hadoop.hbase.client.ScannerTimeoutException: 106728ms passed since the last invocation, timeout is currently set to 60000 @ HBaseStoreManager.java:358表示从HBase删除单行需要约107秒。单次HTable.delete电话是一段荒谬的漫长时间。您的群集或客户端是什么?您可以在此处查看相关代码:https://github.com/thinkaurelius/titan/blob/0.4.4/titan-hbase/src/main/java/com/thinkaurelius/titan/diskstorage/hbase/HBaseStoreManager.java#L358

答案 1 :(得分:0)

好吧,我已经重新启动了,现在它可以做清楚的操作了。 很奇怪,但它现在正在工作。