Question

我运行hbase性能工具，并且已经创建了数千个表。并且我们的集群当前处于不一致状态（我们不知道是什么原因，但是我们尝试找到了它），起初我尝试禁用/删除创建的表（1700个表），但是什么也没做。 list_procedure显示492行，并且无法中止任何行。然后，我重新启动hmaster服务，但是现在，我得到了无数以下异常：

2018-12-09 20:01:30,194 WARN  [MASTER_SERVER_OPERATIONS-master-4:16000-0] master.AssignmentManager: Failed assignment of t53889,00000000000000000007603345,1542715604227.4cc63591941dbe928663
88fbde075cac. to data-22-54,16020,1543392184445, waiting a little before trying on the same region server try=1 of 10
org.apache.hadoop.hbase.regionserver.RegionAlreadyInTransitionException: org.apache.hadoop.hbase.regionserver.RegionAlreadyInTransitionException: Received OPEN for the region:t53889,0000000
0000000000007603345,1542715604227.4cc63591941dbe92866388fbde075cac. , which we are already trying to CLOSE 
        at org.apache.hadoop.hbase.regionserver.RSRpcServices.openRegion(RSRpcServices.java:1604)
        at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:22239)
        at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2196)
        at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
        at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
        at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
        at java.lang.Thread.run(Thread.java:748)

        at sun.reflect.GeneratedConstructorAccessor10.newInstance(Unknown Source)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
        at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
        at org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:330)
        at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:772)
        at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:2164)
        at org.apache.hadoop.hbase.master.AssignmentManager$2.process(AssignmentManager.java:860)
        at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:129)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

我们如何停止此类日志！？

list_procedures的输出包含以下内容：

1530 DisableTableProcedure (table=t2151) FINISHED Fri Dec 07 11:32:45 +0330 2018 Sun Dec 09 20:07:59 +0330 2018
1532 DisableTableProcedure (table=t21514) FINISHED Fri Dec 07 11:42:53 +0330 2018 Sun Dec 09 20:07:27 +0330 2018
1534 DisableTableProcedure (table=t21518) FINISHED Fri Dec 07 11:53:02 +0330 2018 Sun Dec 09 20:07:57 +0330 2018
1535 DeleteTableProcedure (table=t13946) FINISHED Fri Dec 07 12:02:59 +0330 2018 Sun Dec 09 20:07:27 +0330 2018

我不知道是否从hdfs中删除/ hbase / MasterProcWAL是否会出现问题。

任何帮助将不胜感激。

致以最诚挚的问候。

如何中止hbase的挂起过程？

0 个答案: