Question

我有Hive 0.13.1 HBase 0.98.8 和Hadoop 2.5.1 。我正在尝试将Hive与HBase集成。

以下步骤如下：

$ hive --auxpath /home/hduser/hive/lib/hive-hbase-handler-0.13.1.jar,/home/hduser/hive/lib/hbase-common-0.98.8-hadoop2.jar,/home/hduser/hive/lib/zookeeper-3.4.6.jar,/home/hduser/hive/lib/guava-11.0.2.jar -hiveconf hbase.master=masternode:60000
CREATE TABLE sahi23( rowkey int, x int, y string) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf:age, cf:name") TBLPROPERTIES("hbase.table.name" = "sahi23");

这个命令工作正常。我能够在Hive和HBase中创建表

INSERT OVERWRITE TABLE sahi23 SELECT * FROM hello where no=1;

但我在这里遇到问题：

Total jobs = 1
        Launching Job 1 out of 1
        Number of reduce tasks is set to 0 since there's no reduce operator
        Starting Job = job_1420005248631_0011, Tracking URL = http://example.co.in:8088/proxy/application_1420005248631_0011/
        Kill Command = /usr/local/hadoop//bin/hadoop job  -kill job_1420005248631_0011
        Hadoop job information for Stage-0: number of mappers: 1; number of reducers: 0
        2014-12-31 15:27:34,524 Stage-0 map = 0%,  reduce = 0%
        2014-12-31 15:28:09,206 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.39 sec
        2014-12-31 15:29:09,264 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.39 sec
        2014-12-31 15:30:10,185 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.39 sec
        2014-12-31 15:31:11,069 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.39 sec
        2014-12-31 15:32:11,861 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.39 sec
        2014-12-31 15:33:12,628 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.39 sec
        2014-12-31 15:34:13,396 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.39 sec
        2014-12-31 15:35:14,126 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.39 sec
        2014-12-31 15:36:14,837 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.39 sec
        2014-12-31 15:37:15,546 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.39 sec
        2014-12-31 15:38:16,216 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.39 sec
        2014-12-31 15:38:33,714 Stage-0 map = 0%,  reduce = 0%
        2014-12-31 15:38:44,972 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.27 sec
        2014-12-31 15:39:45,855 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.27 sec
        2014-12-31 15:40:46,532 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.27 sec
        2014-12-31 15:41:47,245 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.27 sec
        2014-12-31 15:42:47,906 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.27 sec
        2014-12-31 15:43:48,561 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.27 sec
        2014-12-31 15:44:49,370 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.27 sec
        2014-12-31 15:45:50,130 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.27 sec
        2014-12-31 15:46:50,763 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.27 sec
        2014-12-31 15:47:51,521 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.27 sec
        2014-12-31 15:48:52,101 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.27 sec
        2014-12-31 15:49:04,438 Stage-0 map = 0%,  reduce = 0%
        2014-12-31 15:49:15,702 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.3 sec
        2014-12-31 15:50:16,321 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.3 sec
        2014-12-31 15:51:16,897 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.3 sec
        2014-12-31 15:52:17,468 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.3 sec
        2014-12-31 15:53:18,077 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.3 sec
        2014-12-31 15:54:18,808 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.3 sec
        2014-12-31 15:55:19,430 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.3 sec
        2014-12-31 15:56:20,011 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.3 sec
        2014-12-31 15:57:20,623 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.3 sec
        2014-12-31 15:58:21,173 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.3 sec
        2014-12-31 15:59:21,761 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.3 sec
        2014-12-31 15:59:34,084 Stage-0 map = 0%,  reduce = 0%
        2014-12-31 16:00:00,733 Stage-0 map = 100%,  reduce = 0%, Cumulative CPU 1.35 sec

        MapReduce Total cumulative CPU time: 1 seconds 350 msec
        Ended Job = job_1420005248631_0011 with errors
        Error during job, obtaining debugging information...
        Examining task ID: task_1420005248631_0011_m_000000 (and more) from job job_1420005248631_0011

        Task with the most failures(4):
        -----
        Task ID:
          task_1420005248631_0011_m_000000

        URL:
          http://masternode:8088/taskdetails.jsp?jobid=job_1420005248631_0011&tipid=task_1420005248631_0011_m_000000
        -----
        Diagnostic Messages for this Task:
        AttemptID:attempt_1420005248631_0011_m_000000_3 Timed out after 600 secs

        FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
        MapReduce Jobs Launched:
        Job 0: Map: 1   Cumulative CPU: 1.35 sec   HDFS Read: 0 HDFS Write: 0 FAIL
        Total MapReduce CPU Time Spent: 1 seconds 350 msec

面对Hive-HBase集成的问题

0 个答案: