Question

我准备了使用hive jdbc客户端调用Hadoop DB的java应用程序。当我尝试做“从学生中选择*”这样的简单查询时，它的工作正常。但是，只要我添加一些条件语句（例如，年龄> 10），它就会开始响应异常，如下所示：

Caused by: java.sql.SQLException: Query returned non-zero code: 2, cause: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
    at org.apache.hadoop.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:194)
    at org.springframework.jdbc.core.JdbcTemplate$1QueryStatementCallback.doInStatement(JdbcTemplate.java:441)
    at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:396)
    ... 29 more

我唯一可能的原因是我在google中发现它丢失了库。但对我而言，我需要额外的lib来进行更复杂的查询，这看起来很奇怪。

以防这里是build.gradle的依赖列表

compile "org.springframework:spring-core:"+spring_version
compile "org.springframework:spring-beans:"+spring_version
compile "org.springframework:spring-context:"+spring_version
compile "org.springframework:spring-jdbc:"+spring_version

compile "commons-io:commons-io:2.1"

compile 'org.apache.hadoop:hadoop-core:1.0.0'

compile 'org.apache.hive:hive-jdbc:0.13.0'
compile 'org.apache.hive:hive-exec:0.13.0'
compile 'org.apache.hive:hive-service:0.13.0'
compile 'org.apache.hive:hive-metastore:0.13.0'

compile 'org.apache.thrift:libfb303:0.9.2'
compile 'org.apache.thrift:libthrift:0.9.2'

compile 'log4j:log4j:1.2.15'
compile 'org.antlr:antlr-runtime:3.5'
compile 'org.apache.derby:derby:10.10.1.1'
compile 'javax.jdo:jdo2-api:2.3-eb'
compile 'jpox:jpox:1.1.9'
compile 'jpox:jpox:1.1.9'

和jdbc模板的spring配置

<?xml version="1.0" encoding="UTF-8"?>
<beans xmlns="http://www.springframework.org/schema/beans"
       xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:c="http://www.springframework.org/schema/c"
       xmlns:context="http://www.springframework.org/schema/context"
       xsi:schemaLocation="http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans-3.2.xsd
        http://www.springframework.org/schema/context http://www.springframework.org/schema/context/spring-context-3.2.xsd">

    <bean class="org.springframework.beans.factory.config.PropertyPlaceholderConfigurer">
        <property name="location">
            <value>classpath:spring/application.properties</value>
        </property>
    </bean>

    <context:component-scan base-package="com.sample" />

    <!-- basic Hive driver bean -->
    <bean id="hive-driver" class="org.apache.hadoop.hive.jdbc.HiveDriver" />

    <bean id="hiveSource"
          class="org.springframework.jdbc.datasource.SimpleDriverDataSource"
          c:driver-ref="hive-driver" c:url="${hadoop.jdbc.driver.path}"
          c:username="${hadoop.login}" c:password="${hadoop.password}" />

    <bean id="jdbcTemplate" class="org.springframework.jdbc.core.JdbcTemplate"
          c:data-source-ref="hiveSource" />

    <bean id="hiveDao" class="com.sample.dao.HiveDao">
        <property name="jdbcTemplate" ref="jdbcTemplate" />
    </bean>


    <bean id="hiveClient" class=" com.sample.client.HiveClient">
        <property name="hiveDao" ref="hiveDao" />
    </bean>

</beans>

请告知或分享工作实例。

最诚挚的问候，亚历

Answer 1

使用， <bean id="hive-driver" class="org.apache.hive.jdbc.HiveDriver" /＆gt;而不是<bean id="hive-driver" class="org.apache.hadoop.hive.jdbc.HiveDriver" />

Hive jdbc驱动程序响应非描述性消息

1 个答案: