Apache Drill通过Java连接

时间:2015-04-04 07:03:19

标签: apache hadoop apache-drill

在整个Apache Drill的Wiki中,我只能看到通过SqlLine客户端运行的查询。除了REST API之外,是否有任何编程方式在Drill中运行查询?任何样品或指针?

或者它是否与使用JDBC驱动程序运行SQL查询等效?

4 个答案:

答案 0 :(得分:2)

您可以使用Drill JDBC驱动程序,该驱动程序在此处记录:http://drill.apache.org/docs/using-the-jdbc-driver/

请注意,如果您使用Maven构建Java程序,则需要在本地安装Drill依赖项:

mvn install:install-file -Dfile=/opt/apache-drill-1.0.0/jars/drill-java-exec-1.0.0-rebuffed.jar -DgroupId=org.apache.drill.exec -DartifactId=drill-java-exec -Dversion=1.0.0 -Dpackaging=jar -DgeneratePom=true
mvn install:install-file -Dfile=/opt/apache-drill-1.0.0/jars/drill-common-1.0.0-rebuffed.jar -DgroupId=org.apache.drill -DartifactId=drill-common -Dversion=1.0.0 -Dpackaging=jar -DgeneratePom=true

以下是一个例子:https://github.com/vicenteg/DrillJDBCExample

答案 1 :(得分:2)

对于JDBC部分,我在我的Java代码中使用了类似的东西 -

-------------
Dependency
-------------
    <dependency>
      <groupId>org.apache.drill.exec</groupId>
      <artifactId>drill-jdbc</artifactId>
      <version>1.1.0</version>
    </dependency>

----------
Testcase
----------
import java.sql.Connection;
import java.sql.ResultSet;
import java.sql.Statement;
import java.util.Properties;

import org.apache.drill.exec.ExecConstants;
import org.apache.drill.jdbc.Driver;

import org.testng.Assert;
import org.testng.annotations.Test;

public class TestDrillJdbcDriver {

  /* Drill JDBC Uri for local/cluster zookeeper */
  public static final String DRILL_JDBC_LOCAL_URI = "jdbc:drill:zk=local";

  /* Sample query used by Drill */
  public static final String DRILL_SAMPLE_QUERY = "SELECT * FROM cp.`employee.json` LIMIT 20";


  @Test
  public void testDrillJdbcDriver() throws Exception {
    Connection con = null;

    try {
      con = new Driver().connect(DRILL_JDBC_LOCAL_URI, getDefaultProperties());
      Statement stmt = con.createStatement();
      ResultSet rs = stmt.executeQuery(DRILL_SAMPLE_QUERY);

      int count = 0;
      while (rs.next()) {
        System.out.println(rs.getString(1));
        System.out.println(rs.getString(2));
        System.out.println(rs.getString(3));
        count++;
      }
      Assert.assertEquals(count, 20, "Twenty rows were expected.");
    } catch (Exception ex) {
      System.out.println(ex);
    } finally {
      if (con != null) {
        con.close();
      }
    }
  }

  public static Properties getDefaultProperties() {
    final Properties properties = new Properties();
    properties.setProperty(ExecConstants.HTTP_ENABLE, "false");
    return properties;
  }
}

答案 2 :(得分:1)

除了sqlline,您可以使用

  1. 钻取Web UI以运行查询。本地默认端口为8047 (嵌入式)安装。
  2. 或者下载并配置MapR ODBC 驱动程序,它会来自Drill Explorer(另一个UI) 用过的。 https://drill.apache.org/docs/installing-the-driver-on-windows/
  3. 或配置任何其他适用于ODBC的工具(我已配置 使用MapR ODBC驱动程序钻取的Teradata SQL助手)
  4. JDBC集成 - 使用可以运行的SQuirrel或DBVisualizer 查询。 https://drill.apache.org/docs/using-jdbc-with-squirrel-on-windows/
  5. 以编程方式通过JDBC。 (使用 drill-jdbc-all-1.0.0jar和org.apache.drill.jdbc.Driver类)

答案 3 :(得分:-2)

Other way to execute query by Calling REST API in Apache Drill

公共类RequestQuery {

private String queryType;
private String query;

public String getQueryType() {
    return queryType;
}
public void setQueryType(String queryType) {
    this.queryType = queryType;
}
public String getQuery() {
    return query;
}
public void setQuery(String query) {
    this.query = query;
}

}

import javax.ws.rs.client.Client;
import javax.ws.rs.client.ClientBuilder;
import javax.ws.rs.client.Entity;
import javax.ws.rs.client.WebTarget;
import javax.ws.rs.core.MediaType;
import javax.ws.rs.core.Response;

import org.apache.commons.logging.Log;
import org.apache.commons.logging.LogFactory;
import org.ramyam.eis.apache.drill.api.model.RequestQuery;

public class RestAPI {

    private static Log logger = LogFactory.getLog(RestAPI.class);
    public static void main(String[] args) {
        getQueryResponce();
    }

    private static void getQueryResponce(){
        Client client = null;
        WebTarget target = null;
        try {
            logger.info("---------Started execution-----------");
            RequestQuery query = new RequestQuery();
            query.setQueryType("SQL");
            //MySQL
            //query.setQuery("SELECT * FROM MYSQL.foodmart.collections");
            //query.setQuery("SELECT * FROM MYSQL.foodmart.collections limit 100");
            //query.setQuery("SELECT payment_due_from,NumItems FROM MYSQL.foodmart.collections limit 10");
            //query.setQuery("SELECT count(SPORTS_PREFERENCE) FROM MYSQL.foodmart.collections group by SPORTS_PREFERENCE");
            //query.setQuery("SELECT DISTINCT payment_due_from FROM MYSQL.foodmart.collections ");

            //Mongo DB
            //query.setQuery("select * from mongo.apache_drill.pt_BMS_preferences_data where SPORTS_PREFERENCE = 'Cricket' limit 10");
            //query.setQuery("SELECT COUNT(SPORTS_PREFERENCE) FROM mongo.apache_drill.pt_BMS_preferences_data GROUP BY SPORTS_PREFERENCE");
            query.setQuery("SELECT DISTINCT(SPORTS_PREFERENCE) FROM mongo.apache_drill.pt_BMS_preferences_data ");
            client = ClientBuilder.newClient();
            target = client.target("http://localhost:8047/query.json");
            //target = target.path(path);
            Response response = target.request().accept(MediaType.APPLICATION_JSON)
                    .post(Entity.json(query), Response.class);
            if (response.getStatus() != 200) {
                throw new RuntimeException("Failed : HTTP error code : " + response.getStatus());
            }
            String string = response.readEntity(String.class);
            logger.info(query.getQueryType()+"->"+query.getQuery());
            logger.info("Responce:\n"+string);
            logger.info("---------End execution-----------");
        } catch (Exception e) {
            e.printStackTrace();
            logger.error(e.getMessage(),e);
        }
    }