ElasticSearch RestClient对ResponseHits API的响应,而不是对Response API的响应不起作用

时间:2018-06-27 06:54:44

标签: java elasticsearch elastic-stack rest-client

Am通过RestClient Java API从elasticsearch中获取文档,并尝试在ResponseHits中获取响应,以便能够使用以下代码处理多个文档(作为响应)。

SearchHit[] contentSearchHits = contentSearchResponse.getHits().getHits();

但是无法在RestClient API中设置ResponseHits响应。从Eclipse收到此消息Type mismatch: cannot convert from Response to ResponseHits

如果我使用RestHighLevelClient可以使用ResponseHits类,那么一切都会很好。但是由于BUFFER_SIZE默认情况下限制为100MB,我需要更多BUFFER_SIZE。因此没有使用它。

因此,如果它在搜索时返回多个文档,则仍然可以处理RestClient响应。

请找到我的Java代码,该代码用于从ElasticSearch提取文档。

private final static String ATTACHMENT = "document_attachment";
    private final static String TYPE = "doc";
    static long BUFFER_SIZE = 520 * 1024 * 1024;   //  <---- set buffer to 520MB instead of 100MB


    public static void main(String args[])
    {
        RestClient restClient = null;
        Response contentSearchResponse=null;
        String responseBody = null;
        JSONObject source = null;
        String path = null;
        String filename = null;
        int id = 0;
        ResponseHits responseHits = null;

        RestClientBuilder builder =  null; 

        try {

        restClient = RestClient.builder(
                        new HttpHost("localhost", 9200, "http"),
                        new HttpHost("localhost", 9201, "http")).build();

        } catch (Exception e) {
            System.out.println(e.getMessage());
        }

        SearchRequest contentSearchRequest = new SearchRequest(ATTACHMENT); 
        SearchSourceBuilder contentSearchSourceBuilder = new SearchSourceBuilder();
        contentSearchRequest.types(TYPE);
        QueryBuilder attachmentQB = QueryBuilders.matchQuery("attachment.content", "activa");
        contentSearchSourceBuilder.query(attachmentQB);
        contentSearchSourceBuilder.size(50);
        contentSearchRequest.source(contentSearchSourceBuilder);

        Map<String, String> params = Collections.emptyMap();
        HttpEntity entity = new NStringEntity(contentSearchSourceBuilder.toString(), ContentType.APPLICATION_JSON);
        HttpAsyncResponseConsumerFactory.HeapBufferedResponseConsumerFactory consumerFactory =
                new HttpAsyncResponseConsumerFactory.HeapBufferedResponseConsumerFactory((int) BUFFER_SIZE);


        try {
            //contentSearchResponse = restClient.performRequest("GET", "/document_attachment/doc/_search", params, entity, consumerFactory); //  this is working with single document, not sure how to handle if request is returning multiple documents while searching.
            responseHits  = restClient.performRequest("GET", "/document_attachment/doc/_search", params, entity, consumerFactory); // am not able to set the response to `ResponseHits` class
        } catch (IOException e1) {
            e1.printStackTrace();
        } 

        try {
            responseBody = EntityUtils.toString(contentSearchResponse.getEntity());
        } catch (ParseException e) {
            e.printStackTrace();
        } catch (IOException e) {
            e.printStackTrace();
        }

        System.out.println("Converting to JSON");
        JSONObject jsonObject = new JSONObject(responseBody);
        JSONObject  hits = jsonObject.getJSONObject("hits");
        JSONArray hitsArray=hits.getJSONArray("hits");
        for(int i=0;i<hitsArray.length();i++) {
            JSONObject obj= hitsArray.getJSONObject(i);
            source = obj.getJSONObject("_source");
            id = Integer.parseInt(source.opt("id").toString());
            path = source.optString("path");
            filename = source.optString("filename");

        }

        JSONObject jsonBody = new JSONObject();
        jsonBody.put("id", id);
        jsonBody.put("path", path);
        jsonBody.put("filename", filename);
        System.out.println("Response --->"+jsonBody.toString());

        }

Am使用ElasticSearch版本6.2.3

1 个答案:

答案 0 :(得分:0)

我已经找到了处理来自RestClient响应的多个文档的方法

             JSONArray hitsArray;
             JSONArray responseArray = new JSONArray();
             JSONObject responseObj;
             String fileRelativePath=null;

             JSONObject json = new JSONObject(responseBody);
             JSONObject hits = json.getJSONObject("hits");
             hitsArray = hits.getJSONArray("hits");
                for (int i=0; i<hitsArray.length(); i++) {
                JSONObject h = hitsArray.getJSONObject(i);
                JSONObject sourceJObj = h.getJSONObject("_source");
                        responseObj = new JSONObject();
                        fileRelativePath = sourceJObj.optString("path").toString().concat(sourceJObj.optString("filename").toString());
                        responseObj.put("id", Integer.parseInt(sourceJObj.opt("id").toString()));
                        responseObj.put("fileRelativePath", fileRelativePath);
                        responseArray.put(responseObj);

                }
                System.out.println("Response Length -->"+responseArray.length()+"Response --->"+responseArray.toString());