ElasticSearch:inner_hits和hightlight_query

时间:2015-12-11 10:50:57

标签: elasticsearch elasticsearch-2.0

简短版:是否有可能获得highlight_query提供的功能,以突出显示inner_hits结果?

长版: 请考虑以下映射:

{
  "settings": {
    "number_of_replicas": 0,
    "number_of_shards": 1
  },
  "mappings": {
    "docs": {
      "properties": {
        "doctext": {
          "type": "string",
          "store": "yes"
        },
        "sentences": {
          "type": "nested",
          "properties": {
            "text": {
              "type": "string",
              "store": "yes"
            }
          }
        }
      }
    }
  }
}

如您所见,有doctextsentences字段。这个想法是将文档文本分成句子以允许基于句子的搜索。

这是一个示例文档:

{
  "doctext": "I will do a presentation. I talk about lions and show images of zebras. I hope it will be fun.",
  "sentences": [
    {
      "text": "I will do a presentation."
    },
    {
      "text": "I talk about lions and show images of zebras."
    },
    {
      "text": "I hope it will be fun."
    }
  ]
}

现在我可以搜索整个文本以及单个句子,我甚至可以突出显示两者:

{
  "query": {
    "bool": {
      "should": [
        {
          "match": {
            "doctext": "zebras"
          }
        },
        {
          "nested": {
            "path": "sentences",
            "query": {
              "match": {
                "sentences.text": "zebras"
              }
            },
            "inner_hits": {
              "highlight": {
                "fields": {
                  "sentences.text": {}
                }
              }
            }
          }
        }
      ]
    }
  },
  "_source": false,
  "highlight": {
    "fields": {
      "doctext": {
        "highlight_query": {
          "match": {
            "doctext": "lions"
          }
        }
      }
    }
  }
}

请注意以下事项:

  1. nested
  2. 上的sentences查询
  3. 该查询的inner_hits部分
  4. second <{em> highlight_query的{​​{1}}部分,而不是highlight
  5. 中的部分

    发出此查询将导致此响应:

    inner_hits

    请注意,虽然我们搜索了 zebras ,但"hits": [ { "_index": "documents", "_type": "docs", "_id": "123456", "_score": 0.6360315, "highlight": { "doctext": [ "I will do a presentation. I talk about <em>lions</em> and show images of zebras. I hope it will be fun." ] }, "inner_hits": { "sentences": { "hits": { "total": 1, "max_score": 0.5291085, "hits": [ { "_index": "documents", "_type": "docs", "_id": "123456", "_nested": { "field": "sentences", "offset": 1 }, "_score": 0.5291085, "_source": { "text": "I talk about lions and show images of zebras." }, "highlight": { "sentences.text": [ "I talk about lions and show images of <em>zebras</em>." ] } } ] } } } } ] 字段如何突出显示狮子会doctext会突出显示这些内容,因为我们没有指定其他内容。但我希望内部点击突出显示 lions ,就像inner_hits突出显示一样。

    我尝试将查询的doctext部分更改为

    inner_hits

    但这会导致以下异常:

     "inner_hits": {
              "highlight": {
                "fields": {
                  "text": {
                    "highlight_query": {
                      "match": {
                        "sentences.text": "lions"
                      }
                    }
                  }
                }
              }
            }
    

    有没有办法让这项工作?我在这个上错了DSL吗? Failed to execute phase [query_fetch], all shards failed; shardFailures {[9-pMHRPsRiyITgsRNFnkEA][documents][0]: RemoteTransportException[[Fafnir][127.0.0.1:9300][indices:data/read/search[phase/query+fetch]]]; nested: SearchParseException[failed to parse search source [{ "query": { "bool": { "should": [ { "match": { "doctext": "fun" } }, { "nested": { "path": "sentences", "query": { "match": { "sentences.text": "zebras" } }, "inner_hits": { "highlight": { "fields": { "sentences.text": { "highlight_query": { "match": { "doctext": "lions" } } } } } } } } ] } }, "_source": false, "highlight": { "fields": { "doctext": { "highlight_query": { "match": { "doctext": "lions" } } } } } }]]; nested: NullPointerException; } at org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.onFirstPhaseResult( TransportSearchTypeAction.java:228) at org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction$1.onFailure( TransportSearchTypeAction. java:174) at org.elasticsearch.action.ActionListenerResponseHandler.handleException(ActionListenerResponseHandler.java:46) at org.elasticsearch.transport.TransportService$DirectResponseChannel.processException(TransportService.java:821) at org.elasticsearch.transport.TransportService$DirectResponseChannel.sendResponse(TransportService.java:799) at org.elasticsearch.transport.TransportService$4.onFailure(TransportService.java:361) at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: ; nested: NullPointerException; at org.elasticsearch.ElasticsearchException.guessRootCauses(ElasticsearchException.java:382) at org.elasticsearch.action.search.SearchPhaseExecutionException.guessRootCauses(SearchPhaseExecutionException. java:152) at org.elasticsearch.action.search.SearchPhaseExecutionException.getCause(SearchPhaseExecutionException.java:99) at java.lang.Throwable.printStackTrace(Throwable.java:665) at java.lang.Throwable.printStackTrace(Throwable.java:721) at org.apache.log4j.DefaultThrowableRenderer.render(DefaultThrowableRenderer.java:60) at org.apache.log4j.spi.ThrowableInformation.getThrowableStrRep(ThrowableInformation.java:87) at org.apache.log4j.spi.LoggingEvent.getThrowableStrRep(LoggingEvent.java:413) at org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:313) at org.apache.log4j.WriterAppender.append(WriterAppender.java:162) at org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251) at org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:66) at org.apache.log4j.Category.callAppenders(Category.java:206) at org.apache.log4j.Category.forcedLog(Category.java:391) at org.apache.log4j.Category.log(Category.java:856) at org.elasticsearch.common.logging.log4j.Log4jESLogger.internalInfo(Log4jESLogger.java:125) at org.elasticsearch.common.logging.support.AbstractESLogger.info(AbstractESLogger.java:90) at org.elasticsearch.rest.BytesRestResponse.convert(BytesRestResponse.java:131) at org.elasticsearch.rest.BytesRestResponse.<init>(BytesRestResponse.java:96) at org.elasticsearch.rest.BytesRestResponse.<init>(BytesRestResponse.java:87) at org.elasticsearch.rest.action.support.RestActionListener.onFailure(RestActionListener.java:60) at org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.raiseEarlyFailure( TransportSearchTypeAction.java:316) ... 10 more Caused by: java.lang.NullPointerException at org.elasticsearch.index.query.QueryParseContext.parseInnerQuery(QueryParseContext.java:258) at org.elasticsearch.index.query.BoolQueryParser.parse(BoolQueryParser.java:116) at org.elasticsearch.index.query.QueryParseContext.parseInnerQuery(QueryParseContext.java:257) at org.elasticsearch.index.query.IndexQueryParserService.innerParse(IndexQueryParserService.java:303) at org.elasticsearch.index.query.IndexQueryParserService.parse(IndexQueryParserService.java:206) at org.elasticsearch.index.query.IndexQueryParserService.parse(IndexQueryParserService.java:201) at org.elasticsearch.search.query.QueryParseElement.parse(QueryParseElement.java:33) at org.elasticsearch.search.SearchService.parseSource(SearchService.java:831) at org.elasticsearch.search.SearchService.createContext(SearchService.java:651) at org.elasticsearch.search.SearchService.createAndPutContext(SearchService.java:617) at org.elasticsearch.search.SearchService.executeFetchPhase(SearchService.java:460) at org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryFetchTransportHandler.messageReceived( SearchServiceTransportAction.java:392) at org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryFetchTransportHandler.messageReceived( SearchServiceTransportAction.java:389) at org.elasticsearch.transport.TransportService$4.doRun(TransportService.java:350) at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ... 3 more 上的文档仅指出突出显示可行(https://www.elastic.co/guide/en/elasticsearch/reference/2.1/search-request-inner-hits.html),但不会涉及任何细节。

    非常感谢阅读和任何提示!

1 个答案:

答案 0 :(得分:7)

一个好的问题看起来像查询上下文中的内部命中不支持突出显示查询。不确定为什么这很可能是一个错误。

解决方法是将突出显示的嵌套查询包装在最终突出显示中 查询。但是,它需要原始的嵌套查询作为过滤器: OP中突出显示的示例解决方法如下所示:

put test/docs/1
{
  "doctext": "I will do a presentation. I talk about lions and show images of zebras. I hope it will be fun.",
  "sentences": [
    {
      "text": "I will do a presentation."
    },
    {
      "text": "I talk about lions and show images of zebras."
    },
    {
      "text": "I hope it will be fun for lions"
    }
  ]
}


post test/_search
{
   "query": {
      "bool": {
         "should": [
            {
               "match": {
                  "doctext": "zebras"
               }
            },
            {
               "nested": {
                  "path": "sentences",
                  "query": {
                     "match": {
                        "sentences.text": "zebras"
                     }
                  },
                  "inner_hits": {
                     "highlight": {
                        "fields": {
                           "sentences.text": {}
                        }
                     }
                  }
               }
            }
         ]
      }
   },
   "_source": false,
   "highlight": {
      "fields": {
         "*": {
            "highlight_query": {
               "bool": {
                  "should": [
                     {
                        "match": {
                           "doctext": "lions"
                        }
                     },
                     {
                        "nested": {
                           "path": "sentences",
                           "query": {
                              "filtered": {
                                 "query": {
                                    "match": {
                                       "sentences.text": "lions"
                                    }
                                 },
                                 "filter": {
                                    "query": {
                                       "match": {
                                          "sentences.text": "zebras"
                                       }
                                    }
                                 }
                              }
                           },
                           "inner_hits": {
                              "highlight": {
                                 "fields": {
                                    "sentences.text": {}
                                 }
                              }
                           }
                        }
                     }
                  ]
               }
            }
         }
      }
   }
}

结果:

{
   "took": 1,
   "timed_out": false,
   "_shards": {
      "total": 1,
      "successful": 1,
      "failed": 0
   },
   "hits": {
      "total": 1,
      "max_score": 0.6360315,
      "hits": [
         {
            "_index": "test",
            "_type": "docs",
            "_id": "1",
            "_score": 0.6360315,
            "highlight": {
               "doctext": [
                  "I will do a presentation. I talk about <em>lions</em> and show images of zebras. I hope it will be fun."
               ]
            },
            "inner_hits": {
               "sentences": {
                  "hits": {
                     "total": 1,
                     "max_score": 0.40240064,
                     "hits": [
                        {
                           "_index": "test",
                           "_type": "docs",
                           "_id": "1",
                           "_nested": {
                              "field": "sentences",
                              "offset": 1
                           },
                           "_score": 0.40240064,
                           "_source": {
                              "text": "I talk about lions and show images of zebras."
                           },
                           "highlight": {
                              "sentences.text": [
                                 "I talk about <em>lions</em> and show images of zebras."
                              ]
                           }
                        }
                     ]
                  }
               }
            }
         }
      ]
   }
}