Question

我使用Flume索引文本文档，我没有看到任何错误或警告消息，但是Solr和Flume的数据没有被摄取到Solr Log级别设置为TRACE，ALL

Flume version : 1.5.2.2.3
Solr Version : 5.5

**Config files are as below**

   **Flume Config :**

agent.sources = SpoolDirSrc
agent.channels = FileChannel
agent.sinks = SolrSink

# Configure Source
agent.sources.SpoolDirSrc.channels = fileChannel agent.sources.SpoolDirSrc.type = spooldir

agent.sources.SpoolDirSrc.spoolDir = / home / flume / source_emails agent.sources.SpoolDirSrc.basenameHeader = true agent.sources.SpoolDirSrc.fileHeader = true agent.sources.SpoolDirSrc.deserializer = org.apache.flume.sink.solr.morphline.BlobDeserializer $ Builder agent.channels.FileChannel.type = file agent.channels.FileChannel.capacity = 10000 agent.sinks.SolrSink.type = org.apache.flume.sink.solr.morphline.MorphlineSolrSink agent.sinks.SolrSink.morphlineFile = /etc/flume/conf/morphline.conf agent.sinks.SolrSink.batchsize = 1000 agent.sinks.SolrSink.batchDurationMillis = 2500 agent.sinks.SolrSink.channel = fileChannel agent.sinks.SolrSink .morphlineId = morphline1 agent.sources.SpoolDirSrc.channels = FileChannel agent.sinks.SolrSink.channel = FileChannel

＆＃34;
Morphline配置

solrLocator: {
collection : gsearch

zkHost : "codesolr-as-r3p:21810,codesolr-as-r3p:21811,codesolr-as-r3p:21812"
}
morphlines :
[
  {
    id : morphline1
    importCommands : ["org.kitesdk.**", "org.apache.solr.**"]
    commands :
    [
      { detectMimeType { includeDefaultMimeTypes : true } }
      {
        solrCell {
          solrLocator : ${solrLocator}
          captureAttr : true
          lowernames : true
          capture : [_attachment_body, _attachment_mimetype, basename, content, content_encoding, content_type, file, meta]
          parsers : [ { parser : org.apache.tika.parser.txt.TXTParser } ]
         }
      }
      { generateUUID { field : id } }
      { sanitizeUnknownSolrFields { solrLocator : ${solrLocator} } }
      { logDebug { format : "output record: {}", args : ["@{}"] } }
      { loadSolr: { solrLocator : ${solrLocator} } }
    ]
  }
]

Please help me what could be the issue
Regards,
~Sri

Answer 1

通常情况下，你可以看到更详细的错误信息，你可以粘贴跟踪吗？

可能是吗啉没有找到你的solr配置，你可以在你的morphilines.conf中添加这个属性

solrHomeDir：“/ your_solr_config_files”

我希望这是你的帮助

Flume solrSink，没有错误，但没有将数据摄取到Solr

1 个答案: