Question

我正在尝试在logstash中加载CSV文件但它没有读取文件而没有在elasticsearch中创建索引我需要在elasticsearch中读取CSV文件。在配置文件中尝试了一些更改。

我的配置文件

input {
    file {
        type => "csv"
        path => "/root/installables/*.csv"
        start_position => beginning
    }
}

filter {
    grok {
        match => { "message" => "%{COMBINEDAPACHELOG}" }
    }
}

output {
    elasticsearch {
        hosts => localhost
        index => "client"
    }
}

有人可以告诉我们如何在logstash中加载CSV文件吗？

Answer 1

我认为你应该放一个“csv”过滤器。我让它像这样工作：

input {
  file {
    path => "/filepath..."
    start_position => beginning
    # to read from the beginning of file
    sincedb_path => "/dev/null"
  }
}

filter {
    csv {
        columns => ["COL1", "COL2"]
    }
}

output {
    stdout { codec => rubydebug }
    elasticsearch {
        host => "localhost"
        index => "csv_index"
    }
}

此外，添加stdout作为输出可帮助您调试并知道文件是否正在加载

如何在logstash中加载CSV文件

1 个答案: