Logstash逐行输入

时间:2017-10-19 08:38:56

标签: logstash logstash-file

如何使用编解码器逐行读取logstash中的文件? 当我尝试以下配置但它不起作用时:

file {
path => "C:/DEV/Projects/data/*.csv"
start_position => "beginning"
codec => line {
     format => "%{[data]}"
}

1 个答案:

答案 0 :(得分:0)

输出中带弹性搜索的配置示例:

input{
    file {
        path => "C:/DEV/Projects/data/*.csv"
        start_position => beginning
    }

}

filter {

csv {

    columns => [
        "COLUMN_1",
        "COLUMN_2",
        "COLUMN_3",
         .
         .
        "COLUMN_N"
    ]
    separator => ","
}

mutate {
        convert => { 
            "COLUMN_1" => "float" 
            "COLUMN_4" => "float" 
            "COLUMN_6" => "float" 
        }
}
}

output {
elasticsearch {

    hosts => ["localhost:9200"]
    action => "index"
    index => "test_index"
}

对于过滤器: https://www.elastic.co/guide/en/logstash/current/plugins-filters-csv.html