logstash mutate替换输出

时间:2016-09-25 13:21:50

标签: logstash logstash-grok logstash-configuration logstash-forwarder

我正在尝试用我的logstash配置中的另一个IP 10.100.240.199替换10.100.251.98,我尝试使用带有mutate功能的过滤器,但是,我无法获得语法wrtie

Sep 25 15:50:57 10.100.251.98 mail_logs: Info: New SMTP DCID 13417989 interface 172.30.75.10 address 172.30.75.12 port 25
Sep 25 15:50:57 10.100.251.98 local_mail_logs: Info: New SMTP DCID 13417989 interface 172.30.75.10 address 172.30.75.12 port 25
Sep 25 15:51:04 10.100.251.98 cli_logs: Info: PID 35559: User smaduser login from 10.217.3.22 on 172.30.75.10
Sep 25 15:51:22 10.100.251.98 cli_logs: Info: PID 35596: User smaduser login from 10.217.3.22 on 172.30.75.10

这是我的代码:

input { file { path => "/data/collected" } }

filter {
    if [type] == "syslog" {
        mutate {
        replace => [ "@source_host", "10.100.251.99" ]
      }
    }
}

output {

    syslog {
        facility => "kernel"
        host => "10.100.250.199"
        port => 514
   }
}

1 个答案:

答案 0 :(得分:2)

我注意到有关配置的一些事情。首先,您没有任何日志解析。如果字段尚不存在,您将无法替换该字段。为此,您可以在输入块中使用codecgrok filter。我添加了一个简单的grok过滤器。

您还要检查if [type] == "syslog"。您永远不会设置类型,因此检查将始终失败。如果要设置类型,可以在输入块input { file { path => "/data/collected" type => "syslog} }

中执行此操作

以下是我用于测试grok模式和替换IP的示例配置。

input { tcp { port => 5544 } }

filter {
    grok { match => { "message" =>  "%{CISCOTIMESTAMP:log_time} %{IP:@source_host} %{DATA:log_type}: %{DATA:log_level}: %{GREEDYDATA:log_message}" } }
    mutate {
      replace => [ "@source_host", "10.100.251.199" ]
    }
}

output {
   stdout { codec => rubydebug }
}

输出:

{
         "message" => "Sep 25 15:50:57 10.100.251.98 mail_logs: Info: New SMTP DCID 13417989 interface 172.30.75.10 address 172.30.75.12 port 25",
        "@version" => "1",
      "@timestamp" => "2016-09-25T14:03:20.332Z",
            "host" => "0:0:0:0:0:0:0:1",
            "port" => 52175,
        "log_time" => "Sep 25 15:50:57",
    "@source_host" => "10.100.251.199",
        "log_type" => "mail_logs",
       "log_level" => "Info",
     "log_message" => "New SMTP DCID 13417989 interface 172.30.75.10 address 172.30.75.12 port 25"
}