我正在尝试为混合日志创建一个grok模式。这是我第一次创建条件链,并且我不断收到语法错误:
opt/logstash/bin/logstash -f /opt/logstash/conf.d/sip-parser.conf -- configtest
Error: Expected one of #, in, not , ==, !=, <=, >=, <, >, =~, !~, and, or, xor, nand, { at line 27, column 14 (byte 580) after filter {
# separate soap calls from responses
grok {
match => { "message" => "\[%{TIMESTAMP_ISO8601:logdate} \] %{LOGLEVEL:level} %{GREEDYDATA:type}"}
}
if [type]
我的配置文件:
input {
file{
path => "/home/steven/sip.log"
start_position => beginning
# logstash stores the lastrun=> so we trick it
sincedb_path => "/dev/null"
#if logentry does not start with date it's part of previous entry
codec => multiline {
pattern => "\[^%{TIMESTAMP_ISO8601:logdate}\]"
negate => "true"
what => "previous"
}
}
}
filter {
grok {
match => { "message" => "\[%{TIMESTAMP_ISO8601:logdate} \] %{LOGLEVEL:level} %{GREEDYDATA:type}"}
}
# separate soap calls from responses
if ([type] ~= /AbstractLoggingInterceptor:\ Inbound Message$/) {
grok {
match => { "message" => "\[%{TIMESTAMP_ISO8601:logdate} \] %{LOGLEVEL:level} %{GREEDYDATA:type}\n----------------------------\n%{GREEDYDATA:id}\n%{GREEDYDATA:responsecode}\n%{GREEDYDATA:encoding}\n%{GREEDYDATA:contenttype}\n%{GREEDYDATA:headers}\n%{GREEDYDATA:payload}\n--------------------------------------"}
}
}
else if ([type] ~= /AbstractLoggingInterceptor:\ Outbound Message$/) {
grok {
match => {"message" => "\[%{TIMESTAMP_ISO8601:logdate} \] %{LOGLEVEL:level} %{GREEDYDATA:type}\n---------------------------\n%{GREEDYDATA:id}\n%{GREEDYDATA:responsecode}\n%{GREEDYDATA:encoding}\n%{GREEDYDATA:contenttype}\n%{GREEDYDATA:headers}\n%{GREEDYDATA:payload}\n--------------------------------------"}
}
}
else {
grok {
match => {"message" => "\[%{TIMESTAMP_ISO8601:logdate} \] %{LOGLEVEL:level} %{GREEDYDATA:type}"}
}
}
}
output {
#elasticsearch {}
stdout{}
}
我正在尝试解析的日志文件可以在这里找到:http://pastebin.com/afbNfmjW 每个不同类型条目的各个grok模式已在http://grokdebug.herokuapp.com/中进行了测试,但我无法将它们链接在一起。我做错了什么?
答案 0 :(得分:2)
你的条件grok {}不应该在第一个grok中,而是与之对应:
grok { ... }
if [myField] == "value" {
grok { ... }
}
另请注意,您正在运行正则表达式以查看是否应运行正则表达式。我建议将多个模式发送到一个grok节:
grok {
match => { "myField",
pattern1,
pattern2,
pattern3
}
}
默认情况下,当匹配时,grok将停止处理它们。