如何使用logstash日期过滤器插件过滤基于日期的推特的推文

时间:2016-11-12 11:17:57

标签: elasticsearch logstash logstash-configuration logstash-file

我想通过logstash的日期过滤插件来过滤Twitter的推文,这是"@timestamps": "2016-08-10T06:46:26.031Z"的字段,现在每个推文都要基于现在的日期和时间过滤,如果有人帮助我吗?

她是我的logstash配置

input {
twitter {
consumer_key => "key"
consumer_secret => "consumer key"
oauth_token => "aut"
oauth_token_secret => "oauth token"
keywords => [ "afghanistan", "TOLOnews", "kabul", "police"]
full_tweet => true
}
}

filter {
  date {
      match => ["timestamp" , "dd/MMM/yyyy:HH:mm:ss Z"]
  }
}
output {
   stdout { codec => dots }
    elasticsearch {
        hosts => "10.20.1.168"

        index => "twitter-%+YYYY.MM.DD"
        document_type => "tweets"
    }
}

但这不起作用,因为它索引Twitter的大部分Twitter

0 个答案:

没有答案