我需要使用Regex在S3输入中获取前缀,但文档中不支持Regex。
文件夹列表如下:
logs/20180304/app1/app1.log
logs/23180304/app2/app2.log
logs/20180305/app1/app1.log
logs/23180305/app2/app2.log
logs/20180306/app1/app1.log
logs/23180306/app2/app2.log
我在Logstash中的输入插件
s3
{
access_key_id => "ABDCWERJKPOKJVB"
secret_access_key => "4356ytghnfvgbh09oiujsedfvgh0piod"
region => "as-sfg-2"
bucket => "new-logs"
prefix => "log/*/app1/app1.log
}
s3
{
access_key_id => "ABDCWERJKPOKJVB"
secret_access_key => "4356ytghnfvgbh09oiujsedfvgh0piod"
region => "as-sfg-2"
bucket => "new-logs"
prefix => "log/*/app1/app2.log
}
我尝试了上面的前缀,但是logstash没有从这些前缀中获取日志