如何使用W3C_LOG_PARSE分析kinesis代理发送的日志?

时间:2019-11-16 16:49:17

标签: amazon-web-services amazon-kinesis

我使用kinesis代理通过简单的配置将Apache Log发送到kinesis数据流。

{ 
  "kinesis.endpoint": "kinesis.us-east-1.amazonaws.com", 
  ... 
  "flows": [ { 
    "filePattern": "/var/log/httpd/access_log*",
    "kinesisStream": "kinesis-stream-test", 
    "partitionKeyOption": "RANDOM" 
  } ] 
}

因此,如果我想使用W3C_LOG_PARSE函数来解析日志数据,我怎么能知道像character-expression这样的log参数呢?

CREATE OR REPLACE PUMP "INTERMEDIATE_STREAM_PUMP" AS INSERT INTO "INTERMEDIATE_STREAM" SELECT STREAM l.r.COLUMN1, l.r.COLUMN2, l.r.COLUMN3, l.r.COLUMN4, l.r.COLUMN5, l.r.COLUMN6, l.r.COLUMN7 FROM (SELECT STREAM W3C_LOG_PARSE("log", 'COMMON') FROM "SOURCE_SQL_STREAM_001" ) AS l(r);

谢谢。

0 个答案:

没有答案