时间戳记以字符串形式爬行

时间:2019-04-29 11:11:27

标签: amazon-web-services amazon-ec2 serverless-framework aws-glue aws-glue-data-catalog

我抓取了.csv文件和抓取器创建表,但创建为字符串而不是时间戳记的时间列是我的Yaml

  AWSGlueTimeSeriesCsvCrawler2:
      Type: AWS::Glue::Crawler
      Properties:
        Name: ggCrawler
        Role: !GetAtt AWSGlueServiceRole.Arn
        Classifiers:
          - !Ref GlueRawClicksClassifier
        DatabaseName: !Ref AWSGlueFileDatalakeDatabase
        TablePrefix: "${{file(./src/config/config.yml):CsvCrawlerTablePrefix}}"
        Targets:
          S3Targets:
            - Path: "s3://${{file(./src/config/config.yml):CrawledBucketName}}/time_series"
        SchemaChangePolicy:
          UpdateBehavior: "UPDATE_IN_DATABASE"
          DeleteBehavior: "DEPRECATE_IN_DATABASE"

    GlueRawClicksClassifier:
      Type: "AWS::Glue::Classifier"
      Properties:
        GrokClassifier:
          Name: gg
          Classification: csv
          GrokPattern: "%{x:timestamp:timestamp}"
          CustomPatterns: "x %{DATE_US}[T ]%{HOUR}:?%{MINUTE}"

0 个答案:

没有答案