Apache Beam JmsIO-无限制源的Avro序列化问题

时间:2019-05-25 21:14:26

标签: apache-beam

从不受限制的JMS源读取时,出现以下异常:

avro.shaded.com.google.common.util.concurrent.UncheckedExecutionException: org.apache.avro.SchemaParseException: Illegal character in: this$0
    at avro.shaded.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2234)
    at avro.shaded.com.google.common.cache.LocalCache.get(LocalCache.java:3965)
    at avro.shaded.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3969)
    at avro.shaded.com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4829)
    at org.apache.avro.specific.SpecificData.getSchema(SpecificData.java:225)
    ... 12 more

Avro内省JmsCheckpointMark生成架构时会引发异常。

JmsIO配置:

PCollection<DFAMessage> messages = pipeline.apply("read messages from the events broker",
            JmsIO.<DFAMessage>readMessage()
                    .withConnectionFactory(jmsConnectionFactory)
                    .withTopic(options.getTopic())
                    .withMessageMapper(new DFAMessageMapper())
                    .withCoder(AvroCoder.of(DFAMessage.class)));

0 个答案:

没有答案