Hazelcast jet 0.6.1管道和DAG定义

时间:2018-07-25 14:54:50

标签: hazelcast-jet

我有用于构建管道的示例代码。

The maximum size of an attached data piece cannot be larger than 256Mb.

Adding, deleting, and editing of the attached items is only possible through an Attachments dialog box.

In the design of Forms and Reports there is new item in the toolbox: the Attachment control (looks like a paper clip). This control may be used at design time.

Editing an attachment is possible if the program used for creating the attachment is available on the local computer. The program will edit the attachment and when it is saved the attachment gets saved to its own field.

Access will compress uncompressed files in the attachments before storing them.

Attachments may originate from any location on the disk drive or the network.

VBA can be used to work with attachments programmatically using the new Attachment Object. It has several properties and methods, and it supports events.

此代码显示以下DAG信息

    private Pipeline buildPipeline() {

    logger.debug("AbstractAuditLogProcessor.buildPipeline  method start");
    Pipeline p = Pipeline.create();

    p.drawFrom(Sources.<String, CacheEntry<AuditLogRecord>>remoteMapJournal("cache_AuditLog", getPlatformClientConfig(), START_FROM_OLDEST))
    .addTimestamps((v) ->  getTimeStamp(v), 3000)
    .peek()
    .groupingKey((v) -> Tuple2.tuple2(getUserID(v),getTranType(v)))
    .window(WindowDefinition.sliding(getSlidingWindowLengthInMillies(), getSlidingStepInMillies()))
    .aggregate(counting())
    .map((v)-> getMapKey(v))
    //.<Map.Entry<String, Long>>customTransform("test2", ()-> this)
    //.<Offer>customTransform("Offer_Recommendations", ()-> this)
    .<Map.Entry<String, Offer>>customTransform("Offer_Recommendations", ()-> this)
    //.drainTo(Sinks.remoteList("cache_OfferRecommendations", getPlatformClientConfig()));
    .drainTo(Sinks.remoteMap("cache_OfferRecommendations", getPlatformClientConfig()));
    logger.debug("AbstractAuditLogProcessor.buildPipeline  method end");
    return p;
}

DAG信息具有其他详细信息/方法调用,例如partitioned(),distributed()

这是否基于密钥分配记录? 同样,hazelcast jet如何确保记录不会移动到其他分区。

0 个答案:

没有答案