Question

我有一个json文件如下：

{＆＃34; imei＆＃34;：{＆＃34; imei＆＃34;：＆＃34; 358174069248418F＆＃34;，＆＃34; imeiBinary＆＃34;：＆＃34; NYF0BpJIQY8 =＆＃34 ;，＆＃34; imeiNotEncoded＆＃34;：＆＃34; 358174069248418＆＃34;，＆＃34;有效＆＃34;：1}，＆＃34; dataPackets＆＃34;：[[＆＃34; msy.mxp .datapacket.AlarmNotification＆＃34;，{＆＃34; version＆＃34;：1，＆＃34; id＆＃34;：21，＆＃34; op＆＃34;：2，＆＃34; sizeDynamic＆＃34; ：0，＆＃34; alarmStatus＆＃34;：4}]，[＆＃34; msy.mxp.datapacket.IOStatus＆＃34;，{＆＃34;版本＆＃34;：1，＆＃34; id＆＃ 34 ;: 15，＆＃34; op＆＃34;：2，＆＃34; sizeDynamic＆＃34;：0，＆＃34; ioStatus＆＃34;：135，＆＃34; ioDirections＆＃34;：120}] ，[＆＃34; msy.mxp.datapacket.LogicalStatus＆＃34;，{＆＃34; version＆＃34;：1，＆＃34; id＆＃34;：16，＆＃34; op＆＃34;：2 ，＆＃34; sizeDynamic＆＃34;：0，＆＃34; logicalStatus＆＃34;：5}]，[＆＃34; msy.mxp.datapacket.Position＆＃34;，{＆＃34; version＆＃34; ：1，＆＃34; id＆＃34;：19，＆＃34; op＆＃34;：2，＆＃34;纬度＆＃34;：40.835243，＆＃34;经度＆＃34;：14.246057，＆＃34 ;海拔高度＆＃34;：40，＆＃34;速度＆＃34;：0，＆＃34;当然＆＃34;：68，＆＃34; gpsNumSatellite＆＃34;：5，＆＃34; glonassNumSatellite＆＃34;： 1，＆＃34; fixValid＆＃34;：1，＆＃34; timeValid＆＃34;：1，＆＃34; wgs84degMinFormat＆＃34;：1，＆＃34; glonass＆＃34;：1，＆＃34; fixMode＆＃34;：3，＆＃34; timestamp＆＃ 34;：{＆＃34; timeSecFrom1Gen2000＆＃34;：925560202，＆＃34; time＆＃34;：1490648755000}，＆＃34; sizeDynamic＆＃34;：0}]]}

我正在通过以下查询阅读：

WITH Datapackets AS
(
SELECT imei.imei as imei,
        persistent as persistent,
        [timestamp].[time] as input_time,
        compressed as compressed,
        GetArrayElement(dataPackets, 3) as position
FROM h24
), one as(
SELECT *,
GetRecordPropertyValue (GetArrayElement(position,1), 'timestamp') as position_timestamp --1st
from Datapackets 
), two as (
select
    imei,
    GetRecordPropertyValue (GetArrayElement(position,1), 'op') as position_OP,
    [position_timestamp].[time] as position_time,
    dateadd(S, [position_timestamp].[timeSecFrom1Gen2000], '1970-01-01') as timing,
GetRecordPropertyValue (GetArrayElement(position,1), 'latitude') as position_latitude,
GetRecordPropertyValue (GetArrayElement(position,1), 'longitude') as position_longitude,
GetRecordPropertyValue (GetArrayElement(position,1), 'altitude') as position_altitude,
GetRecordPropertyValue (GetArrayElement(position,1), 'speed') as position_speed
    from one) SELECT * from two

现在我想让窗口翻滚组按照以下30秒进行，但是我有一个问题告诉我输入文件不允许使用timestamp属性＆＃34; 2＆＃34; ,,这里是我使用的查询

    WITH Datapackets AS
    (
    SELECT imei.imei as imei,
            persistent as persistent,
            [timestamp].[time] as input_time,
            compressed as compressed,
            GetArrayElement(dataPackets, 3) as position
    FROM h24
    ), one as(
    SELECT *,
    GetRecordPropertyValue (GetArrayElement(position,1), 'timestamp') as position_timestamp --1st
    from Datapackets 
    ), two as (
    select
        imei,
        GetRecordPropertyValue (GetArrayElement(position,1), 'op') as position_OP,
        [position_timestamp].[time] as position_time,
        dateadd(S, [position_timestamp].[timeSecFrom1Gen2000], '1970-01-01') as timing,
GetRecordPropertyValue (GetArrayElement(position,1), 'latitude') as position_latitude,
GetRecordPropertyValue (GetArrayElement(position,1), 'longitude') as position_longitude,
GetRecordPropertyValue (GetArrayElement(position,1), 'altitude') as position_altitude,
GetRecordPropertyValue (GetArrayElement(position,1), 'speed') as position_speed
        from one) SELECT imei, System.TimeStamp AS 'start', Avg(position_speed), max(position_latitude)  
FROM two TIMESTAMP BY TIMING GROUP BY imei, TumblingWindow(duration(second, 30))

错误出现在最后两行（FROM TIMESTAMP BY TIMING），

**************更新，经过调查后，我发现我只能在输入中使用选项timestamp，而且只有在我做的时候我才能使用它为事件定制时间戳。通常，它们会按到达时间加上时间戳作为默认值（https://msdn.microsoft.com/en-us/library/mt573293.aspx）

现在我的问题是如何使用记录在Json文件中的第3级数组中的时间字段为我的事件添加时间戳，以便能够进行聚合。

有关我如何处理此问题的任何建议，谢谢

Answer 1

根据https://msdn.microsoft.com/en-us/library/mt598501.aspx TIMESTAMP BY只能用于输入来源，因此您可以将其作为第一步的一部分：

WITH Datapackets AS
...
FROM h24 TIMESTAMP BY (expression)
...

此外，来自同一来源，在窗口上与System.TimeStamp一起使用时引用GROUP BY：

聚合结果的时间戳是此结果对应的时间窗口的结尾。

因此，当您在最终System.TimeStamp语句中编写SELECT时，它会引用当前窗口的结尾。

Azure流分析 - 通过＆＃34;自定义＆＃34;时间戳的错误同时应用窗口翻滚

1 个答案: