在两个日期列之间上采样

时间:2019-02-11 13:46:05

标签: python pandas resampling

我有以下df

lst = [[1548828606206000000, 1548840373139000000],
 [1548841285708000000, 1548841458405000000],
 [1548842198276000000, 1548843109519000000],
 [1548844022821000000, 1548844934207000000],
 [1548845431090000000, 1548845539219000000],
 [1548845555332000000, 1548845846621000000],
 [1548847176147000000, 1548851020030000000],
 [1548851704053000000, 1548852256143000000],
 [1548852436514000000, 1548855900767000000],
 [1548856817770000000, 1548857162183000000],
 [1548858736931000000, 1548858979032000000]]

df = pd.DataFrame(lst,columns =['start','end'])
df['start'] = pd.to_datetime(df['start'])
df['end'] = pd.to_datetime(df['end'])

,我想获取该事件的持续时间以及每小时的开始和结束时间: enter image description here

然后在我的虚拟df中,第6小时应该是60分钟(每小时最大)-00:10:06 = 00:49:54。第七和第八应该是1:00:00,因为结束时间是09:26:13。对于9th,应为00:26:13,再加上与9h 09:44-09:41 = 3mins和60mins -00:56 = 4 mins重叠的以下.row中的所有间隔。因此,第9名的总数应为26+ 3 + 4〜= 00:32:28

我最初的方法是合并开始和结束,在第3行添加虚拟点,将样本升采样为1S,获得行之间的差,仅汇总实际行。必须有更Python化的方式来做到这一点。任何提示都会很棒。

1 个答案:

答案 0 :(得分:1)

IIUC,类似这样:

df.apply(lambda x: pd.to_timedelta(pd.Series(1, index=pd.date_range(x.start, x.end, freq='S'))
                                     .groupby(pd.Grouper(freq='H')).count(), unit='S'), axis=1).sum()

输出:

2019-01-30 06:00:00   00:49:54
2019-01-30 07:00:00   01:00:00
2019-01-30 08:00:00   01:00:00
2019-01-30 09:00:00   00:32:28
2019-01-30 10:00:00   00:33:43
2019-01-30 11:00:00   00:40:24
2019-01-30 12:00:00   00:45:37
2019-01-30 13:00:00   00:45:01
2019-01-30 14:00:00   00:09:48
Freq: H, dtype: timedelta64[ns]

或将其缩减为几个小时,请尝试:

df.apply(lambda r: pd.to_timedelta(pd.Series(1, index=pd.date_range(r.start, r.end, freq='S'))
                                   .pipe(lambda x: x.groupby(x.index.hour).count()), unit='S'), axis=1)\
  .sum()

输出:

6    00:49:54
7    01:00:00
8    01:00:00
9    00:32:28
10   00:33:43
11   00:40:24
12   00:45:37
13   00:45:01
14   00:09:48
dtype: timedelta64[ns]