熊猫:外部键之间的键差指定范围

时间:2019-01-03 19:30:17

标签: python pandas outer-join

我想在键为id: intdate: pd.Timestamp对象的两个数据帧上执行外部联接。最重要的是,如果ids相同(正常行为)并且日期相等(正常行为)或者日期之间的差异最大为30天,我希望将键视为相等。然后,当执行外部联接时,应采用来自右数据帧的date。下面是一个示例:

left = pd.DataFrame({"id": [1, 2, 3], "date": [pd.Timestamp(2002, 3, 25), pd.Timestamp(2003, 4, 4), pd.Timestamp(2004, 6, 6)], "val_3": [77, 88, 11]})

right = pd.DataFrame({"id": [1, 2, 3], "date": [pd.Timestamp(2002, 3, 10), pd.Timestamp(2003, 4, 27), pd.Timestamp(2004, 5, 5)], "val_1": [99, 66, 33], "val_2": [101, 102, 103]})

加入后的结果应为:

result = pd.DataFrame({"id": [1, 2, 3, 3], "date": [pd.Timestamp(2002, 3, 10), pd.Timestamp(2003, 4, 27), pd.Timestamp(2004, 6, 6), pd.Timestamp(2004, 5, 5)], "val_3": [77, 88, 11, np.nan], "val_1": [99, 66, np.nan, 33], "val_2": [101, 102, np.nan, 103]})

期待您的回答!

1 个答案:

答案 0 :(得分:0)

我认为merge上的'id',然后如果日期不在30天之内,则根据需要拆分DataFrame

import pandas as pd

# Rename so it's easier to split columns later
left = left.rename(columns={'date': 'date_l'})

m = left.merge(right, on='id', how='outer')
mask = m.date >= m.date_l - pd.Timedelta(days=30)

pd.concat([
    m[mask].drop(columns='date_l'),
    m.loc[~mask, left.columns].rename(columns={'date_l': 'date'}),
    m.loc[~mask, right.columns]], 
    ignore_index=True, sort=False)

输出:

   id  val_3       date  val_1  val_2
0   1   77.0 2002-03-10   99.0  101.0
1   2   88.0 2003-04-27   66.0  102.0
2   3   11.0 2004-06-06    NaN    NaN
3   3    NaN 2004-05-05   33.0  103.0