熊猫根据日期范围爆炸列

时间:2020-06-15 13:41:11

标签: pandas python-3.8

我有一个如下所示的数据框:

compute(K key, BiFunction<? super K, ? super V, ? extends V> remappingFunction)

当日期范围存在时,我想爆炸这些列,这由列名中Col1 6/13/2020-6/15/2020 6/16/2020 A1 2.3 1.65 A2 1.4 1.4 A3 1.3 1.3 的存在来表示。

期望的结果如下:

-

我不确定如何在各列之间爆炸它。

2 个答案:

答案 0 :(得分:5)

我们仍然explode

s=df.set_index('Col1').T.reset_index()
s
Out[49]: 
Col1                index    A1   A2   A3
0     6/13/2020-6/15/2020  2.30  1.4  1.3
1               6/16/2020  1.65  1.4  1.3
s['index']=[pd.date_range(x.split('-')[0],x.split('-')[-1]) for x in s['index']]
s=s.explode('index').set_index('index').T.reset_index()
s
Out[52]: 
index Col1  2020-06-13 00:00:00  ...  2020-06-15 00:00:00  2020-06-16 00:00:00
0       A1                  2.3  ...                  2.3                 1.65
1       A2                  1.4  ...                  1.4                 1.40
2       A3                  1.3  ...                  1.3                 1.30
[3 rows x 5 columns]

答案 1 :(得分:2)

将非datetimes列转换为索引,然后在列表理解中使用numpy.broadcast_to创建新的DataFrame,最后通过concat进行联接:

df1 = df.set_index('Col1')

dfs = [pd.DataFrame(data=np.broadcast_to(df1.iloc[:,[i]].to_numpy(), 
                                         shape=(len(df1), len(pd.date_range(s, e)))), 
                   index=df1.index, 
                   columns=pd.date_range(s, e))
      if pd.notna(e) 
      else pd.DataFrame(df1.iloc[:,[i]].to_numpy(), 
                        index=df1.index, 
                        columns=[pd.to_datetime(s)]) 
      for i, (s, e) in enumerate(df1.columns.str.split('-', expand=True))]

df = pd.concat(dfs, axis=1)
print (df)
      2020-06-13  2020-06-14  2020-06-15  2020-06-16
Col1                                                
A1           2.3         2.3         2.3        1.65
A2           1.4         1.4         1.4        1.40
A3           1.3         1.3         1.3        1.30

如果可能重叠:

print (df)
  Col1  6/13/2020-6/16/2020  6/16/2020
0   A1                  2.3       1.65 <- 6/16/2020 is overlap
1   A2                  1.4       1.40
2   A3                  1.3       1.30

df1 = df.set_index('Col1')

dfs = [pd.DataFrame(data=np.broadcast_to(df1.iloc[:,[i]].to_numpy(), 
                                         shape=(len(df1), len(pd.date_range(s, e)))), 
                   index=df1.index, 
                   columns=pd.date_range(s, e))
      if pd.notna(e) 
      else pd.DataFrame(df1.iloc[:,[i]].to_numpy(), 
                        index=df1.index, 
                        columns=[pd.to_datetime(s)]) 
      for i, (s, e) in enumerate(df1.columns.str.split('-', expand=True))]

df = pd.concat(dfs, axis=1).sum(level=0, axis=1)
print (df)
      2020-06-13  2020-06-14  2020-06-15  2020-06-16
Col1                                                
A1           2.3         2.3         2.3        3.95
A2           1.4         1.4         1.4        2.80
A3           1.3         1.3         1.3        2.60