在等于值的地方分配列-pandas df

时间:2019-02-21 22:36:33

标签: python pandas dataframe group-by where

我正在尝试assign pandas中的df个值。具体来说,对于下面的df,我想使用Column['On']来确定当前有多少个值。然后,我想在3组中分配这些值。如此有价值;

1-3 = 1
4-6 = 2
7-9 = 3 etc

这最多可以增加20-30个值。我考虑过np.where,但效率不高,并且返回错误。

import pandas as pd
import numpy as np

d = ({                
    'On' : [1,2,3,4,5,6,7,7,6,5,4,3,2,1],                                     
      })

df = pd.DataFrame(data=d)

此呼叫有效:

df['P'] = np.where(df['On'] == 1, df['On'],1)

但是如果我想将此值应用于其他值,则会出现错误:

df = df['P'] = np.where(df['On'] == 1, df['On'],1)
df = df['P'] = np.where(df['On'] == 2, df['On'],1)
df = df['P'] = np.where(df['On'] == 3, df['On'],1)

IndexError: only integers, slices (`:`), ellipsis (`...`), numpy.newaxis (`None`) and integer or boolean arrays are valid indices

2 个答案:

答案 0 :(得分:1)

您可以使用系列遮罩和loc

df['P'] = float('nan')
df['P'].loc[(df['On'] >= 1) & (df['On'] <= 3)] = 1
df['P'].loc[(df['On'] >= 4) & (df['On'] <= 6)] = 2
# ...etc

通过循环扩展它很容易

j = 1
for i in range(1, 20):
    df['P'].loc[(df['On'] >= j) & (df['On'] <= (j+2))] = i
    j += 3

答案 1 :(得分:1)

通过一些基本的数学和矢量化处理,您可以获得更好的性能。

import pandas as pd
import numpy as np
n = 1000 
df = pd.DataFrame({"On":np.random.randint(1,20, n)})

AlexG的解决方案

%%time
j = 1
df["P"] =  np.nan
for i in range(1, 20):
    df['P'].loc[(df['On'] >= j) & (df['On'] <= (j+2))] = i
    j += 3

CPU times: user 2.11 s, sys: 0 ns, total: 2.11 s
Wall time: 2.11 s

建议的解决方案

%%time
df["P"] = np.ceil(df["On"]/3)


CPU times: user 2.48 ms, sys: 0 ns, total: 2.48 ms
Wall time: 2.15 ms

加速比是〜1000倍