Pandas DataFrame使用where()将列与阈值列进行比较

时间:2014-10-13 22:31:06

标签: python pandas

我需要在几个列中使值为空,它们的绝对值小于阈值列中的对应值

        import pandas as pd
        import numpy as np
        df=pd.DataFrame({'key1': ['Ohio', 'Ohio', 'Ohio', 'Nevada', 'Nevada'],
          'key2': [2000, 2001, 2002, 2001, 2002], 
          'data1': np.random.randn(5),
          'data2': np.random.randn(5),
           'threshold': [0.5,0.4,0.6,0.1,0.2]}).set_index(['key1','key2'])

                   data1    data2   threshold
key1    key2            
Ohio    2000    0.201240    0.083833    0.5
        2001    -1.993489   -1.081208   0.4
        2002    0.759038    -1.688769   0.6
Nevada  2001    -0.543916   1.412679    0.1
        2002    -1.545781   0.181224    0.2

这给了我一个错误"无法加入没有指定级别且没有重叠名称"     df.where(df.abs()> DF ['阈值'])

这可行,但显然是针对标量      df.where(df.abs()&0.5)

                       data1           data2    threshold
        key1    key2            
        Ohio    2000    NaN              NaN    NaN
                2001    -1.993489   -1.081208   NaN
                2002    0.759038    -1.688769   NaN
      Nevada    2001    -0.543916   1.412679    NaN
                2002    -1.545781        NaN    NaN
顺便说一下,这似乎给了我一个好结果 - 仍然想知道如何用where()方法做到这一点

      df.apply(lambda x:x.where(x.abs()>x['threshold']),axis=1)

1 个答案:

答案 0 :(得分:3)

这里使用DataFrame.gt(大于)方法的选项略有不同。

df[df.abs().gt(df['threshold'], axis='rows')]
Out[16]: 
# Output might not look the same because of different random numbers,
# use np.random.seed() for reproducible random number gen
Out[13]: 
                data1     data2  threshold
key1   key2                               
Ohio   2000       NaN       NaN        NaN
       2001  1.954543  1.372174        NaN
       2002       NaN       NaN        NaN
Nevada 2001  0.275814  0.854617        NaN
       2002       NaN  0.204993        NaN