我的代码:
import pandas as pd
from sklearn.preprocessing import LabelEncoder
column_names = ["age","workclass","fnlwgt","education","education-num","marital-status","occupation","relationship","race","sex","capital-gain","capital-loss","hrs-per-week","native-country","income"]
adult_train = pd.read_csv("adult.data",header=None,sep=',\s',na_values=["?"])
adult_train.columns=column_names
adult_train.fillna('NA',inplace=True)
我想要在多个列中具有值“NA”的行的索引。是否有内置方法或我必须逐行迭代并检查每列的值? 这是数据的快照:
我希望行的索引如398,409(B列和G列缺失值)而不是像394这样的行(仅在N列缺少值)
答案 0 :(得分:1)
使用isnull.any(1)
或sum
获取布尔掩码,然后选择要获取索引的行,即
df = pd.DataFrame({'A':[1,2,3,4,5],
'B' :[np.nan,4,5,np.nan,8],
'C' :[2,4,np.nan,3,5],
'D' :[np.nan,np.nan,np.nan,np.nan,5]})
A B C D
0 1 NaN 2.0 NaN
1 2 4.0 4.0 NaN
2 3 5.0 NaN NaN
3 4 NaN 3.0 NaN
4 5 8.0 5.0 5.0
# If you want to select rows with nan value from Columns B and C
df.loc[df[['B','C']].isnull().any(1)].index
Int64Index([0, 2, 3], dtype='int64')
# If you want to rows with more than one nan then
df.loc[df.isnull().sum(1)>1].index
Int64Index([0, 2, 3], dtype='int64')