通过在字符串列中查找确切的单词来创建新列

时间:2018-04-11 08:05:25

标签: python string python-3.x pandas dataframe

如果列表中的任何单词与数据帧字符串列匹配,我想创建一个包含1或0的新列。

list_provided=["mul","the"]
#how my dataframe looks
id  text
a    simultaneous there the
b    simultaneous there
c    mul why

预期输出

id  text                     found
a    simultaneous there the   1
b    simultaneous there       0
c    mul why                  1

第二行被指定为0,因为 中的“mul”或“the”在字符串列“text”中不完全匹配

代码尝试到现在

#For exact match I am using the below code
data["Found"]=np.where(data["text"].str.contains(r'(?:\s|^)penalidades(?:\s|$)'),1,0)

如何迭代循环以查找所提供的单词列表中所有单词的完全匹配?

修改 如果我使用Georgey建议的str.contains(模式),数据[“Found”]的所有行都变为1

data=pd.DataFrame({"id":("a","b","c","d"), "text":("simultaneous there the","simultaneous there","mul why","mul")})
list_of_word=["mul","the"]
pattern = '|'.join(list_of_word)
data["Found"]=np.where(data["text"].str.contains(pattern),1,0)

Output:
id  text                     found
a    simultaneous there the   1
b    simultaneous there       1
c    mul why                  1
d    mul                      1

找到列中的第二行应为0

2 个答案:

答案 0 :(得分:4)

您可以使用pd.Series.applysum使用生成器表达式执行此操作:

import pandas as pd

df = pd.DataFrame({'id': ['a', 'b', 'c'],
                   'text': ['simultaneous there the', 'simultaneous there', 'mul why']})

test_set = {'mul', 'the'}

df['found'] = df['text'].apply(lambda x: sum(i in test_set for i in x.split()))

#   id                    text  found
# 0  a  simultaneous there the      1
# 1  b      simultaneous there      0
# 2  c                 mul why      1

以上提供计数。如果您只需要布尔值,请使用any

df['found'] = df['text'].apply(lambda x: any(i in test_set for i in x.split()))

对于整数表示,链.astype(int)

答案 1 :(得分:1)

修改1

试试这段代码

import pandas as pd
dataframe = [["simultaneous there the","simultaneous there","mul why","mul"],["a","b","c","d"]]
list_of_word = ["mul","the"]


dic = {
    "id": dataframe[1],
    "text": dataframe[0] 
}

DataF = pd.DataFrame(dic)

found = []
for key in DataF["text"]:
    anyvari = False
    for damn in key.split(" "):

        if(damn==list_of_word[0] or damn==list_of_word[1]):
            anyvari = True

            break
        else:
            continue
    if(anyvari!=True):
        found.append(0)
    else:
        found.append(1)


DataF["found"] = found         


print(DataF)

它会给你这样的

  id                    text  found
0  a  simultaneous there the      1
1  b      simultaneous there      0
2  c                 mul why      1
3  d                     mul      1