Question

删除列表中与集合中的子字符串相匹配的项目的最快方法是什么？

例如，

the_list =
['Donald John Trump (born June 14, 1946) is an American businessman, television personality',
 'and since June 2015, a candidate for the Republican nomination for President of the United States in the 2016 election.',
 'He is the chairman and president of The Trump Organization and the founder of Trump Entertainment Resorts.',
 'Trumps career',
 'branding efforts',
 'personal life',
 'and outspoken manner have made him a celebrity.',
 'Trump is a native of New York City and a son of Fred Trump, who inspired him to enter real estate development.',
 'While still attending college he worked for his fathers firm',
 'Elizabeth Trump & Son. Upon graduating in 1968 he joined the company',
 'and in 1971 was given control, renaming the company The Trump Organization.',
 'Since then he has built hotels',
 'casinos',
 'golf courses',
 'and other properties',
 'many of which bear his name. He is a major figure in the American business scene and has received prominent media exposure']

列表实际上比这个（数百万个字符串元素）要长很多，我想删除包含字符串的任何元素，例如，

{"Donald Trump", "Trump Organization","Donald J. Trump", "D.J. Trump", "dump", "dd"}

最快的方法是什么？循环最快？

Answer 1

如果您的字符串已经在内存中，请使用列表解析：

new = [line for line in the_list if not any(item in line for item in set_of_words)]

如果你没有在内存中将它们作为内存使用方面更优化的方法，你可以使用生成器表达式：

new = (line for line in the_list if not any(item in line for item in set_of_words))

Answer 2

Aho-Corasick algorithm专为完成此任务而设计。它具有比嵌套循环O（n * m）低得多的时间复杂度O（n + m）的明显优势，其中n是要查找的字符串数，m是要搜索的字符串数。

有一个很好的Python implementation of Aho-Corasick附带解释。 <{3}}还有一些实现，但我没有看过它们。

从列表中删除与子字符串匹配的项目的最快方法 - Python

2 个答案: