Question

我有两个python列表：

a = [('when', 3), ('why', 4), ('throw', 9), ('send', 15), ('you', 1)]

b = ['the', 'when', 'send', 'we', 'us']

我需要过滤掉与b中类似的所有元素。就像在这种情况下，我应该得到：

c = [('why', 4), ('throw', 9), ('you', 1)]

最有效的方法是什么？

Answer 1

列表理解将起作用。

a = [('when', 3), ('why', 4), ('throw', 9), ('send', 15), ('you', 1)]
b = ['the', 'when', 'send', 'we', 'us']
filtered = [i for i in a if not i[0] in b]

>>>print(filtered)
[('why', 4), ('throw', 9), ('you', 1)]

Answer 2

列表理解应该有效：

c = [item for item in a if item[0] not in b]

或者使用词典理解：

d = dict(a)
c = {key: value for key in d.iteritems() if key not in b}

Answer 3

in很不错，但您应该至少使用b的集合。如果你有numpy，你当然也可以尝试np.in1d，但如果它更快或者没有，你应该尝试。

# ruthless copy, but use the set...
b = set(b)
filtered = [i for i in a if not i[0] in b]

# with numpy (note if you create the array like this, you must already put
# the maximum string length, here 10), otherwise, just use an object array.
# its slower (likely not worth it), but safe.
a = np.array(a, dtype=[('key', 's10'), ('val', int)])
b = np.asarray(b)

mask = ~np.in1d(a['key'], b)
filtered = a[mask]

集合也有方法difference等，这些方法在这里可能没有用，但通常可能是。

Answer 4

由于这是用numpy标记的，因此这是一个使用numpy.in1d基于列表理解基准的numpy解决方案：

In [1]: a = [('when', 3), ('why', 4), ('throw', 9), ('send', 15), ('you', 1)]

In [2]: b = ['the', 'when', 'send', 'we', 'us']

In [3]: a_ar = np.array(a, dtype=[('string','|S5'), ('number',float)])

In [4]: b_ar = np.array(b)

In [5]: %timeit filtered = [i for i in a if not i[0] in b]
1000000 loops, best of 3: 778 ns per loop

In [6]: %timeit filtered = a_ar[-np.in1d(a_ar['string'], b_ar)]
10000 loops, best of 3: 31.4 us per loop

因此，对于5个记录，列表理解更快。

然而，对于大型数据集，numpy解决方案的速度是列表理解的两倍：

In [7]: a = a * 1000

In [8]: a_ar = np.array(a, dtype=[('string','|S5'), ('number',float)])

In [9]: %timeit filtered = [i for i in a if not i[0] in b]
1000 loops, best of 3: 647 us per loop

In [10]: %timeit filtered = a_ar[-np.in1d(a_ar['string'], b_ar)]
1000 loops, best of 3: 302 us per loop

Answer 5

试试这个：

a = [('when', 3), ('why', 4), ('throw', 9), ('send', 15), ('you', 1)]

b = ['the', 'when', 'send', 'we', 'us']

c=[]

for x in a:
    if x[0] not in b:
        c.append(x)
print c

演示：http://ideone.com/zW7mzY

Answer 6

简便

a = [('when', 3), ('why', 4), ('throw', 9), ('send', 15), ('you', 1)]
b = ['the', 'when', 'send', 'we', 'us']
c=[] # a list to store the required tuples 
#compare the first element of each tuple in with an element in b
for i in a:
    if i[0] not in b:
        c.append(i)
print(c)

Answer 7

使用过滤器：

c = filter(lambda (x, y): False if x in b else True, a)

查找python列表之间的交集/区别

7 个答案: