在python中有效地知道两个列表的交集是否为空

时间:2010-02-04 05:22:31

标签: python list performance intersection

假设我有两个列表,L和M.现在我想知道它们是否共享一个元素。 如果他们共享一个元素,这将是最快的询问方式(在python中)? 我不关心他们分享哪些元素,或者分享多少元素,只要他们分享或不分享。

例如,在这种情况下

L = [1,2,3,4,5,6]
M = [8,9,10]

我应该得到假,在这里:

L = [1,2,3,4,5,6]
M = [5,6,7]

我应该成真。

我希望问题清楚。 谢谢!

曼努埃尔

4 个答案:

答案 0 :(得分:31)

或者更简洁

if set(L) & set(M):
    # there is an intersection
else:
    # no intersection

如果您确实需要TrueFalse

bool(set(L) & set(M))

在运行一些时间后,这似乎也是一个很好的选择

m_set=set(M)
any(x in m_set  for x in L)

如果M或L中的项目不可用,则必须使用效率较低的方法

any(x in M for x in L)

以下是100个项目列表的一些时间安排。没有交叉点时使用集合会快得多,而当有相当的交集时使用集合会慢一些。

M=range(100)
L=range(100,200)

timeit set(L) & set(M)
10000 loops, best of 3: 32.3 µs per loop

timeit any(x in M for x in L)
1000 loops, best of 3: 374 µs per loop

timeit m_set=frozenset(M);any(x in m_set  for x in L)
10000 loops, best of 3: 31 µs per loop

L=range(50,150)

timeit set(L) & set(M)
10000 loops, best of 3: 18 µs per loop

timeit any(x in M for x in L)
100000 loops, best of 3: 4.88 µs per loop

timeit m_set=frozenset(M);any(x in m_set  for x in L)
100000 loops, best of 3: 9.39 µs per loop


# Now for some random lists
import random
L=[random.randrange(200000) for x in xrange(1000)]
M=[random.randrange(200000) for x in xrange(1000)]

timeit set(L) & set(M)
1000 loops, best of 3: 420 µs per loop

timeit any(x in M for x in L)
10 loops, best of 3: 21.2 ms per loop

timeit m_set=set(M);any(x in m_set  for x in L)
1000 loops, best of 3: 168 µs per loop

timeit m_set=frozenset(M);any(x in m_set  for x in L)
1000 loops, best of 3: 371 µs per loop

答案 1 :(得分:5)

为了避免构建交集的工作,并在我们知道它们相交时立即产生答案:

m_set = frozenset(M)
return any(x in m_set for x in L)

更新: gnibbler尝试了这一点,发现用set()代替frozenset()运行得更快。 Whaddayaknow。

答案 2 :(得分:3)

首先,如果您不需要它们,请切换到set类型。

如果您仍然需要列表类型,请按以下方式执行:0 == False

len(set.intersection(set(L), set(M)))

答案 3 :(得分:-1)

这是我能够提出的最平衡和最有效的方法(评论应该让代码易于理解):

import itertools, operator

def _compare_product(list1, list2):
    "Return if any item in list1 equals any item in list2 exhaustively"
    return any(
        itertools.starmap(
            operator.eq,
            itertools.product(list1, list2)))

def do_they_intersect(list1, list2):
    "Return if any item is common between list1 and list2"

    # do not try to optimize for small list sizes
    if len(list1) * len(list2) <= 100: # pick a small number
        return _compare_product(list1, list2)

    # first try to make a set from one of the lists
    try: a_set= set(list1)
    except TypeError:
        try: a_set= set(list2)
        except TypeError:
            a_set= None
        else:
            a_list= list1
    else:
        a_list= list2

    # here either a_set is None, or we have a_set and a_list

    if a_set:
        return any(itertools.imap(a_set.__contains__, a_list))

    # try to sort the lists
    try:
        a_list1= sorted(list1)
        a_list2= sorted(list2)
    except TypeError: # sorry, not sortable
        return _compare_product(list1, list2)

    # they could be sorted, so let's take the N+M road,
    # not the N*M

    iter1= iter(a_list1)
    iter2= iter(a_list2)
    try:
        item1= next(iter1)
        item2= next(iter2)
    except StopIteration: # one of the lists is empty
        return False # ie no common items

    while 1:
        if item1 == item2:
            return True
        while item1 < item2:
            try: item1= next(iter1)
            except StopIteration: return False
        while item2 < item1:
            try: item2= next(iter2)
            except StopIteration: return False

HTH。