Tweepy实现以避免Twitter速率限制器(python)

时间:2017-11-29 05:37:04

标签: python api twitter tweepy rate-limiting

我正在尝试执行以下代码并收到'88'错误,也在下面复制。我已经删除了Twitter帐户句柄,但我已经包含了25个帐户句柄,每个句柄大约有3k-80k粉丝(可能平均大约20k)。

import time
import tweepy
import csv
from itertools import zip_longest

auth = tweepy.OAuthHandler('', '')
auth.set_access_token('', '')

api = tweepy.API(auth)

accounts = [25 twitter account handles here as strings]

numberOfAccts = len(accounts)
d = [[''],[''],[''],[''],[''],[''],[''],[''],[''],[''],[''],[''],[''],[''],[''],[''],[''],[''],[''],[''],[''],[''],[''],[''],['']]

with open('FollowerIDLists.csv', 'a', newline="") as f:
    #writer = csv.writer(f)
    for i in range(0, numberOfAccts):
        print(accounts[i])
        ids = []
        for page in tweepy.Cursor(api.followers_ids, screen_name=accounts[i]).pages():
            ids.extend(page)
            time.sleep(60)
        d[i] = ids
    export_data = zip_longest(*d, fillvalue = '')
    wr = csv.writer(f)
    wr.writerow(accounts)
    wr.writerows(export_data)
f.close()

这是错误:

Traceback (most recent call last):
  File "C:\Users\USER\Desktop\composeFollowerIDLists.py", line 30, in <module>
    for page in tweepy.Cursor(api.followers_ids, screen_name=accounts[i]).pages():
  File "C:\Users\USER\AppData\Local\Programs\Python\Python36-32\lib\site-packages\tweepy\cursor.py", line 49, in __next__
    return self.next()
  File "C:\Users\USER\AppData\Local\Programs\Python\Python36-32\lib\site-packages\tweepy\cursor.py", line 75, in next
    **self.kargs)
  File "C:\Users\USER\AppData\Local\Programs\Python\Python36-32\lib\site-packages\tweepy\binder.py", line 245, in _call
    return method.execute()
  File "C:\Users\USER\AppData\Local\Programs\Python\Python36-32\lib\site-packages\tweepy\binder.py", line 227, in execute
    raise RateLimitError(error_msg, resp)
tweepy.error.RateLimitError: [{'message': 'Rate limit exceeded', 'code': 88}]

我听说避免速率限制器的正确方法是使用'wait_on_rate_limit'和'wait_on_rate_limit_notify'的某种组合,但我不知道如何在上面实现这些。如您所见,我尝试使用time.sleep(60)命令失败。谁可以借给我一个人?

1 个答案:

答案 0 :(得分:1)

查看我的推文抓取工具我使用了'wait_on_rate_limit'和'wait_on_rate_limit_notify:https://github.com/Sy-Muzammil/Tweet-Crawlers/blob/master/geo_country.py