Selenium Webdriver Firefox 52 Python每次运行都会选择随机代理

时间:2017-05-04 10:45:13

标签: python selenium firefox selenium-webdriver proxy

我尝试为FireFox上的每次运行设置一个新的随机代理。尝试了许多方法,但只有这个方法有效,但无法弄清楚如何使其随机化:

profile.set_preference("network.proxy.type", 1)
            profile.set_preference("network.proxy.http", "Host")
            profile.set_preference("network.proxy.http_port", port)
            browser = webdriver.Firefox(profile)

我尝试了这个例子,但没有奏效:

from selenium.webdriver.common.proxy import *
myProxy = "xx.xx.xx.xx:xxxx"

proxy = Proxy({
    'proxyType': ProxyType.MANUAL,
'httpProxy': myProxy,
'ftpProxy': myProxy,
'sslProxy': myProxy,
'noProxy': '' # set this value as desired
})  
driver = webdriver.Firefox(proxy=proxy)
driver.get("http://www.google.com")

这对我来说是最好的方式,因为我可以使用:

myProxy = random.choice(open('data.txt').readlines())

我试图从文本文件中获取代理这项工作,但不知道如何随机化:

with open('IPs.txt') as proxylist:
for line in proxylist: 
    proxyserv, proxyport = line.split(':') 
    proxy= proxyserv , proxyport 

最后我试过了:

def random_line():
line_num = 0
selected_line = ''
with open('IPs.txt') as f:
    while 1:
        line = f.readline()
        if not line: break
        line_num += 1
        if random.uniform(0, line_num) < 1:
            selected_line = line
return selected_line.strip() 

这个得到随机行,但无法弄清楚如何解析结果 X = IP Y = PORT 然后:

profile.set_preference("network.proxy.type", 1)
        profile.set_preference("network.proxy.http", "RANDOM IP")
        profile.set_preference("network.proxy.http_port", Random PORT)
        browser = webdriver.Firefox(profile)

1 个答案:

答案 0 :(得分:1)

Port需要是一个整数,您可能想要使用:

import random
myProxy = random.choice(open('IPs.txt').readlines())
parts = myProxy.strip().split(":") # strip removes spaces and line breaks
host = parts[0]
port = int(parts[1]) # port needs to be an integer