我尝试为FireFox上的每次运行设置一个新的随机代理。尝试了许多方法,但只有这个方法有效,但无法弄清楚如何使其随机化:
profile.set_preference("network.proxy.type", 1)
profile.set_preference("network.proxy.http", "Host")
profile.set_preference("network.proxy.http_port", port)
browser = webdriver.Firefox(profile)
我尝试了这个例子,但没有奏效:
from selenium.webdriver.common.proxy import *
myProxy = "xx.xx.xx.xx:xxxx"
proxy = Proxy({
'proxyType': ProxyType.MANUAL,
'httpProxy': myProxy,
'ftpProxy': myProxy,
'sslProxy': myProxy,
'noProxy': '' # set this value as desired
})
driver = webdriver.Firefox(proxy=proxy)
driver.get("http://www.google.com")
这对我来说是最好的方式,因为我可以使用:
myProxy = random.choice(open('data.txt').readlines())
我试图从文本文件中获取代理这项工作,但不知道如何随机化:
with open('IPs.txt') as proxylist:
for line in proxylist:
proxyserv, proxyport = line.split(':')
proxy= proxyserv , proxyport
最后我试过了:
def random_line():
line_num = 0
selected_line = ''
with open('IPs.txt') as f:
while 1:
line = f.readline()
if not line: break
line_num += 1
if random.uniform(0, line_num) < 1:
selected_line = line
return selected_line.strip()
这个得到随机行,但无法弄清楚如何解析结果 X = IP Y = PORT 然后:
profile.set_preference("network.proxy.type", 1)
profile.set_preference("network.proxy.http", "RANDOM IP")
profile.set_preference("network.proxy.http_port", Random PORT)
browser = webdriver.Firefox(profile)
答案 0 :(得分:1)
Port
需要是一个整数,您可能想要使用:
import random
myProxy = random.choice(open('IPs.txt').readlines())
parts = myProxy.strip().split(":") # strip removes spaces and line breaks
host = parts[0]
port = int(parts[1]) # port needs to be an integer