Question

有没有人尝试使用旋转代理？这有多容易实现？它运作良好吗？您的经历

PS：我看到像"how to make php script use a list of proxies"这样的问题收集了很多弊端。你能在解决-1之前解释一下吗？

Answer 1

------ 2017年3月4日更新-------

我去过那里，发现最好的解决方案是：

如果您没有专用服务器或至少有一个vps且有一点耐心，请不要费心阅读帖子的其余部分......

1 - 从源头安装Squid 3.2（检查下面的注释）
2 - 在squid.conf中添加20个左右的ip列表（费用约为25美元） 3 - 使用新功能ACLrandom旋转传出IP。

这样你就不需要在php脚本上旋转ip列表了，相反，你将连接到同一个ip（例如：192.168.1.1：3129），但是可见的传出ip < / strong>（tcp_outgoing_address）将根据随机设置在每个请求上轮播。

您需要使用'-enable-http-violations'编译squid 3.2，以使其成为精英匿名代理。

分步安装：

yum -y groupinstall 'Development Tools' yum -y install openssl-devel wget http://www.squid-cache.org/Versions/v3/3.2/squid-3.2.13.tar.gz tar -xvf squid-3.2.13.tar.gz cd squid-3.2.13 ./configure -prefix=/squid32 '--enable-removal-policies=heap,lru' '--enable-ssl' '--with-openssl' '--enable-linux-netfilter' '--with-pthreads' '--enable-ntlm-auth-helpers=SMB,fakeauth' '--enable-external-acl-helpers=ip_user,ldap_group,unix_group,wbinfo_group' '--enable-auth-basic' '--enable-auth-digest' '--enable-auth-negotiate' '--enable-auth-ntlm' '--with-winbind-auth-challenge' '--enable-useragent-log' '--enable-referer-log' '--disable-dependency-tracking' '--enable-cachemgr-hostname=localhost' '--enable-underscores' '--enable-build-info' '--enable-cache-digests' '--enable-ident-lookups' '--enable-follow-x-forwarded-for' '--enable-wccpv2' '--enable-fd-config' '--with-maxfd=16384' '-enable-http-violations' make make install

示例squid.conf（位于这种情况下为/squid32/etc/squid.conf）：

#this will be the ip and port where squid will run http_port 5.5.5.5:33333 # change this ip and port ... #Extra parameters on squid.conf to make an elite proxy request_header_access Allow allow all request_header_access Authorization allow all request_header_access WWW-Authenticate allow all request_header_access Proxy-Authorization allow all request_header_access Proxy-Authenticate allow all request_header_access Cache-Control allow all request_header_access Content-Encoding allow all request_header_access Content-Length allow all request_header_access Content-Type allow all request_header_access Date allow all request_header_access Expires allow all request_header_access Host allow all request_header_access If-Modified-Since allow all request_header_access Last-Modified allow all request_header_access Location allow all request_header_access Pragma allow all request_header_access Accept allow all request_header_access Accept-Charset allow all request_header_access Accept-Encoding allow all request_header_access Accept-Language allow all request_header_access Content-Language allow all request_header_access Mime-Version allow all request_header_access Retry-After allow all request_header_access Title allow all request_header_access Connection allow all request_header_access Proxy-Connection allow all request_header_access User-Agent allow all request_header_access Cookie allow all request_header_access All deny all via off forwarded_for off follow_x_forwarded_for deny all acl vinte1 random 1/5 acl vinte2 random 1/5 acl vinte3 random 1/5 acl vinte4 random 1/5 acl vinte5 random 1/5 tcp_outgoing_address 1.1.1.1 vinte1 # fake ip's , replace with yours tcp_outgoing_address 1.1.1.2 vinte2 tcp_outgoing_address 1.1.1.3 vinte3 tcp_outgoing_address 1.1.1.4 vinte4 tcp_outgoing_address 1.1.1.5 vinte5 tcp_outgoing_address 1.1.1.6 # this will be the default tcp outgoing address

使用squid代理示例PHP CURL请求：

$proxy = "1.1.1.1:33333"; $useragent="Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1"; $url = "https://api.ipify.org/"; $ch = curl_init(); curl_setopt($ch, CURLOPT_CONNECTTIMEOUT,15); curl_setopt($ch, CURLOPT_HTTP_VERSION,'CURL_HTTP_VERSION_1_1' ); curl_setopt($ch, CURLOPT_HTTPPROXYTUNNEL, 1); curl_setopt($ch, CURLOPT_PROXY, $proxy); curl_setopt($ch, CURLOPT_PROXYUSERPWD,'USER:PASS'); curl_setopt($ch, CURLOPT_USERAGENT,$useragent); curl_setopt($ch, CURLOPT_URL, $url); curl_setopt($ch, CURLOPT_RETURNTRANSFER,1); curl_setopt($ch, CURLOPT_FOLLOWLOCATION,1); curl_setopt($ch, CURLOPT_SSL_VERIFYPEER,0); $result=curl_exec ($ch); curl_close ($ch); echo $result

有用的链接：
Squid 3.2来源：http://www.squid-cache.org/Versions/v3/3.2/squid-3.2.13.tar.gz
Rotating_three_IPs ：http://wiki.squid-cache.org/ConfigExamples/Strange/RotatingIPs#Example:_Rotating_three_IPs_based_on_time_of_day
AclRandom ：http://wiki.squid-cache.org/Features/AclRandom
在CentOS 5.3上安装Squid 3.2 - http://www.guldmyr.com/blog/installing-squid-3-2-on-centos-5-3/
为Squid添加密码：How to set up a squid Proxy with basic username and password authentication?

我发现这是旋转代理的最可靠和最安全的方式，因为您不依赖第三方代理提供商，您的信息（密码，数据等）将更安全。一开始设置可能听起来有点困难，但它会花掉您花费的每一秒，GL :)

Answer 2

PHP Curl支持许多代理命令。

CURLOPT_PROXYAUTH CURLOPT_PROXYPORT CURLOPT_PROXYTYPE CURLOPT_PROXY CURLOPT_PROXY_SERVICE_NAME CURLOPT_PROXYUSERPWD CURLOPT_PROXYHEADER CURLOPT_HTTPPROXYTUNNEL

有关更多信息，请参见：http://php.net/manual/en/function.curl-setopt.php

下面的简单示例。

$proxy      =   array();
$proxy[]    =   '1.2.3.4';
$proxy[]    =   '5.6.7.8';

$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, $url);
curl_setopt($ch, CURLOPT_PROXY, $proxy[array_rand($proxy)]);

curl_setopt($ch, CURLOPT_USERAGENT, "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1");
curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);
curl_setopt($ch, CURLOPT_FOLLOWLOCATION, 1);
curl_setopt($ch, CURLOPT_SSL_VERIFYPEER, 0);
curl_setopt($ch, CURLOPT_CONNECTTIMEOUT, 15);


$result =   curl_exec($ch);
curl_close($ch);

PHP和旋转代理

2 个答案: