我的https网站无法通过WGET命令下载

时间:2011-10-11 21:37:32

标签: https wget

我可以通过浏览器浏览页面,但是我无法通过wget下载html页面。 https://money.benck.tw

当我使用wget时,它甚至无法连接到网站:

--2011-10-12 05:30:24--  https://money.benck.tw/
Resolving money.benck.tw... 97.107.135.68
Connecting to money.benck.tw|97.107.135.68|:443... failed: Connection timed out.
Retrying.

--2011-10-12 05:33:35--  (try: 2)  https://money.benck.tw/
Connecting to money.benck.tw|97.107.135.68|:443...

但是,我可以下载其他https网站,例如:https://ajax.googleapis.com/ajax/libs/jquery/1/jquery.min.js 这很奇怪。

3 个答案:

答案 0 :(得分:2)

对于本网站,您必须使用--no-check-certificate命令

wget --no-check-certificate https://money.benck.tw

答案 1 :(得分:0)

我正在试验相同的问题,我尝试从https://downloads.wordpress.org/plugin/easy-wp-smtp.zip这样的外部站点下载文件,并且我使用--no-check-certificate仍然无法正常工作。...此行冻结了:

连接到downloads.wordpress.org(downloads.wordpress.org)| 198.143.164.250 |:443 ...

有人遇到同样的问题吗?

未配置IP表和规则。当我在相同网络上的其他服务器上执行此操作时。这只会在此服务器上专门发生。

关于, 于Yu

答案 2 :(得分:0)

这是因为此页面可能被 wget 抓取的频率太高。您需要修改标题,尤其是用户代理。

来自其他网站的示例:

--no-check-certificate 没有帮助

 wget --no-check-certificate "https://www.money.pl/pieniadze/depozyty/walutowearch/1921-02-05,2021-02-05,LIBORCHF3M,strona,1.html"                                                                  --2021-02-05 17:05:34--  https://www.money.pl/pieniadze/depozyty/walutowearch/1921-02-05,2021-02-05,LIBORCHF3M,strona,1.html
Loaded CA certificate '/etc/ssl/certs/ca-certificates.crt'
Resolving www.money.pl (www.money.pl)... 212.77.101.20
Connecting to www.money.pl (www.money.pl)|212.77.101.20|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2021-02-05 17:05:34 ERROR 403: Forbidden.

但其他下载sendign其他标头的工具可以使用

 http -h "https://www.money.pl/pieniadze/depozyty/walutowearch/1921-02-05,2021-02-05,LIBORCHF3M,strona,1.html"  
HTTP/1.1 200 OK
Cache-control: max-age=60, public,stale-while-revalidate=5
Connection: keep-alive
Content-Encoding: gzip
Content-Length: 20756
Content-Security-Policy: upgrade-insecure-requests;
Content-Type: text/html; charset=iso-8859-2
Date: Fri, 05 Feb 2021 16:04:16 GMT
Link: <https://money.wp.pl/dGxwOTV0SyYZFTlneUtGM1pNbSY9EkhlJ1V1dglvOxgnKBALCW87GCcoEAsJbzsYJygQCwlvOxgnKBALCW87GCcoEAsJbzsYJygQCwlvOxgnKBALCW87GCcoEAsJbzsYJygQCwlvOxgnKBALCW87GCcoEAsJbzsYJygQCwlvOxgnKBALCW87GCcobXh0RUZ9WlgoNTAeDjRHBTlpZxYWIhMeKydrAld1TER2ciZYECoUSjgjIR4JKBYSNnomXEF1TUUJJD9VCi4ZEzUxcwJRdT4TKiQ5Sh0zAVJ9YWR2EyYUAjs7IVUFNRsfamZjAiJ2QUV-eWYCSXdNUn1hZHNWd0pGYmRkHVRyXUV6ZhV8LQU3JQwcEAMpYkpCfRclRBYoFhZqZmMCJ3ZWHzs5OhY0EDkoLjA0VFl1XgQ_PTgNKRMbQgIuB0lCIRQEOzUiWQB6XhYrIgVcCzMLSn9lZhYHJBkDKjM5Qh16DxYjISJJRjo=>;rel="preload";as="script";
Server: nginx
Set-Cookie: mny_ver2=v8c;Domain=.money.pl;Path=/;Max-Age=2592000;
Vary: Accept-Encoding