我正在使用wget
使用递归选项(-r
)下载文件并启用递归以转到其他域(-H
)。当它找不到某个文件时,wget就会继续尝试
--2013-05-05 13:38:52-- http://clnet.ucla.edu/robots.txt
Resolving clnet.ucla.edu... 128.97.168.150
Connecting to clnet.ucla.edu|128.97.168.150|:80... failed: Connection timed out.
Retrying.
--2013-05-05 13:39:14-- (try: 2) http://clnet.ucla.edu/robots.txt
Connecting to clnet.ucla.edu|128.97.168.150|:80... failed: Connection timed out.
Retrying.
向下试试10,依此类推。有没有办法告诉wget只是忽略这个文件?