我想下载网页的本地副本并获取所有css,图片,javascript等。
在之前的讨论中(例如here和here,两者都超过两年),通常会提出两条建议:wget -p
和httrack。但是,这些建议都失败了。我非常感谢使用这些工具中的任何一个来完成任务;替代品也很可爱。
选项1:wget -p
wget -p
成功下载了所有网页的先决条件(css,images,js)。但是,当我在Web浏览器中加载本地副本时,该页面无法加载先决条件,因为尚未从Web上的版本修改这些先决条件的路径。
例如:
<link rel="stylesheet href="/stylesheets/foo.css" />
以指向foo.css
的新相对路径background-image: url(/images/bar.png)
。有没有办法修改wget -p
以便路径正确?
选项2:httrack
httrack
似乎是镜像整个网站的绝佳工具,但我不清楚如何使用它来创建单个页面的本地副本。 httrack论坛中有很多关于这个主题的讨论(例如here),但似乎没有人有防弹解决方案。
选项3:另一个工具?
有些人建议使用付费工具,但我无法相信那里没有免费解决方案。
非常感谢!
答案 0 :(得分:242)
wget能够做你想要的。试试以下内容:
wget -p -k http://www.example.com/
-p
将为您提供正确查看网站所需的所有元素(css,图片等)。
-k
会更改所有链接(包括CSS和图片的链接),以便您在线显示该网页。
来自Wget文档:
‘-k’
‘--convert-links’
After the download is complete, convert the links in the document to make them
suitable for local viewing. This affects not only the visible hyperlinks, but
any part of the document that links to external content, such as embedded images,
links to style sheets, hyperlinks to non-html content, etc.
Each link will be changed in one of the two ways:
The links to files that have been downloaded by Wget will be changed to refer
to the file they point to as a relative link.
Example: if the downloaded file /foo/doc.html links to /bar/img.gif, also
downloaded, then the link in doc.html will be modified to point to
‘../bar/img.gif’. This kind of transformation works reliably for arbitrary
combinations of directories.
The links to files that have not been downloaded by Wget will be changed to
include host name and absolute path of the location they point to.
Example: if the downloaded file /foo/doc.html links to /bar/img.gif (or to
../bar/img.gif), then the link in doc.html will be modified to point to
http://hostname/bar/img.gif.
Because of this, local browsing works reliably: if a linked file was downloaded,
the link will refer to its local name; if it was not downloaded, the link will
refer to its full Internet address rather than presenting a broken link. The fact
that the former links are converted to relative links ensures that you can move
the downloaded hierarchy to another directory.
Note that only at the end of the download can Wget know which links have been
downloaded. Because of that, the work done by ‘-k’ will be performed at the end
of all the downloads.