我一直在使用以下代码在没有浏览器的情况下下载网页。问题是,当您将页面保存为完整时,它不会保存Firefox之类的所有代码。 Internet Explorer既不保存所有代码,也不保存Web客户端。我已经使用过Gecko和XULRunner但是我一直都会遇到错误,它会为你的项目增加20-40 MB。 Firefox保存的网页大约为55KB。 Internet Explorer(应用程序和Web控件)以24KB的速度保存完整页面。源代码遗漏了很多代码。使用下面的代码,他们无论如何都要保存网页的全部内容?也许是通过标题?
Try
Dim wrWebRequest As HttpWebRequest = CType(WebRequest.Create("http://websta.me/p/799354489959753224_22167696"), HttpWebRequest)
wrWebRequest.Timeout = 30000
wrWebRequest.UserAgent = "Mozilla/5.0"
Dim wrWebResponse As HttpWebResponse = CType(wrWebRequest.GetResponse(), HttpWebResponse)
Dim strStream As Stream = wrWebResponse.GetResponseStream()
Dim bytBuffer(65536) As Byte
Dim intBytesToRead As Integer = CInt(bytBuffer.Length)
Dim intBytesRead As Integer = 0
While intBytesToRead > 0
Dim intNumber As Integer = strStream.Read(bytBuffer, intBytesRead, intBytesToRead)
If intNumber = 0 Then
Exit While
End If
intBytesRead += intNumber
intBytesToRead -= intNumber
End While
strStream.Close()
Dim fsFileStream As New FileStream(Application.StartupPath & "\" & "Data.dat", FileMode.Create, FileAccess.Write, FileShare.None)
fsFileStream.Write(bytBuffer, 0, intBytesRead)
fsFileStream.Close()
Catch ex As Exception
MessageBox.Show(ex.Message)
End Try