我正在尝试使用Android DefaultHTTPClient
获取页面并使用Jsoup解析它。我收到了一个非常奇怪的回复,其中<body>
和</body>
标记中的所有HTML都被编码为某些内容。
<html>
<head></head>
<body>
��������������Y�#I�&�\�+��*;����/U���53�*��U�=�D�I:I� ����X�������=H��2�`Ѓ ��o��nͽ�C瘹;�l2Y�I_l�����;f��W�k��o2.����?�r>��œ�qYξ<<<;;�g*��ѡl���9>s@I��`R��V �c�������Ɂ��e�����,> }���A�����W�?��".��ˡhޖ�Qy1�oL�_�W�h?9�E?Ofe��KO�Q��(�Av�N�h@��G�qvV�_G��W�g�'q�2�N��L�?�"鳷�x�o�����$9�}/;'#ȸ Q��&�2�\�a��aǔ�L�I�ԯ�=���TPFE� ���:�,�H�N�'QQԯ<>�i}�x��'$�'O ��qy@J�h 2��ᓃ�CH��ʤO���0�LD)��p8�챺)
</body>
</html>
这是我获取页面的方法。
public String doGet(String strUrl, List<NameValuePair> lstParams) throws Exception {
String strResponse = null;
HttpGet htpGet = new HttpGet(strUrl);
//htpGet.addHeader("Accept-Encoding", "gzip, deflate");
htpGet.setHeader("User-Agent", "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:15.0) Gecko/20100101 Firefox/15.0.1");
DefaultHttpClient dhcClient = new DefaultHttpClient();
PersistentCookieStore pscStore = new PersistentCookieStore(this.objContext);
dhcClient.setCookieStore(pscStore);
HttpResponse resResponse = dhcClient.execute(htpGet);
strResponse = EntityUtils.toString(resResponse.getEntity());
return strResponse;
}
为什么会发生这种情况?
如果我使用Jsoup本身获取页面,则响应很好。我必须使用Jsoup.connect("http://www.kat.ph/").get()
答案 0 :(得分:1)
试试这种方式......结果相同......
URL url = new URL("Your_URL");
InputStream is = url.openStream(); // or url.openConnection();
Scanner scan = new Scanner(is);
while(scan.hasNextLine()){
System.out.println(scan.nextLine());
}
}
答案 1 :(得分:1)
这是因为响应是GZIPped。我连接了一个解压缩响应的自定义响应拦截器。就是这样:
class Decompressor implements HttpResponseInterceptor {
/*
* @see org.apache.http.HttpResponseInterceptor#process(org.apache.http.
* HttpResponse, org.apache.http.protocol.HttpContext)
*/
public void process(HttpResponse hreResponse, HttpContext hctContext) throws HttpException, IOException {
HttpEntity entity = hreResponse.getEntity();
if (entity != null) {
Header ceheader = entity.getContentEncoding();
if (ceheader != null) {
HeaderElement[] codecs = ceheader.getElements();
for (int i = 0; i < codecs.length; i++) {
if (codecs[i].getName().equalsIgnoreCase("gzip")) {
hreResponse.setEntity(new HttpEntityWrapper(entity) {
@Override
public InputStream getContent() throws IOException, IllegalStateException {
return new GZIPInputStream(wrappedEntity.getContent());
}
@Override
public long getContentLength() {
return -1;
}
});
return;
}
}
}
}
}
}