我正在尝试使用Apache HttpClient 4从网页上获取“标题”。
编辑:我的第一种方法是尝试从标头中获取它(使用HttpHead)。如果那是不可能的,我怎么能从响应的主体那里得到它,就像@Todd说的那样?
编辑2:
<head>
[...]
<title>This is what I need to get!</title>
[...]
</head>
答案 0 :(得分:2)
谢谢大家的意见。一旦使用了jsoup,解决方案就非常简单了。
Document doc = Jsoup.connect("http://example.com/").get();
String title = doc.title();
考虑到我真的需要使用HttpClient进行连接,这就是我所拥有的:
org.jsoup.nodes.Document doc = null;
String title = "";
System.out.println("Getting content... ");
CloseableHttpClient httpclient = HttpClients.createDefault();
HttpHost target = new HttpHost(host);
HttpGet httpget = new HttpGet(path);
CloseableHttpResponse response = httpclient.execute(target, httpget);
System.out.println("Parsing content... ");
try {
String line = null;
StringBuffer tmp = new StringBuffer();
BufferedReader in = new BufferedReader(new InputStreamReader(response.getEntity().getContent()));
while ((line = in.readLine()) != null) {
String decoded = new String(line.getBytes(), "UTF-8");
tmp.append(" ").append(decoded);
}
doc = Jsoup.parse(String.valueOf(tmp));
title = doc.title();
System.out.println("Title=" + title); //<== ^_^
//[...]
} finally {
response.close();
}
System.out.println("Done.");
答案 1 :(得分:0)
使用此代码段,您仍然可以通过证明其 URL 来检索网页的<title>
。
InputStream response = null;
try {
String url = "http://example.com/";
response = new URL(url).openStream();
Scanner scanner = new Scanner(response);
String responseBody = scanner.useDelimiter("\\A").next();
System.out.println(responseBody.substring(responseBody.indexOf("<title>") + 7, responseBody.indexOf("</title>")));
} catch (IOException ex) {
ex.printStackTrace();
} finally {
try {
response.close();
} catch (IOException ex) {
ex.printStackTrace();
}
}