从HTTP输入流构建时,Javax xml解析器卡住了

时间:2012-10-15 06:56:39

标签: java html xml parsing well-formed

我正在尝试打开与网站的HTTP连接,并将html解析为org.w3c.dom.Document类。我可以打开HTTP连接并将网页输出到控制台就好了,但如果我将InputStream对象传递给XML解析器,它会挂起一分钟并输出错误

[Fatal Error] :108:55: Open quote is expected for attribute "{1}" associated with an  element type  "onload".

代码:

private static Document getInputStream(String url) throws IOException, SAXException, ParserConfigurationException
{
  System.out.println(url);
  URL webUrl = new URL(url);
  URLConnection connection = webUrl.openConnection();
  connection.setConnectTimeout(60 * 1000);
  connection.setReadTimeout(60 * 1000);

  InputStream stream = connection.getInputStream();

  DocumentBuilderFactory domFactory = DocumentBuilderFactory.newInstance();
  domFactory.setNamespaceAware(true);
  DocumentBuilder builder = domFactory.newDocumentBuilder();
  Document doc = builder.parse(stream); // This line is hanging
  return doc;
}

暂停时的堆栈跟踪:

Thread [main] (Suspended)   
    SocketInputStream.socketRead0(FileDescriptor, byte[], int, int, int) line: not available [native method]    
    SocketInputStream.read(byte[], int, int) line: not available    
    BufferedInputStream.fill() line: not available  
    BufferedInputStream.read1(byte[], int, int) line: not available 
    BufferedInputStream.read(byte[], int, int) line: not available  
    HttpClient.parseHTTPHeader(MessageHeader, ProgressSource, HttpURLConnection) line: not available    
    HttpClient.parseHTTP(MessageHeader, ProgressSource, HttpURLConnection) line: not available  
    HttpURLConnection.getInputStream() line: not available  
    XMLEntityManager.setupCurrentEntity(String, XMLInputSource, boolean, boolean) line: not available   
    XMLEntityManager.startEntity(String, XMLInputSource, boolean, boolean) line: not available  
    XMLEntityManager.startDTDEntity(XMLInputSource) line: not available 
    XMLDTDScannerImpl.setInputSource(XMLInputSource) line: not available    
    XMLDocumentScannerImpl$DTDDriver.dispatch(boolean) line: not available  
    XMLDocumentScannerImpl$DTDDriver.next() line: not available 
    XMLDocumentScannerImpl$PrologDriver.next() line: not available  
    XMLNSDocumentScannerImpl(XMLDocumentScannerImpl).next() line: not available 
    XMLNSDocumentScannerImpl.next() line: not available 
    XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean) line: not available  
    XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not available 
    XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource) line: not available  
    DOMParser(XMLParser).parse(XMLInputSource) line: not available  
    DOMParser.parse(InputSource) line: not available    
    DocumentBuilderImpl.parse(InputSource) line: not available  
    DocumentBuilderImpl(DocumentBuilder).parse(InputStream) line: not available 
    MSCommunicator.getInputStream(String) line: 45  
    MSCommunicator.getGamePageFromForum(int, int, int) line: 70 
    MSCommunicator.getGamePageFromForum(int, int) line: 57  
    Game.<init>(int, int) line: 21  
    MSCommunicator.main(String[]) line: 26  

2 个答案:

答案 0 :(得分:0)

您实际上不能指望将HTML解析为XML DOM树。它不一定是有效的XML。您可能需要先清理它。看看这个问题的答案:

Reading HTML file to DOM tree using Java

答案 1 :(得分:0)

即使您获得的HTML页面是正确且格式正确的HTML,它也可能不是格式良好的XML。例如,这在HTML4中有效:

<p class=myclass>Paragraph<br>Next line</p>

而在XML(XHTML)中,这被认为是有效的:

<p class="myclass">Paragraph<br/>Next line</p>

请注意已关闭的<br/>代码以及p代码的class属性周围的引号。

此外,互联网是一个野生的地方,所以内容不太可能是良好的形式,这就是为什么你需要“拿一粒盐” - 甚至是良好的形成,所以你将不得不使用HTML整洁,如jTidynekoHTML