如何使用JSOUP通过java在HTML页面中刮取和下载表

Question

我试过了......但是行和列分开打印......我的要求是从HTML页面下载表格

public class Main {
   public static void main(String[] args) throws IOException {
      String html = "URL";
      // Document doc = Jsoup.connect(html).get();
     Document doc = Jsoup.parse(html);
     System.out.println(doc);
     Elements tableElements = doc.select("table");

     Elements tableHeaderEles = tableElements.select("thead tr th");
    System.out.println("headers");
     for (int i = 0; i < tableHeaderEles.size(); i++) {
        System.out.println(tableHeaderEles.get(i).text());
     }
     System.out.println();

     Elements tableRowElements = tableElements.select(":not(thead) tr");

     for (int i = 0; i < tableRowElements.size(); i++) {
        Element row = tableRowElements.get(i);
        System.out.println("row");
        Elements rowItems = row.select("td");
        for (int j = 0; j < rowItems.size(); j++) {
           System.out.println(rowItems.get(j).text());
        }
     }
   }
}

提前致谢...

Answer 1

使用luksch wrote in his comment的教程，解决方案可能是：

echo `git log -2 --format=oneline --reverse | cut -f 1 -d ' ' | xargs` master | ./hooks/post-receive

这将创建一个package com.github.davidepastore.stackoverflow34331254; import java.io.FileWriter; import java.io.IOException; import org.jsoup.Jsoup; import org.jsoup.nodes.Document; import org.jsoup.nodes.Element; import org.jsoup.select.Elements; /** * Reply to stackoverflow 34331254 question. * */ public class App { public static void main(String[] args) throws IOException { String url = "http://www.htmlcodetutorial.com/tables/_THEAD.html"; String fileName = "table.csv"; FileWriter writer = new FileWriter(fileName); Document doc = Jsoup.connect(url).get(); System.out.println(doc); Element tableElement = doc.select("table").first(); Elements tableHeaderEles = tableElement.select("thead tr th"); System.out.println("headers"); for (int i = 0; i < tableHeaderEles.size(); i++) { System.out.println(tableHeaderEles.get(i).text()); writer.append(tableHeaderEles.get(i).text()); if(i != tableHeaderEles.size() -1){ writer.append(','); } } writer.append('\n'); System.out.println(); Elements tableRowElements = tableElement.select(":not(thead) tr"); for (int i = 0; i < tableRowElements.size(); i++) { Element row = tableRowElements.get(i); System.out.println("row"); Elements rowItems = row.select("td"); for (int j = 0; j < rowItems.size(); j++) { System.out.println(rowItems.get(j).text()); writer.append(rowItems.get(j).text()); if(j != rowItems.size() -1){ writer.append(','); } } writer.append('\n'); } writer.close(); } } 文件，其中包含第一个表（包括标题）。

表格内容为：

csv

<table cellpadding="6" rules="GROUPS" frame="BOX"> <thead> <tr> <th>Weekday</th> <th>Date</th> <th>Manager</th> <th>Qty</th> </tr> </thead> <tbody> <tr> <td>Mon</td> <td>09/11</td> <td>Kelsey</td> <td>639</td> </tr> <tr> <td>Tue</td> <td>09/12</td> <td>Lindsey</td> <td>596</td> </tr> <tr> <td>Wed</td> <td>09/13</td> <td>Randy</td> <td>1135</td> </tr> <tr> <td>Thu</td> <td>09/14</td> <td>Susan</td> <td>1002</td> </tr> <tr> <td>Fri</td> <td>09/15</td> <td>Randy</td> <td>908</td> </tr> <tr> <td>Sat</td> <td>09/16</td> <td>Lindsey</td> <td>371</td> </tr> <tr> <td>Sun</td> <td>09/17</td> <td>Susan</td> <td>272</td> </tr> </tbody> <tfoot> <tr> <th align="LEFT" colspan="3">Total</th> <th>4923</th> </tr> </tfoot> </table> 输出将是：

csv

<强>更新

The table that you're talking about已从其他网址加载：http://factfinder.census.gov/tablerestful/tableServices/renderProductData?renderForMap=f&renderForChart=f&pid=PEP_2014_PEPANNRES&src=pt&log=t&_ts=468903667318

它包含一个带有表格内容的Weekday,Date,Manager,Qty Mon,09/11,Kelsey,639 Tue,09/12,Lindsey,596 Wed,09/13,Randy,1135 Thu,09/14,Susan,1002 Fri,09/15,Randy,908 Sat,09/16,Lindsey,371 Sun,09/17,Susan,272 属性。