将数据从HTML提取到Java对象

时间:2018-02-14 11:48:12

标签: java html message

我有一个来自存储为HTML的消息传递应用程序的消息日志。在该文件中,以下列方式显示单个消息:

<div class="message">
  <div class="message_header">
    <span class="user">User Name</span>
    <span class="meta">10 february 2018 at 16:17 UTC+01</span>
  </div>
  <p>Message content</p>
</div>

消息没有很好地排列在文件中 - 每行可能有多条消息,有时行会在消息中间结束。

我想为文件中的每个项目创建一个类Message的实例,其中包含userNamedatemessageContent等字段。有没有优雅的方法来做到这一点?

我计划迭代文件并在每次新消息开始时拆分每一行,然后从字符串中获取数据,但如果有一种不那么繁琐的方法,我宁愿避免使用它。

2 个答案:

答案 0 :(得分:2)

我的答案可能不会对这个问题的作者有用(我迟到了5个月,所以我认为不是正确的时机),但我认为这可能对可能遇到此答案的许多其他开发人员有用。

今天,我刚刚发布了(以我公司的名义)一个HTML到POJO的完整框架,您可以使用该框架将HTML映射到任何带有简单批注的POJO类。该库本身非常方便,并且具有许多其他功能,同时可插拔。您可以在这里查看:https://github.com/whimtrip/jwht-htmltopojo

使用方法:基础知识

想象一下,我们需要解析以下html页面:

<html>
    <head>
        <title>A Simple HTML Document</title>
    </head>
    <body>
        <div class="restaurant">
            <h1>A la bonne Franquette</h1>
            <p>French cuisine restaurant for gourmet of fellow french people</p>
            <div class="location">
                <p>in <span>London</span></p>
            </div>
            <p>Restaurant n*18,190. Ranked 113 out of 1,550 restaurants</p>  
            <div class="meals">
                <div class="meal">
                    <p>Veal Cutlet</p>
                    <p rating-color="green">4.5/5 stars</p>
                    <p>Chef Mr. Frenchie</p>
                </div>

                <div class="meal">
                    <p>Ratatouille</p>
                    <p rating-color="orange">3.6/5 stars</p>
                    <p>Chef Mr. Frenchie and Mme. French-Cuisine</p>
                </div>

            </div> 
        </div>    
    </body>
</html>

让我们创建我们想要映射到的POJO:

public class Restaurant {

    @Selector( value = "div.restaurant > h1")
    private String name;

    @Selector( value = "div.restaurant > p:nth-child(2)")
    private String description;

    @Selector( value = "div.restaurant > div:nth-child(3) > p > span")    
    private String location;    

    @Selector( 
        value = "div.restaurant > p:nth-child(4)"
        format = "^Restaurant n\*([0-9,]+). Ranked ([0-9,]+) out of ([0-9,]+) restaurants$",
        indexForRegexPattern = 1,
        useDeserializer = true,
        deserializer = ReplacerDeserializer.class,
        preConvert = true,
        postConvert = false
    )
    // so that the number becomes a valid number as they are shown in this format : 18,190
    @ReplaceWith(value = ",", with = "")
    private Long id;

    @Selector( 
        value = "div.restaurant > p:nth-child(4)"
        format = "^Restaurant n\*([0-9,]+). Ranked ([0-9,]+) out of ([0-9,]+) restaurants$",
        // This time, we want the second regex group and not the first one anymore
        indexForRegexPattern = 2,
        useDeserializer = true,
        deserializer = ReplacerDeserializer.class,
        preConvert = true,
        postConvert = false
    )
    // so that the number becomes a valid number as they are shown in this format : 18,190
    @ReplaceWith(value = ",", with = "")
    private Integer rank;

    @Selector(value = ".meal")    
    private List<Meal> meals;

    // getters and setters

}

现在还有Meal类:

public class Meal {

    @Selector(value = "p:nth-child(1)")
    private String name;

    @Selector(
        value = "p:nth-child(2)",
        format = "^([0-9.]+)\/5 stars$",
        indexForRegexPattern = 1
    )
    private Float stars;

    @Selector(
        value = "p:nth-child(2)",
        // rating-color custom attribute can be used as well
        attr = "rating-color"
    )
    private String ratingColor;

    @Selector(
        value = "p:nth-child(3)"
    )
    private String chefs;

    // getters and setters.
}

我们在github页面上对上述代码提供了更多解释。

目前,让我们看看如何将其废弃。

private static final String MY_HTML_FILE = "my-html-file.html";

public static void main(String[] args) {


    HtmlToPojoEngine htmlToPojoEngine = HtmlToPojoEngine.create();

    HtmlAdapter<Restaurant> adapter = htmlToPojoEngine.adapter(Restaurant.class);

    // If they were several restaurants in the same page, 
    // you would need to create a parent POJO containing
    // a list of Restaurants as shown with the meals here
    Restaurant restaurant = adapter.fromHtml(getHtmlBody());

    // That's it, do some magic now!

}


private static String getHtmlBody() throws IOException {
    byte[] encoded = Files.readAllBytes(Paths.get(MY_HTML_FILE));
    return new String(encoded, Charset.forName("UTF-8"));

}

可以找到另一个简短的示例here

希望这会帮助某个人!

答案 1 :(得分:0)

您可以将HTML视为XML,并将dom包用于java https://docs.oracle.com/javase/tutorial/jaxp/dom/readingXML.html 或者你可以用JAXB解组。

相关问题