Jsoup ArrayList和LinkedHashMap组合

时间:2015-06-03 19:17:29

标签: java android arraylist linkedhashmap

我编写的代码使用jsoup转到某个站点,查看所有段落标题,然后将它们保存到名为headingList的ArrayList中。这是棘手的部分。我有一张地图,以字符串作为键,ArrayLists作为值。代码的设计方式要求它转到多个页面。因此,标题数量可能会有很大变化,以及与标题相关的段落数量。所以,这里的想法是创建两个int值。在查看页面并确定有多少标题后,将设置一个名为headingAmt的int值。名为headCount的第二个int值初始化为值1.然后,我尝试做的是设置一个while循环,如下所示:while(headCount != headAmt + 1)并在循环结束时递增它这样当headCount经过每个标题时它就会终止。在while循环期间,我试图通过并将每个段落添加到名为items的ArrayList中,然后在itemsList中取出什么内容,然后将其设置为第一个项目的值。地图。然后,清除ArrayList,转到下一段,将那里的内容保存到items,然后将该ArrayList设置为地图中第二项的值,依此类推。我有可以发布的代码,但是由于有问题的while循环被重新排列了很多次,因为我无法使其正常工作,因此令人困惑。

在此处编辑代码以防任何人可以提供帮助:

public class Finder {

public Finder(String url) {
    String mainURL = "http://www.website.com";
    Map<String, List<String> > headMap  = new HashMap<>();
    ArrayList<String> headingList = new ArrayList<>();
    ArrayList<String> items = new ArrayList<>();
    int headCounter = 1;

    String itemList = "div > div:nth-child(1).category > ul:nth-child(2) > li.item > span";
    int headAmt;



    Document doc1 = null;


    ///// Connect to site to get menu /////
    try{
        doc1 = Jsoup.connect(url).userAgent("Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.135 Safari/537.36")
                .referrer("http://www.google.com")
                .get();
    }
    catch(IOException e){
        System.out.println("Can't connect to website");
    }

        /////// Get headings ////////
        Elements head = doc1.select("div > div > div > h3");

        ////// Loop through headings and add to ArrayList /////
        for(Element e: head){
            headingList.add(e.text());

        }
        headAmt = headingList.size();

        /*
        Here is the problem
         */

        while(headCounter != headAmt + 1){

            Elements elem = doc1.select("div > div:nth-child("+ headCounter +").category > ul:nth-child(2) > li.item > span");


            for (String key : headingList) {
                for(Element e : elem){
                items.add(e.text());
                }

                List<String> value = new ArrayList<>(items);
                headMap.put(key, value);
            }

            items.clear();
            headCounter++;
            }
            }
        }
    }
}

1 个答案:

答案 0 :(得分:1)

您可以尝试这样的事情:

public class Finder {
public static void main(String[] args) {
    new Finder(
            "http://www.allmenus.com/ny/new-york/250087-forlinis-restaurant/menu/");
}

public Finder(String url) {
    Document doc1 = null;
    try {
        doc1 = Jsoup
                .connect(url)
                .userAgent(
                        "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.135 Safari/537.36")
                .referrer("http://www.google.com").get();
    } catch (IOException e) {
        System.out.println("Can't connect to website");
    }
    Elements elements = doc1.select(".category");
    HashMap<String, ArrayList<List<String>>> menu = new HashMap<String, ArrayList<List<String>>>();
    for (Element e : elements) {
        String name = e.select(".category_head>h3").first().text();
        Elements itms = e.select("ul > li");
        ArrayList<List<String>> menuItems = new ArrayList<List<String>>();
        for (Element it : itms) {
            menuItems.add(Arrays.asList(new String[] {
                    it.select("span").first().text(),
                    it.select("span").eq(1).text() }));
        }
        menu.put(name, menuItems);

    }
    for (String key : menu.keySet()) {
        System.out.println(key);
        ArrayList<List<String>> lst = menu.get(key);
        for (List<String> item : lst) {
            System.out.println("       " + item.get(0) + " " + item.get(1));
        }
        System.out.println("\n");
    }
}
}