我有以下的html片段。我想通过网页抓取页面来获取主题和子主题并将其存储在对象中。
期望的结果是:
{
'topic': 'Java Basics',
'subtopics':['Define the scope of variables', 'Define the structure of a Java class', ...]
}
我尝试使用Jsdom for Node.js和JQuery:
var jsdom = require('jsdom');
var fs = require("fs");
var topicos = fs.readFileSync("topic.html", "utf-8");
jsdom.env(topicos, ["http://code.jquery.com/jquery.js"], function (error, window) {
var $ = window.$;
var length = $('div ~ ').each(function () {
//???
var topic = $(this);
var text = topic.text();
console.log(text.trim())
});
})
但由于我缺乏jQuery的经验,我无法正确组织层次结构。
Html片段:
<div>
<strong>Java Basics </strong></div>
<ul>
<li>
Define the scope of variables </li>
<li>
Define the structure of a Java class
</li>
<li>
Create executable Java applications with a main method; run a Java program from the command line; including
console output.
</li>
<li>
Import other Java packages to make them accessible in your code
</li>
<li>
Compare and contrast the features and components of Java such as:
platform independence, object orientation, encapsulation, etc.
</li>
</ul>
<div>
<strong>Working With Java Data Types </strong></div>
<ul>
<li>
Declare and initialize variables (including casting of primitive data types)
</li>
<li>
Differentiate between object reference variables and primitive variables
</li>
<li>
Know how to read or write to object fields
</li>
<li>
Explain an Object's Lifecycle (creation, "dereference by reassignment" and garbage collection)
</li>
<li>
Develop code that uses wrapper classes such as Boolean, Double, and Integer. </li>
</ul>
...
答案 0 :(得分:1)
以下是工作代码段fiddle
jQuery('.js-topic-data').each(function(){
var data = {};
var jThis = jQuery(this);
data.topic = jThis.find('.js-topic').text();
data.subtopics = [];
jThis.next('.js-sub-topic').each(function(){
var jThis = jQuery(this);
data.subtopics.push(jThis.text());
});
topicos.push(data);
});
但我强烈建议您在标记中添加类,并将它们用作选择器而不是标记名称:
id
然后你可以这样做:
tbl1
对于标记更改等更加健壮