如何使用HTML :: TreeBuilder解析html?

时间:2014-09-25 20:44:14

标签: perl html-treebuilder

这是我要解析的代码

[...]
<div class="item" style="clear:left;">
 <div class="icon" style="background-image:url(http://nwn2db.com/assets/builder/icons/40x40/is_acidsplash.png);">
 </div>
  <h2>Acid Splash</h2>
   <p>Caster Level(s): Wizard / Sorcerer 0
   <br />Innate Level: 0
   <br />School: Conjuration
   <br />Descriptor(s): Acid
   <br />Component(s): Verbal, Somatic
   <br />Range: Medium
   <br />Area of Effect / Target: Single
   <br />Duration: Instant
   <br />Save: None
   <br />Spell Resistance: Yes
   <p>
   You fire a small orb of acid at the target for 1d3 points of acid damage.
 </div>
[...]

这是我的算法:

my $text = '';

scan_child($spells);

print $text, "\n";

sub scan_child {
  my $element = $_[0];
  return if ($element->tag eq 'script' or
             $element->tag eq 'a');   # prune!
  foreach my $child ($element->content_list) {
    if (ref $child) {  # it's an element
      scan_child($child);  # recurse!
    } else {           # it's a text node!
      $child =~ s/(.*)\:/\\item \[$1\]/; #itemize
      $text .= $child;
      $text .= "\n";
    }
   }
  return;
}

它获取模式<key> : <value>并修剪像<script><a>...</a>这样的垃圾。 我想改进它以获得<h2>...</h2>标题和所有<p>...<p>块,以便我可以添加一些LaTeX标记。

有任何线索吗?

提前致谢。

2 个答案:

答案 0 :(得分:0)

因为这可能是XY问题......

Mojo::DOM是一个更现代的框架,用于使用css选择器解析HTML。以下内容从文档中提取您想要的P元素:

use strict;
use warnings;

use Mojo::DOM;

my $dom = Mojo::DOM->new(do {local $/; <DATA>});

for my $h2 ($dom->find('h2')->each) {
    next unless $h2->all_text eq 'Acid Splash';

    # Get following P
    my $next_p = $h2;
    while ($next_p = $next_p->next_sibling()) {
        last if $next_p->node eq 'tag' and $next_p->type eq 'p';
    }

    print $next_p;
}

__DATA__
<html>
<body>
<div class="item" style="clear:left;">
 <div class="icon" style="background-image:url(http://nwn2db.com/assets/builder/icons/40x40/is_acidsplash.png);">
 </div>
  <h2>Acid Splash</h2>
   <p>Caster Level(s): Wizard / Sorcerer 0
   <br />Innate Level: 0
   <br />School: Conjuration
   <br />Descriptor(s): Acid
   <br />Component(s): Verbal, Somatic
   <br />Range: Medium
   <br />Area of Effect / Target: Single
   <br />Duration: Instant
   <br />Save: None
   <br />Spell Resistance: Yes
   <p>
   You fire a small orb of acid at the target for 1d3 points of acid damage.
 </div>
 </body>
 </html>

输出:

<p>Caster Level(s): Wizard / Sorcerer 0
   <br>Innate Level: 0
   <br>School: Conjuration
   <br>Descriptor(s): Acid
   <br>Component(s): Verbal, Somatic
   <br>Range: Medium
   <br>Area of Effect / Target: Single
   <br>Duration: Instant
   <br>Save: None
   <br>Spell Resistance: Yes
   </p>

答案 1 :(得分:0)

我使用look_down()方法扫描HTML。 使用look_down()我可以先返回获取class =“item”的所有div的列表。

然后我可以对它们进行迭代,找到并处理h2p,我将使用//作为我的分割器进行分割。