从xml文件中提取数据

时间:2013-03-29 11:28:34

标签: xml perl sed awk text-processing

我有一个包含数千个条目的xml文件,例如:

<gml:featureMember>
<Feature>
<featureType>JCSOutput</featureType>
<property name="gml2_coordsys"></property>
<gml:PointProperty>
                <gml:Point>
                  <gml:coordinates>4048313.294966287,5374397.792158723 </gml:coordinates>
                </gml:Point>

</gml:PointProperty>
<property name="BEZEICHNUN">Anton-Bosch-Gasse</property>
<property name="WL_NUMMER">68</property>
</Feature>
</gml:featureMember>


<gml:featureMember>
<Feature>
<featureType>JCSOutput</featureType>
<property name="gml2_coordsys"></property>
<gml:PointProperty>
                <gml:Point>
                  <gml:coordinates>4044355.0231338665,5365146.95116724 </gml:coordinates>
                </gml:Point>

</gml:PointProperty>
<property name="BEZEICHNUN">Anschützgasse</property>
<property name="WL_NUMMER">67</property>
</Feature>
</gml:featureMember>

脚本应搜索列表中给出的名称(例如Anton-Bosch-Gasse)并将以<gml:featureMember>开头的整段复制到新文件

你会为此目的使用什么 - awk,sed,perl?

3 个答案:

答案 0 :(得分:5)

Sed和awk不是解析XML的正确工具。伸手去拿Perl:

#!/usr/bin/perl
use warnings;
use strict;

use XML::LibXML;

my $search = 'Anton-Bosch-Gasse';

# Put your real values here!
my $file = '1.xml';
my $uri  = 'http://1.2.3';

my $xpc = XML::LibXML::XPathContext->new;
$xpc->registerNs('gml', $uri);

my $xml = XML::LibXML->load_xml(location => $file);
my $r = $xml->find("//property[.='$search']/ancestor::gml:featureMember");
print $_->serialize for @$r;

或者,如果您发现上述示例过于冗长,则可以使用xsh

my $search = 'Anton-Bosch-Gasse' ;
register-namespace gml http://1.2.3 ; # Insert the real URI.
open 1.xml ;                          # Insert the real path.
ls //property[.=$search]/ancestor::gml:featureMember ;

答案 1 :(得分:3)

使用xml_grep附带的XML::Twig,您可以编写

$ xml_grep --root 'gml:featureMember' \
--cond 'property[string()="Anton-Bosch-Gasse"]' \
to_grep.xml > extract.xml

答案 2 :(得分:1)

这是一个类似choroba的解决方案,但使用Mojolicious套件。它的模块Mojo::DOM使用css3选择器而不是xpath遍历XML。

在这里,我首先找到所有gml:featureMember元素,然后提取第一个具有匹配后代的元素。

#!/usr/bin/env perl

use strict;
use warnings;

use Mojo::DOM;
use Mojo::Util qw/slurp spurt/;

my $dom = Mojo::DOM->new->xml(1);

# read in from file
# $dom->parse( slurp 'myfile.xml' );
# but for the demo ...
$dom->parse(do{ local $/; <DATA> });

my $found = 
  $dom->find('gml\:featureMember')
      ->first(sub{ 
        $_->find('property[name="BEZEICHNUN"]')
          ->first( qr/\QAnton-Bosch-Gasse/ )
      });

spurt "$found", 'output.xml';


__DATA__
<gml:featureMember>
<Feature>
<featureType>JCSOutput</featureType>
<property name="gml2_coordsys"></property>
<gml:PointProperty>
                <gml:Point>
                  <gml:coordinates>4048313.294966287,5374397.792158723 </gml:coordinates>
                </gml:Point>

</gml:PointProperty>
<property name="BEZEICHNUN">Anton-Bosch-Gasse</property>
<property name="WL_NUMMER">68</property>
</Feature>
</gml:featureMember>


<gml:featureMember>
<Feature>
<featureType>JCSOutput</featureType>
<property name="gml2_coordsys"></property>
<gml:PointProperty>
                <gml:Point>
                  <gml:coordinates>4044355.0231338665,5365146.95116724 </gml:coordinates>
                </gml:Point>

</gml:PointProperty>
<property name="BEZEICHNUN">Anschützgasse</property>
<property name="WL_NUMMER">67</property>
</Feature>
</gml:featureMember>

对于这个例子,我从DATA部分获取XML。您可以使用注释的代码从文件中解析。

如果您确定该属性在结构中的两个深度,您也可以更有效率。

my $found = 
  $dom->find('gml\:featureMember property[name="BEZEICHNUN"]')
      ->first( qr/\QAnton-Bosch-Gasse/ )
      ->parent
      ->parent;