Question

我尝试使用来自marvel数据库wikia的数据提取来填充本体（您可以提取包含Wiki的所有信息的xml）。我的问题是这个xml太重了，无法用它做任何事情（超过500Mo）。我尝试使用xslt将其转换为更简单的rdf文件，但由于xml文件大小，这是非常不可能的。

xml文档由以下页面构成：

<page>
<title>Aeroika (Earth-616)</title>
<ns>0</ns>
<id>1035</id>
  <sha1>11t0be5viqp0vsj8zwglfu3wea8fou4</sha1>
<revision>
  <id>1786343</id>
  <timestamp>2011-10-04T17:49:37Z</timestamp>
  <contributor>
    <username>HamsterMan</username>
    <id>2082346</id>
  </contributor>
  <minor/>
  <text xml:space="preserve" bytes="1652">{{Marvel Database:Character Template
| Image                   = Aeroika (Earth-616).jpg
| RealName                = Aeroika
| CurrentAlias            = Aeroika
| Aliases                 = 
| Identity                = 
| Affiliation             = [[Defenders (Earth-616)|Defenders]]
| Relatives               = 
| Universe                = Earth-616
| BaseOfOperations        = [[Tunnelworld]]

| Gender                  = Male
| Height                  = 
| Weight                  = 
| Eyes                    = 
| Hair                    = Gold
| UnusualSkinColour       = Gold
| UnusualFeatures         = Wings growing out of his head.
}}
[[Category:Flight]]</text>
</revision>
</page>

例如，在这种情况下，我做了一个xslt，它在rdf中提取重要的数据。

<xsl:template match="/">
<rdf:RDF
xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
xmlns:si="http://www.w3schools.com/rdf/">

<xsl:for-each select="page">
    <xsl:choose>
        <xsl:when test="contains(revision/text, 'Character Template')">
            <rdf:Description rdf:about="{title}">
                <Image><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Image'),'|'),'=')" /></Image>
                <RealName><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'RealName'),'|'),'=')" /></RealName>
                <CurrentAlias><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'CurrentAlias'),'|'),'=')" /></CurrentAlias>
                <Aliases><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Aliases'),'|'),'=')" /></Aliases>
                <Identity><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Identity'),'|'),'=')" /></Identity>
                <Affiliation><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Affiliation'),'|'),'=')" /></Affiliation>
                <Relatives><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Relatives'),'|'),'=')" /></Relatives>
                <Universe><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Universe'),'|'),'=')" /></Universe>
                <BaseOfOperations><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'BaseOfOperations'),'|'),'=')" /></BaseOfOperations>
                <Gender><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Gender'),'|'),'=')" /></Gender>
                <Height><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Height'),'|'),'=')" /></Height>
                <Weight><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Weight'),'|'),'=')" /></Weight>
                <Eyes><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Eyes'),'|'),'=')" /></Eyes>
                <Hair><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Hair'),'|'),'=')" /></Hair>
                <UnusualSkinColour><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'UnusualSkinColour'),'|'),'=')" /></UnusualSkinColour>
                <UnusualFeatures><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'UnusualFeatures'),'|'),'=')" /></UnusualFeatures>
                <Citizenship><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Citizenship'),'|'),'=')" /></Citizenship>
                <MaritalStatus><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'MaritalStatus'),'|'),'=')" /></MaritalStatus>
                <Occupation><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Occupation'),'|'),'=')" /></Occupation>
                <Education><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Education'),'|'),'=')" /></Education>
                <Origin><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Origin'),'|'),'=')" /></Origin>
                <PlaceOfBirth><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'PlaceOfBirth'),'|'),'=')" /></PlaceOfBirth>
                <Creators><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Creators'),'|'),'=')" /></Creators>
                <First><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'First'),'|'),'=')" /></First>
                <HistoryText><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'HistoryText'),'|'),'=')" /></HistoryText>
                <Powers><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Powers'),'|'),'=')" /></Powers>
                <Abilities><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Abilities'),'|'),'=')" /></Abilities>
                <Strength><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Strength'),'|'),'=')" /></Strength>
                <Weaknesses><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Weaknesses'),'|'),'=')" /></Weaknesses>
                <Equipement><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Equipement'),'|'),'=')" /></Equipement>
                <Transportation><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Transportation'),'|'),'=')" /></Transportation>      
                <Weapons><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Weapons'),'|'),'=')" /></Weapons>
            </rdf:Description>
        </xsl:when>
        <xsl:otherwise>
        </xsl:otherwise>
    </xsl:choose>
</xsl:for-each>
</rdf:RDF>
</xsl:template>

</xsl:stylesheet>

你知道我该怎么做吗？感谢

Answer 1

您的XSLT样式表将“普通”XML转换为RDF / XML语法 - 这将同样大或甚至更大，并且几乎同样难以处理。而且，RDF / XML手工编写很复杂，容易出错。调试你的XSLT将是一场噩梦。

如果您的目标是使数据集更紧凑，更易于处理，我建议您将XML转换为RDF Turtle或RDF N-Triples语法。这些是非常简单，紧凑的基于文本的格式，非常适合流处理，任何支持RDF的软件都能够读取和写入这些格式。

您可以使用XSLT，或者如果这给您带来可伸缩性问题，请使用任何具有一些基本XML支持的编程/脚本语言 - 获取流式XML解析器并挂钩处理解析器输出并创建RDF数据的简单脚本/程序苍蝇或者，鉴于您的输入XML是相当规则的结构，您甚至可以完全跳过使用XML解析器，只需将几个正则表达式混合在一起读取数据 - 无论您最熟悉哪种技术。

当然，你也可以尝试使用一些最终用户工具，内置支持这种东西。例如，Topbraid Composer具有开箱即用的这种转换的一些奇特功能。

通过将巨大的xml文件转换为rdf来填充Ontology

1 个答案: