我有这个包含2000多个短语的XML文件,下面是一个小样本。
<TEXT>
<PHRASE>
<V>played</V>
<N>John</N>
<PREP>with</PREP>
<en x='PERS'>Adam</en>
<PREP>in</PREP>
<en x='LOC'> ASL school/en>
</PHRASE>
<PHRASE>
<V y='0'>went</V>
<en x='PERS'>Mark</en>
<PREP>to</PREP>
<en x='ORG>United Nations</en>
<PREP>for</PREP>
<PREP>a</PREP>
<N>visit</N>
</PHRASE>
<PHRASE>
<PREP>in</PREP>
<en x='DATE'>1987</en>
<en x='PERS'>Nick</en>
<V>founded</V>
<en x='ORG'>XYZ company</en>
</PHRASE>
<PHRASE>
<en x='ORG'>Google's</en>
<en x='PERS'>Frank</en>
<V>went</V>
<N>yesterday</N>
<PREP>to</PREP>
<en x='LOC'>San Fransisco/en>
</PHRASE>
</TEXT>
我有一个模式列表:
finalPatterns=['went \n to \n','created\n the\n', 'founded\n a\n', 'went\n yesterday\n to\n', 'a\n visit\n', 'founded\n in\n']
我想要的是以每个finalPattern为例:转到并在文本中的每个短语中搜索它的存在,如果任何短语同时包含 AND < strong> to 然后打印出2 <en>
个标签。 [如果en标签不等于PERS&amp; ORG没有打印]
搜索时:
-"went" & "to" --> this is the output: Frank -San Fransisco
-"founded" & "in" --> output: Nick-XYZ Company
这就是我所做的,但它没有奏效。什么都没打印出来。
for phrase in root.findall('./PHRASE'):
ens = {en.get('x'): en.text for en in phrase.findall('en')}
if 'ORG' in ens and 'PERS' in ens:
if all(word in phrase for word in finalPatterns):
x="".join(phrase.itertext()) #print whats in between [since I would also like to print the whole sentence]
print("ORG is: {}, PERS is: {} /".format(ens["ORG"],ens["PERS"]))
答案 0 :(得分:1)
在处理搜索时考虑XSLT(操作XML文档的专用语言),根据匹配的值重写原始xml。
下面的XSLT嵌入在Python中,使用finalPatterns
列表动态删除不匹配的元素。从那里,Python可以转换(使用lxml
模块)原始文档,然后使用这样的输出来满足最终用途需求。
Python 脚本
import lxml.etree as ET
finalPatterns=['went \n to \n','created\n the\n', 'founded\n a\n', 'went\n yesterday\n to\n', 'a\n visit\n', 'founded\n in\n']
# BUILDING XSLT FILTER STRING
contains = ''
for p in finalPatterns:
contains += "("
for i in p.split('\n '):
contains += "contains(., '{}') and \n".format(i.replace('\n', '').strip(' '))
contains += ")"
contains = contains.replace(' and \n)', ') or ')
xslstr = '''<xsl:transform xmlns:xsl="http://www.w3.org/1999/XSL/Transform" version="1.0">
<xsl:output version="1.0" encoding="UTF-8" indent="yes" />
<xsl:strip-space elements="*"/>
<!-- Identity Transform -->
<xsl:template match="@*|node()">
<xsl:copy>
<xsl:apply-templates select="@*|node()"/>
</xsl:copy>
</xsl:template>
<!-- Rewrites Matching Phrase elements -->
<xsl:template match="PHRASE">
<xsl:copy>
<wholetext>
<xsl:call-template name="join">
<xsl:with-param name="valueList" select="*"/>
<xsl:with-param name="separator" select="' '"/>
</xsl:call-template>
</wholetext>
<xsl:choose>
<xsl:when test="contains(., 'went') = True and contains(., 'to') = True">
<match>went to</match>
</xsl:when>
<xsl:when test="contains(., 'founded') = True and contains(., 'in') = True">
<match>founded in</match>
</xsl:when>
<xsl:when test="contains(., 'created') = True and contains(., 'the') = True">
<match>created the</match>
</xsl:when>
<xsl:otherwise test="contains(., 'a') = True and contains(., 'visit') = True">
<match>a visit</match>
</xsl:otherwise>
</xsl:choose>
<person><xsl:value-of select="en[@x='PERS']"/></person>
<organization><xsl:value-of select="en[@x='ORG']"/></organization>
<location><xsl:value-of select="en[@x='LOC']"/></location>
</xsl:copy>
</xsl:template>
<!-- Rewrites Unmatched Phrase elements -->
<xsl:template match="PHRASE[not({0})]"/>
<!-- Join Text values -->
<xsl:template name="join">
<xsl:param name="valueList" select="''"/>
<xsl:param name="separator" select="','"/>
<xsl:for-each select="$valueList">
<xsl:choose>
<xsl:when test="position() = 1">
<xsl:value-of select="."/>
</xsl:when>
<xsl:otherwise>
<xsl:value-of select="concat($separator, .) "/>
</xsl:otherwise>
</xsl:choose>
</xsl:for-each>
</xsl:template>
</xsl:transform>'''.format(contains[:-4])
dom = ET.parse(os.path.join(cd, 'SearchWords.xml'))
xslt = ET.fromstring(xslstr)
transform = ET.XSLT(xslt)
newdom = transform(dom)
tree_out = ET.tostring(newdom, encoding='UTF-8', pretty_print=True)
print(tree_out.decode("utf-8"))
for phrase in newdom.findall('PHRASE'):
print("Text: {} \n ORG is: {}, PERS is: {} /".format(phrase.find('wholetext').text,
phrase.find('organization').text,
phrase.find('person').text))
<强>输出强>
下面包含用于演示的转换后的xml。 tree_out
字符串可以在外部保存为新的xml文件。
<TEXT>
<PHRASE>
<wholetext>went Mark to United Nations for a visit</wholetext>
<person>Mark</person>
<organization>United Nations</organization>
<location/>
</PHRASE>
<PHRASE>
<wholetext>in 1987 Nick founded XYZ company</wholetext>
<person>Nick</person>
<organization>XYZ company</organization>
<location/>
</PHRASE>
<PHRASE>
<wholetext>Google's Frank went yesterday to San Fransisco</wholetext>
<person>Frank</person>
<organization>Google's</organization>
<location>San Fransisco</location>
</PHRASE>
</TEXT>
Text: went Mark to United Nations for a visit
ORG is: United Nations, PERS is: Mark /
Text: in 1987 Nick founded XYZ company
ORG is: XYZ company, PERS is: Nick /
Text: Google's Frank went yesterday to San Fransisco
ORG is: Google's, PERS is: Frank /
列表理解
使用xpath
查看列表理解尝试。但是,挑战是你的finalPatterns
在一致的比赛中不匹配。例如,文字可以使用went \n to
之间的单词,如went \n Mark \n to
。如果您只为列表中的每个元素包含一个关键字,则下面的内容可以正常工作。否则请考虑regex进行模式识别。
dom = ET.parse(os.path.join(cd, 'Input.xml'))
phraselist = dom.xpath('//PHRASE')
for phrase in phraselist:
if any(word in p for p in phrase.xpath('./*/text()') for word in finalPatterns):
print(' '.join(phrase.xpath('./*/text()')))
print('ORG is: {0}, PERS is: {1}'.format(phrase.xpath("./en[@x='ORG']")[0].text, \
phrase.xpath("./en[@x='PERS']")[0].text))
答案 1 :(得分:1)
这应该可以解决问题:
phrasewords = [w.text for w in phrase.findall('V')+phrase.findall('N')+phrase.findall('PREP')]
for words in finalPatterns:
if all(word in phrasewords for word in words.split()):
print "found"