在使用Python和xml.etree.ElementTree解析XML时遇到一些挑战

时间:2018-07-26 17:46:53

标签: python xml python-3.x elementtree

<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<feed xml:base="https://share.corp.com/sites/CPIBudget/_vti_bin/ListData.svc/" xmlns:d="http://schemas.microsoft.com/ado/2007/08/dataservices" xmlns:m="http://schemas.microsoft.com/ado/2007/08/dataservices/metadata" xmlns="http://www.w3.org/2005/Atom">
  <title type="text">Tbl_Projects_Tableau</title>
  <id>https://share.corp.com/sites/CPIBudget/_vti_bin/ListData.svc/Tbl_Projects_Tableau/</id>
  <updated>2018-07-25T21:27:59Z</updated>
  <link rel="self" title="Tbl_Projects_Tableau" href="Tbl_Projects_Tableau" />
  <entry m:etag="W/&quot;8&quot;">
    <id>https://share.corp.com/sites/CPIBudget/_vti_bin/ListData.svc/Tbl_Projects_Tableau(1)</id>
    <title type="text"></title>
    <updated>2018-06-14T17:15:27Z</updated>
    <author>
      <name />
    </author>
    <link rel="edit" title="Tbl_Projects_TableauItem" href="Tbl_Projects_Tableau(1)" />
    <link rel="http://schemas.microsoft.com/ado/2007/08/dataservices/related/FBN_ID" type="application/atom+xml;type=entry" title="FBN_ID" href="Tbl_Projects_Tableau(1)/FBN_ID" />
    <link rel="http://schemas.microsoft.com/ado/2007/08/dataservices/related/CreatedBy" type="application/atom+xml;type=entry" title="CreatedBy" href="Tbl_Projects_Tableau(1)/CreatedBy" />
    <link rel="http://schemas.microsoft.com/ado/2007/08/dataservices/related/ModifiedBy" type="application/atom+xml;type=entry" title="ModifiedBy" href="Tbl_Projects_Tableau(1)/ModifiedBy" />
    <category term="Microsoft.SharePoint.DataService.Tbl_Projects_TableauItem" scheme="http://schemas.microsoft.com/ado/2007/08/dataservices/scheme" />
    <content type="application/xml">
      <m:properties>
        <d:FBN_IDId m:type="Edm.Int32">6</d:FBN_IDId>
        <d:Title m:null="true" />
        <d:PROJECT_NAME>Project Swoop</d:PROJECT_NAME>
        <d:Cluster>ABC</d:Cluster>
        <d:PROJECT_SITE>ABC9</d:PROJECT_SITE>
        <d:PROJECT_ORIGINALAMT m:type="Edm.Double">500000</d:PROJECT_ORIGINALAMT>
        <d:PROJECT_ORG>Nookie</d:PROJECT_ORG>
        <d:PROJECT_GROUP>Smooth</d:PROJECT_GROUP>
        <d:c__OldID m:type="Edm.Double">1</d:c__OldID>
        <d:ContentTypeID>0x0100FD279BEBCF3C4F45BB75D6147D315C09</d:ContentTypeID>
        <d:Id m:type="Edm.Int32">1</d:Id>
        <d:ContentType>Item</d:ContentType>
        <d:Modified m:type="Edm.DateTime">2018-06-14T17:15:27</d:Modified>
        <d:Created m:type="Edm.DateTime">2018-06-14T16:58:50</d:Created>
        <d:CreatedById m:type="Edm.Int32">2</d:CreatedById>
        <d:ModifiedById m:type="Edm.Int32">2</d:ModifiedById>
        <d:Owshiddenversion m:type="Edm.Int32">8</d:Owshiddenversion>
        <d:Version>1.0</d:Version>
        <d:Path>/sites/SmoothBudget/Lists/Projects_Tableau1</d:Path>
      </m:properties>
    </content>
  </entry>
 </feed>

这是我尝试解析为CSV的XML示例。

到目前为止,这是我的代码:

import config
import csv
import pymysql
import requests
import xml.etree.ElementTree as ET
from requests_ntlm import HttpNtlmAuth

ssoUsername = config.username
ssoPassword = config.password

f = open(path+csvFile,'w',newline='')
csvwriter = csv.writer(f)
column_headers = ['FBN','Project_Name','Cluster','Site','OP2_USD','Type','Group']
csvwriter.writerow(column_headers)

rows = []
r2 = requests.get(project_url, auth=HttpNtlmAuth('ANT\\'+ssoUsername,ssoPassword), verify=False)
projectData = r2.content
etree2 = ET.fromstring(projectData)

#print(etree2.findall('.****'))

for element in etree2.findall(".****") :
    print(element.find('{http://schemas.microsoft.com/ado/2007/08/dataservices}FBN_IDId'))
    fbnKey2 = element.find('{http://schemas.microsoft.com/ado/2007/08/dataservices}FBN_IDId')
    FBN = fbnMap.get(fbnKey2)

所以在这一点上我无法获得'{http://schemas.microsoft.com/ado/2007/08/dataservices} FBN_IDId'元素的.text。无论我尝试使用哪种xPath,它总是会给我NoneType没有属性文本错误。

这是print(etree2.findall('。****'))的结果

[<Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}ContentTypeID' at 0x000001C4B7F31BD8>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Id' at 0x000001C4B7F31C28>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}ContentType' at 0x000001C4B7F31C78>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Modified' at 0x000001C4B7F31CC8>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Created' at 0x000001C4B7F31D18>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}CreatedById' at 0x000001C4B7F31D68>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}ModifiedById' at 0x000001C4B7F31DB8>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Owshiddenversion' at 0x000001C4B7F31E08>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Version' at 0x000001C4B7F31E58>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Path' at 0x000001C4B7F31EA8>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}FBN_IDId' at 0x000001C4B7F3ABD8>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Title' at 0x000001C4B7F3AB88>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}PROJECT_NAME' at 0x000001C4B7F3AB38>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Cluster' at 0x000001C4B7F3AA98>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}PROJECT_SITE' at 0x000001C4B7F3AA48>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}PROJECT_ORIGINALAMT' at 0x000001C4B7F3A9F8>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}PROJECT_ORG' at 0x000001C4B7F3A908>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}PROJECT_GROUP' at 0x000001C4B7F3A868>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}c__OldID' at 0x000001C4B7F3A8B8>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}ContentTypeID' at 0x000001C4B7F3A778>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Id' at 0x000001C4B7F3A728>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}ContentType' at 0x000001C4B7F3A6D8>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Modified' at 0x000001C4B7F3A138>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Created' at 0x000001C4B7F3A048>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}CreatedById' at 0x000001C4B7F3A638>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}ModifiedById' at 0x000001C4B7F3A5E8>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Owshiddenversion' at 0x000001C4B7F3A548>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Version' at 0x000001C4B7F3A598>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Path' at 0x000001C4B7F3A4F8>]

似乎我应该能够获得FBNIDId,但是我能做的最好的就是获得

None
<Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}FBN_IDId' at 0x000001C4B7F3ABD8>

,这将导致none类型错误。我唯一能够使它正常工作的唯一方法是:

for element in etree2.findall(".//{http://schemas.microsoft.com/ado/2007/08/dataservices}FBN_IDId") :
        fbnKey2 = element.text
        FBN = fbnMap.get(fbnKey2)

但是如果我这样做,那么我必须对我需要的每个元素执行此操作,然后弄清楚如何将它们全部合并为一行,然后循环遍历以添加所有行,这似乎是错误的。

建议?

2 个答案:

答案 0 :(得分:1)

也许您可以使用完整路径:

/feed/entry/content/m:properties/d:FBN_IDId

或:

/feed/entry/content/{http://schemas.microsoft.com/ado/2007/08/dataservices/metadata}properties/{http://schemas.microsoft.com/ado/2007/08/dataservices}FBN_IDId

答案 1 :(得分:0)

在您的循环中

for element in etree2.findall(".****") :

您正在遍历所有四个级别的所有元素。然后,对于每个这样的元素,在其子元素中搜索名为FBN_IDId的元素。这将找到任何五个向下的元素。

但是,没有任何此类元素。它们仅存在四个级别下。

也许您想遍历所有三个级别的元素,并寻找这些名为FBN_IDId的子元素?这可以通过删除循环中的*之一来完成:

for element in etree2.findall(".***") :

但是,此循环还会找到空的<name />元素。

也许写会更好

for element in etree2.findall(".//{http://schemas.microsoft.com/ado/2007/08/dataservices/metadata}properties") :

可以在任何深度循环遍历所有<m:properties>元素。