使用Python将子节点输出为CSV

时间:2018-04-18 12:56:40

标签: python xml csv xml-parsing

编辑:我已用实际数据替换了示例XML,并在底部提供了我的代码。

我有几个包含1到10行以下数据的xml文件:

<?xml version="1.0" encoding="UTF-8"?>
<Invoice xmlns="urn:oasis:names:specification:ubl:schema:xsd:Invoice-2" xmlns:cac="urn:oasis:names:specification:ubl:schema:xsd:CommonAggregateComponents-2" xmlns:cbc="urn:oasis:names:specification:ubl:schema:xsd:CommonBasicComponents-2" xmlns:cec="urn:oasis:names:specification:ubl:schema:xsd:CommonExtensionComponents-2" xmlns:soapenv="http://www.w3.org/2003/05/soap-envelope" xmlns:wsu="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-utility-1.0.xsd" xmlns:xenc="http://www.w3.org/2001/04/xmlenc#" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="urn:oasis:names:specification:ubl:schema:xsd:Invoice-2 UBL-Invoice-2.0.xsd">
   <cac:LegalMonetaryTotal>
      <cbc:PayableAmount currencyID="DKK">2586.61</cbc:PayableAmount>
   </cac:LegalMonetaryTotal>
   <cac:InvoiceLine>
      <cbc:ID>1</cbc:ID>
      <cbc:InvoicedQuantity unitCode="HUR">1.50</cbc:InvoicedQuantity>
      <cbc:LineExtensionAmount currencyID="DKK">1633.65</cbc:LineExtensionAmount>
   </cac:InvoiceLine>
   <cac:InvoiceLine>
      <cbc:ID>2</cbc:ID>
      <cbc:InvoicedQuantity unitCode="HUR">1.00</cbc:InvoicedQuantity>
      <cbc:LineExtensionAmount currencyID="DKK">952.96</cbc:LineExtensionAmount>
   </cac:InvoiceLine>
</Invoice>

我想以下列结构将数据输出到CSV文件:

filename,lineId,lineQuantity,lineAmount,payableAmount
file1,1,1.50,1633.65,2586.61
file1,2,1.00,952.96,2586.61
file2,.,.,.

...每个文件的每一行都有一行,加上文件名和总金额。

这是我的代码:

from os import listdir, path, walk
import xml.etree.ElementTree as ET
import csv

def invoicelines(self):
    filename = path.splitext(path.split(file)[1])[0]
    lineId = root.find('./InvoiceLine/ID').text
    lineQuantity = root.find('./InvoiceLine/InvoicedQuantity').text
    lineAmount = root.find('./InvoiceLine/LineExtensionAmount').text
    payableAmount = root.find('./LegalMonetaryTotal/PayableAmount').text

    row = [
        filename,
        lineId,
        lineQuantity,
        lineAmount,
        payableAmount
        ]

    return row

csvfile = 'output.csv'

def csv_write_header(csvfile):
     with open(csvfile, 'w', newline='') as outfile:
          writer = csv.writer(outfile)
          writer.writerow([
               'filename',
               'lineId',
               'lineQuantity',
               'lineAmount',
               'payableAmount'
               ])

xml_files = []
for root, dirs, files in walk('mypath'):
    for file in files:
        if file.endswith('.xml'):
            xml_files.append(path.join(root, file))
            csv_write_header(csvfile)

for file in xml_files:
    tree = ET.iterparse(file)
    for _, el in tree:
        el.tag = el.tag.split('}', 1)[1] # ignores namespaces
    root = tree.root
    if 'Invoice' in root.tag: # only invoice files
        for e in root.iter('InvoiceLine'):
            with open(csvfile, 'a', newline='') as outfile:
                writer = csv.writer(outfile)
                writer.writerow(invoicelines(e))

如果我只解析上面的文件,我得到的输出是:

filename,lineId,lineQuantity,lineAmount,payableAmount
file1,1,1.50,1633.65,2586.61
file1,1,1.50,1633.65,2586.61

...所以我猜这是我的迭代。

2 个答案:

答案 0 :(得分:2)

以下代码可以达到您想要的效果。

import os
import xml.etree.ElementTree as ET


def extract_line_id_data(line_element):
    line_id = line_element[0].text
    quantity = line_element[1].text
    line_amount = line_element[2].text

    return line_id, quantity, line_amount


# Iterate over all files in a directory
for _, dirs, files in os.walk('/path/to_folder/with/xml_files/'):
    with open('output.csv', 'a') as output:
        output.write('Filename,LineID,Quantity,LineAmount,TotalAmount\n')  # Headers
        for xml_file in files:
            # If not all files in the folder files are XML you'll need to catch an exception here
            tree = ET.parse(xml_file)  # might need to use os.path.abspath
            root = tree.getroot()
            total_amount = root[0][0].text  # Get total amount value
            # Iterate over all "Line" elements
            for e in root[1:]:
                output.write('{},{},{},{},{}\n'.format(xml_file, * extract_line_id_data(e), total_amount))

使用您的文件和TotalAmount为350的“file2.xml”进行测试,输出如下所示:

Filename,LineID,Quantity,LineAmount,TotalAmount
file.xml,1,4,132,407
file.xml,2,1,72,407
file.xml,3,7,203,407
file2.xml,1,4,132,350
file2.xml,2,1,72,350
file2.xml,3,7,203,350

我希望这适合你。我已经使用了ElementTree作为首选,尽管我本人也会使用lxml

答案 1 :(得分:-1)

请尝试以下代码:

using System;
using System.Collections.Generic;
using System.Linq;
using System.Text;
using System.Data;
using System.Xml;
using System.Xml.Linq;
using System.IO;

namespace ConsoleApp2

{

    class Program
    {
        const string FILENAME = @"c:\temp\text.csv";
        static void Main()
        {

            string[] filenames = Directory.GetFiles(@"c:\temp", "*.xml");
            StreamWriter writer = new StreamWriter(FILENAME);

            foreach (string filename in filenames)
            {
                XDocument doc = XDocument.Load(filename);

                string amount = (string)doc.Descendants("TotalAmount").FirstOrDefault();

                foreach (XElement line in doc.Descendants("Line"))
                {
                    writer.WriteLine(string.Join(",",
                        filename,
                        (string)line.Element("LineID"),
                        (string)line.Element("Quantity"),
                        (string)line.Element("LineAmount"),
                        amount));
                }
            }
            writer.Flush();
            writer.Close();
        }
    }


}