使用pandas组合/合并2个不同的Excel文件/工作表

时间:2014-08-20 08:37:30

标签: python excel pandas

我正在尝试合并两个不同的Excel文件。 (感谢帖子Import multiple excel files into python pandas and concatenate them into one dataframe

到目前为止,我的工作是:

import os
import pandas as pd

df = pd.DataFrame()

for f in ['c:\\file1.xls', 'c:\\ file2.xls']:
    data = pd.read_excel(f, 'Sheet1')
    df = df.append(data)

df.to_excel("c:\\all.xls")

这是他们的样子。

enter image description here

但是我想:

  1. 排除每个文件的最后几行(即File1.xls中的row4和row5; File2.xls中的row7和row8)。
  2. 添加一列(或覆盖A列)以指示数据的来源。
  3. 例如:

    enter image description here

    有可能吗?感谢。

2 个答案:

答案 0 :(得分:13)

对于num。 1,您可以按照here的说明指定skip_footer;或者,或者

data = data.iloc[:-2]

一旦你阅读了数据。

对于num。 2,你可以这样做:

from os.path import basename
data.index = [basename(f)] * len(data)

另外,将所有数据帧放在列表中然后最后concat可能会更好;类似的东西:

df = []
for f in ['c:\\file1.xls', 'c:\\ file2.xls']:
    data = pd.read_excel(f, 'Sheet1').iloc[:-2]
    data.index = [os.path.basename(f)] * len(data)
    df.append(data)

df = pd.concat(df)

答案 1 :(得分:2)

import os
import os.path
import xlrd
import xlsxwriter

file_name = input("Decide the destination file name in DOUBLE QUOTES: ")
merged_file_name = file_name + ".xlsx"
dest_book = xlsxwriter.Workbook(merged_file_name)
dest_sheet_1 = dest_book.add_worksheet()
dest_row = 1
temp = 0
path = input("Enter the path in DOUBLE QUOTES: ")
for root,dirs,files in os.walk(path):
    files = [ _ for _ in files if _.endswith('.xlsx') ]
    for xlsfile in files:
        print ("File in mentioned folder is: " + xlsfile)
        temp_book = xlrd.open_workbook(os.path.join(root,xlsfile))
        temp_sheet = temp_book.sheet_by_index(0)
        if temp == 0:
            for col_index in range(temp_sheet.ncols):
                str = temp_sheet.cell_value(0, col_index)
                dest_sheet_1.write(0, col_index, str)
            temp = temp + 1
        for row_index in range(1, temp_sheet.nrows):
            for col_index in range(temp_sheet.ncols):
                str = temp_sheet.cell_value(row_index, col_index)
                dest_sheet_1.write(dest_row, col_index, str)
            dest_row = dest_row + 1
dest_book.close()
book = xlrd.open_workbook(merged_file_name)
sheet = book.sheet_by_index(0)
print "number of rows in destination file are: ", sheet.nrows
print "number of columns in destination file are: ", sheet.ncols