重命名使用Python请求下载的文件

时间:2017-05-20 05:18:28

标签: python python-3.x web-scraping python-requests

如何替换使用Python请求下载的pdf文件的名称?

我想将其保存为Manual_name1.pdf而不是Elkinson%20Jeffrey.pdf

CSV文件如下所示:

Manual_name1 https://www.adndrc.org/diymodule/doc_panellist/Elkinson%20Jeffrey.pdf
Manual_name2 http://www.parliament.bm/uploadedFiles/Content/House_Business/Presentation_of_Papers_and_of_Reports/PCA%20Report%209262014.pdf
manual_name3 http://www.ohchr.org/Documents/HRBodies/OPCAT/elections2016/HaimoudRamdan.pdf

我目前的代码:

import os
import csv
import requests

write_path = 'C:\\Users\\hgdht\\Desktop\\Downloader_Automation'  # ASSUMING THAT FOLDER EXISTS!

with open('Links.csv', 'r') as csvfile:
    spamreader = csv.reader(csvfile)
    for link in spamreader:
        if not link:
            continue
        print('-'*72)
        pdf_file = link[0].split('/')[-1]
        with open(os.path.join(write_path, pdf_file), 'wb') as pdf:
            try:
                # Try to request PDF from URL
                print('TRYING {}...'.format(link[0]))
                a = requests.get(link[0], stream=True)
                for block in a.iter_content(512):
                    if not block:
                        break

                    pdf.write(block)
                print('OK.')
            except requests.exceptions.RequestException as e:  # This 
will catch ONLY Requests exceptions
                print('REQUESTS ERROR:')
                print(e)  # This should tell you more details about the error

1 个答案:

答案 0 :(得分:1)

而不是

pdf_file = link[0].split('/')[-1]

使用csv文件中的特定列:

pdf_file = link[1]  # (assuming the file name is in the second column)

如果文件名在第一列,则应使用

pdf_file = link[0]  # (assuming the file name is in the first column)
# OR
import time  # put this in the beginning of your script
pdf_file = '{}-{}.pdf'.format(link[0], int(time.time()))
# file name will look like: "name-1495460691.pdf"

但是在使用请求调用它时,您将不得不更改对链接本身的引用:

a = requests.get(link[1], stream=True)  # (assuming the link is in the second column)