Question

我试图用python编写两个函数，可用于从站点下载数据并将其另存为csv文件。

功能是：

def get_site_url( site_number='01589440', date_from="2008-01-01",date_to="2017-12-31" ): 
# input: site_number is a string
# the parameters in the url can have different formats. cb_00065 is the same as parameterCd=00060

#url = 'https://nwis.waterdata.usgs.gov/nwis/uv/cb_00065=on&format=rdb&site_no=%speriod=&begin_date=%s\
#&end_date=%s&siteStatus=all'%(site_number, date_from, date_to)

url = "https://nwis.waterdata.usgs.gov/nwis/uv/?parameterCd=00060,00065&format=rdb&site_no=%s&period=&begin_date=%s\
&end_date=%s&siteStatus=all"%(site_number, date_from, date_to)
return url

def download_data_from_url( url, savename='test.csv' ):
''' 
One can download data with a different method that supports resume. If data is two large then it takes
lot of time and the connection to the server might be interrupted.
'''

buffer = BytesIO()
c = pycurl.Curl()
c.setopt(c.URL, url)
c.setopt(c.WRITEDATA, buffer)
c.perform()
c.close()

body = buffer.getvalue() # Body is a byte string.
with open( savename, 'w' ) as output:
    output.write( body.decode('utf-8')) # We have to know the encoding in order to print it to a text file

将这两个功能用作下一个：

FirstExcUrl = get_site_url()
download_data_from_url(FirstExcUrl, '%s.csv'%'01589440')

产生了错误：

errorTraceback (most recent call last)
<ipython-input-5-f460d226bec2> in <module>()
      1 FirstExcUrl = get_site_url()
----> 2 download_data_from_url(FirstExcUrl, '%s.csv'%'01589440')

<ipython-input-3-e6e6e1be72e0> in download_data_from_url(url, savename)
     19     c.setopt(c.URL, url)
     20     c.setopt(c.WRITEDATA, buffer)
---> 21     c.perform()
     22     c.close()
     23 

error: (1, 'Protocol "https" not supported or disabled in libcurl')

这是从有思想的Canopy编辑器窗口启动的Jupyter笔记本的输出。我从Canpy软件包管理器中安装了curl和PycURL。安装的curl版本为：7.58.0-1，安装的PycURL版本为：7.19.5-5。

任何帮助，建议或解决方案都将受到高度赞赏。

Answer 1

对不起，我们当前不构建具有SSL支持的libcurl。您可以使用另一个支持SSL的python软件包（例如请求）。

在Mac OS High Sierra下使用Canopy中的PycURL下载数据失败

1 个答案: