让我们说有一个文件存在于github repo:
https://github.com/someguy/brilliant/blob/master/somefile.txt
我正在尝试使用请求来请求此文件,将其内容写入当前工作目录中的磁盘,稍后可以使用它。现在,我正在使用以下代码:
import requests
from os import getcwd
url = "https://github.com/someguy/brilliant/blob/master/somefile.txt"
directory = getcwd()
filename = directory + 'somefile.txt'
r = requests.get(url)
f = open(filename,'w')
f.write(r.content)
毫无疑问,丑陋,更重要的是,不工作。而不是预期的文本,我得到:
<!DOCTYPE html>
<!--
Hello future GitHubber! I bet you're here to remove those nasty inline styles,
DRY up these templates and make 'em nice and re-usable, right?
Please, don't. https://github.com/styleguide/templates/2.0
-->
<html>
<head>
<meta http-equiv="Content-type" content="text/html; charset=utf-8">
<title>Page not found · GitHub</title>
<style type="text/css" media="screen">
body {
background: #f1f1f1;
font-family: "HelveticaNeue", Helvetica, Arial, sans-serif;
text-rendering: optimizeLegibility;
margin: 0; }
.container { margin: 50px auto 40px auto; width: 600px; text-align: center; }
a { color: #4183c4; text-decoration: none; }
a:visited { color: #4183c4 }
a:hover { text-decoration: none; }
h1 { letter-spacing: -1px; line-height: 60px; font-size: 60px; font-weight: 100; margin: 0px; text-shadow: 0 1px 0 #fff; }
p { color: rgba(0, 0, 0, 0.5); margin: 20px 0 40px; }
ul { list-style: none; margin: 25px 0; padding: 0; }
li { display: table-cell; font-weight: bold; width: 1%; }
#error-suggestions { font-size: 14px; }
#next-steps { margin: 25px 0 50px 0;}
#next-steps li { display: block; width: 100%; text-align: center; padding: 5px 0; font-weight: normal; color: rgba(0, 0, 0, 0.5); }
#next-steps a { font-weight: bold; }
.divider { border-top: 1px solid #d5d5d5; border-bottom: 1px solid #fafafa;}
#parallax_wrapper {
position: relative;
z-index: 0;
}
#parallax_field {
overflow: hidden;
position: absolute;
left: 0;
top: 0;
height: 370px;
width: 100%;
}
等等
来自Github的内容,但不是文件的内容。我做错了什么?
答案 0 :(得分:18)
相关文件的内容在返回的数据中包含 。您将获得该文件的完整GitHub视图,而不仅仅是内容。
如果您要下载 该文件,则需要使用页面顶部的Raw
链接,该链接将是(例如):
https://raw.github.com/someguy/brilliant/master/somefile.txt
请注意域名的更改,路径的blob/
部分已消失。
使用requests
GitHub存储库本身来证明这一点:
>>> import requests
>>> r = requests.get('https://github.com/kennethreitz/requests/blob/master/README.rst')
>>> 'Requests:' in r.text
True
>>> r.headers['Content-Type']
'text/html; charset=utf-8'
>>> r = requests.get('https://raw.github.com/kennethreitz/requests/master/README.rst')
>>> 'Requests:' in r.text
True
>>> r.headers['Content-Type']
'text/plain; charset=utf-8'
>>> print r.text
Requests: HTTP for Humans
=========================
.. image:: https://travis-ci.org/kennethreitz/requests.png?branch=master
[... etc. ...]
答案 1 :(得分:5)
您需要从https://raw.github.com
。
看到区别:
https://raw.github.com/django/django/master/setup.py与https://github.com/django/django/blob/master/setup.py
此外,您应该在目录和文件名之间添加/
:
>>> getcwd()+'foo.txt'
'/Users/burhanfoo.txt'
>>> import os
>>> os.path.join(getcwd(),'foo.txt')
'/Users/burhan/foo.txt'
答案 2 :(得分:0)
就像更新一样,https://raw.github.com
was migrated 到 https://raw.githubusercontent.com
。所以一般格式是:
url = "https://raw.githubusercontent.com/user/repo/branch/[subfolders]/file"
例如https://raw.githubusercontent.com/earnestt1234/seedir/master/setup.py
。在 Martijn 的回答中仍然使用 requests.get(url)
。