我正在尝试从python应用运行谷歌搜索查询。有没有任何python接口可以让我这样做?如果没有人知道哪个Google API可以让我这样做。感谢。
答案 0 :(得分:70)
有一个简单的例子here(特别缺少一些引号;-)。你在Web上看到的大部分内容都是旧的,已停产的SOAP API的Python接口 - 我指向的示例使用了更新且受支持的AJAX API,这绝对是你想要的! -
编辑:这是一个更完整的Python 2.6示例,其中包含所有必需的引号& c; - )...:
#!/usr/bin/python
import json
import urllib
def showsome(searchfor):
query = urllib.urlencode({'q': searchfor})
url = 'http://ajax.googleapis.com/ajax/services/search/web?v=1.0&%s' % query
search_response = urllib.urlopen(url)
search_results = search_response.read()
results = json.loads(search_results)
data = results['responseData']
print 'Total results: %s' % data['cursor']['estimatedResultCount']
hits = data['results']
print 'Top %d hits:' % len(hits)
for h in hits: print ' ', h['url']
print 'For more results, see %s' % data['cursor']['moreResultsUrl']
showsome('ermanno olmi')
答案 1 :(得分:17)
这是Alex的回答移植到Python3
#!/usr/bin/python3
import json
import urllib.request, urllib.parse
def showsome(searchfor):
query = urllib.parse.urlencode({'q': searchfor})
url = 'http://ajax.googleapis.com/ajax/services/search/web?v=1.0&%s' % query
search_response = urllib.request.urlopen(url)
search_results = search_response.read().decode("utf8")
results = json.loads(search_results)
data = results['responseData']
print('Total results: %s' % data['cursor']['estimatedResultCount'])
hits = data['results']
print('Top %d hits:' % len(hits))
for h in hits: print(' ', h['url'])
print('For more results, see %s' % data['cursor']['moreResultsUrl'])
showsome('ermanno olmi')
答案 2 :(得分:11)
以下是我的方法:http://breakingcode.wordpress.com/2010/06/29/google-search-python/
一些代码示例:
# Get the first 20 hits for: "Breaking Code" WordPress blog
from google import search
for url in search('"Breaking Code" WordPress blog', stop=20):
print(url)
# Get the first 20 hits for "Mariposa botnet" in Google Spain
from google import search
for url in search('Mariposa botnet', tld='es', lang='es', stop=20):
print(url)
请注意,此代码不使用Google API,并且至今仍在使用(2012年1月)。
答案 3 :(得分:6)
我是python的新手,我正在研究如何做到这一点。所提供的示例都不适合我。如果你提出很多(很少)请求,有些会被谷歌阻止,有些已经过时了。 解析谷歌搜索html(在请求中添加标题)将一直有效,直到谷歌再次更改html结构。你可以使用相同的逻辑在任何其他搜索引擎中搜索,查看html(view-source)。
import urllib2
def getgoogleurl(search,siteurl=False):
if siteurl==False:
return 'http://www.google.com/search?q='+urllib2.quote(search)
else:
return 'http://www.google.com/search?q=site:'+urllib2.quote(siteurl)+'%20'+urllib2.quote(search)
def getgooglelinks(search,siteurl=False):
#google returns 403 without user agent
headers = {'User-agent':'Mozilla/11.0'}
req = urllib2.Request(getgoogleurl(search,siteurl),None,headers)
site = urllib2.urlopen(req)
data = site.read()
site.close()
#no beatifulsoup because google html is generated with javascript
start = data.find('<div id="res">')
end = data.find('<div id="foot">')
if data[start:end]=='':
#error, no links to find
return False
else:
links =[]
data = data[start:end]
start = 0
end = 0
while start>-1 and end>-1:
#get only results of the provided site
if siteurl==False:
start = data.find('<a href="/url?q=')
else:
start = data.find('<a href="/url?q='+str(siteurl))
data = data[start+len('<a href="/url?q='):]
end = data.find('&sa=U&ei=')
if start>-1 and end>-1:
link = urllib2.unquote(data[0:end])
data = data[end:len(data)]
if link.find('http')==0:
links.append(link)
return links
用法:
links = getgooglelinks('python','http://www.stackoverflow.com/')
for link in links:
print link
(编辑1:添加参数以将Google搜索范围缩小到特定网站)
(编辑2:当我添加这个答案时,我正在编写一个Python脚本来搜索字幕。我最近将它上传到Github:Subseek)
答案 4 :(得分:0)
由于AJAX API已失效,您可以使用第三方服务,例如Serp API,这是Google搜索引擎结果包装器。
与Python集成很容易:
from lib.google_search_results import GoogleSearchResults
params = {
"q" : "Coffee",
"location" : "Austin, Texas, United States",
"hl" : "en",
"gl" : "us",
"google_domain" : "google.com",
"api_key" : "demo",
}
query = GoogleSearchResults(params)
dictionary_results = query.get_dictionary()
GitHub:https://github.com/serpapi/google-search-results-python