我需要从某些Linux服务器将各种文件类型备份到GDrive(不只是那些可转换为GDocs格式的文件)。
使用python脚本执行此操作最简单,最优雅的方法是什么?是否有任何与GDoc相关的解决方案适用?
答案 0 :(得分:13)
您可以使用Documents List API编写一个写入Drive:
的脚本https://developers.google.com/google-apps/documents-list/
Documents List API和Drive API都与相同的资源(即相同的文档和文件)进行交互。
Python客户端库中的此示例显示了如何将未转换的文件上载到云端硬盘:
http://code.google.com/p/gdata-python-client/source/browse/samples/docs/docs_v3_example.py#180
答案 1 :(得分:3)
可以在此处找到使用python将文件保存到Google云端硬盘的当前文档: https://developers.google.com/drive/v3/web/manage-uploads
但是,google drive api处理文档存储和检索的方式与POSIX文件系统不同。因此,如果您希望在Linux文件系统上保留嵌套文件的层次结构,则需要编写大量自定义代码,以便在google驱动器上保留父目录。
最重要的是,谷歌很难获得普通硬盘帐户的写入权限。您的权限范围必须包含以下链接:https://www.googleapis.com/auth/drive并且要获取用于访问用户普通帐户的令牌,该用户必须首先join a group才能访问未经审核的应用。并且创建的任何oauth令牌的保质期都有限。
但是,如果您获得访问令牌,则以下脚本应允许您将本地计算机上的任何文件保存到Google驱动器上的相同(相对)路径。
def migrate(file_path, access_token, drive_space='drive'):
'''
a method to save a posix file architecture to google drive
NOTE: to write to a google drive account using a non-approved app,
the oauth2 grantee account must also join this google group
https://groups.google.com/forum/#!forum/risky-access-by-unreviewed-apps
:param file_path: string with path to local file
:param access_token: string with oauth2 access token grant to write to google drive
:param drive_space: string with name of space to write to (drive, appDataFolder, photos)
:return: string with id of file on google drive
'''
# construct drive client
import httplib2
from googleapiclient import discovery
from oauth2client.client import AccessTokenCredentials
google_credentials = AccessTokenCredentials(access_token, 'my-user-agent/1.0')
google_http = httplib2.Http()
google_http = google_credentials.authorize(google_http)
google_drive = discovery.build('drive', 'v3', http=google_http)
drive_client = google_drive.files()
# prepare file body
from googleapiclient.http import MediaFileUpload
media_body = MediaFileUpload(filename=file_path, resumable=True)
# determine file modified time
import os
from datetime import datetime
modified_epoch = os.path.getmtime(file_path)
modified_time = datetime.utcfromtimestamp(modified_epoch).isoformat()
# determine path segments
path_segments = file_path.split(os.sep)
# construct upload kwargs
create_kwargs = {
'body': {
'name': path_segments.pop(),
'modifiedTime': modified_time
},
'media_body': media_body,
'fields': 'id'
}
# walk through parent directories
parent_id = ''
if path_segments:
# construct query and creation arguments
walk_folders = True
folder_kwargs = {
'body': {
'name': '',
'mimeType' : 'application/vnd.google-apps.folder'
},
'fields': 'id'
}
query_kwargs = {
'spaces': drive_space,
'fields': 'files(id, parents)'
}
while path_segments:
folder_name = path_segments.pop(0)
folder_kwargs['body']['name'] = folder_name
# search for folder id in existing hierarchy
if walk_folders:
walk_query = "name = '%s'" % folder_name
if parent_id:
walk_query += "and '%s' in parents" % parent_id
query_kwargs['q'] = walk_query
response = drive_client.list(**query_kwargs).execute()
file_list = response.get('files', [])
else:
file_list = []
if file_list:
parent_id = file_list[0].get('id')
# or create folder
# https://developers.google.com/drive/v3/web/folder
else:
if not parent_id:
if drive_space == 'appDataFolder':
folder_kwargs['body']['parents'] = [ drive_space ]
else:
del folder_kwargs['body']['parents']
else:
folder_kwargs['body']['parents'] = [parent_id]
response = drive_client.create(**folder_kwargs).execute()
parent_id = response.get('id')
walk_folders = False
# add parent id to file creation kwargs
if parent_id:
create_kwargs['body']['parents'] = [parent_id]
elif drive_space == 'appDataFolder':
create_kwargs['body']['parents'] = [drive_space]
# send create request
file = drive_client.create(**create_kwargs).execute()
file_id = file.get('id')
return file_id
PS。我已经从labpack
python模块修改了这个脚本。在该模块中有一个名为driveClient的类,由rcj1492编写,它以保留POSIX文件系统的方式处理在谷歌驱动器上保存,加载,搜索和删除文件。
from labpack.storage.google.drive import driveClient
答案 2 :(得分:1)
我发现PyDrive优雅地处理了Drive API,它也有很棒的documentation(特别是让用户通过身份验证部分)。
编辑:将其与Automating pydrive verification process和Pydrive google drive automate authentication上的材料相结合,这样就可以获得一些很棒的文档。希望它可以帮助那些对从哪里开始感到困惑的人。