我正在使用python进行科学应用。我使用各种参数运行模拟,我的脚本将数据输出到该参数集的适当目录。后来我使用那些数据。但有时我会编辑我的脚本;为了能够在需要时重现我的结果,我希望有一个副本,用于在数据目录中直接生成数据的任何版本的脚本。所以基本上我想让我的python脚本自己复制到数据目录。最好的方法是什么?
谢谢!
答案 0 :(得分:3)
我偶然发现了这个问题,因为我想做同样的事情。虽然我同意git / VCS带有修订版的评论,但一切都是最干净的解决方案,有时你只是想要快速而肮脏的工作。所以,如果有人仍然感兴趣:
使用__file__
,您可以access the running scripts filename(带路径),并且如您所建议的那样,您可以使用高级文件操作库(如shutil
)将其复制到某个位置。在一行中:
shutil.copy(__file__, 'experiment_folder_path/copied_script_name.py')
有相应的进口和一些花里胡哨:
import shutil
import os # optional: for extracting basename / creating new filepath
import time # optional: for appending time string to copied script
# generate filename with timestring
copied_script_name = time.strftime("%Y-%m-%d_%H%M") + '_' + os.path.basename(__file__)
# copy script
shutil.copy(__file__, 'my_experiment_folder_path' + os.sep + copied_script_name)
答案 1 :(得分:1)
可以使用shutil.copy()
复制脚本。
但是你应该考虑让你的脚本保持在版本控制之下。这使您可以保留修订历史记录。
E.g。我使用git
将脚本置于版本控制之下。在Python文件中,我倾向于保留这样的版本字符串;
__version__ = '$Revision: a42ef58 $'[11:-2]
每次更改相关文件时,都会使用git short hash标记更新此版本字符串。 (这是通过从git的update-modified-keywords.py
挂钩运行名为post-commit
的脚本来完成的。)
如果你有这样的版本字符串,你可以将它嵌入到输出中,这样你就可以知道哪个版本产生了输出。
修改强>:
update-modified-keywords脚本如下所示;
#!/usr/bin/env python2
# -*- coding: utf-8 -*-
#
# Author: R.F. Smith <rsmith@xs4all.nl>
# $Date: 2013-11-24 22:20:54 +0100 $
# $Revision: 3d4f750 $
#
# To the extent possible under law, Roland Smith has waived all copyright and
# related or neighboring rights to update-modified-keywords.py. This work is
# published from the Netherlands.
# See http://creativecommons.org/publicdomain/zero/1.0/
"""Remove and check out those files that that contain keywords and have
changed since in the last commit in the current working directory."""
from __future__ import print_function, division
import os
import mmap
import sys
import subprocess
def checkfor(args):
"""Make sure that a program necessary for using this script is
available.
Arguments:
args -- string or list of strings of commands. A single string may
not contain spaces.
"""
if isinstance(args, str):
if ' ' in args:
raise ValueError('No spaces in single command allowed.')
args = [args]
try:
with open(os.devnull, 'w') as bb:
subprocess.check_call(args, stdout=bb, stderr=bb)
except subprocess.CalledProcessError:
print("Required program '{}' not found! exiting.".format(args[0]))
sys.exit(1)
def modifiedfiles():
"""Find files that have been modified in the last commit.
:returns: A list of filenames.
"""
fnl = []
try:
args = ['git', 'diff-tree', 'HEAD~1', 'HEAD', '--name-only', '-r',
'--diff-filter=ACMRT']
with open(os.devnull, 'w') as bb:
fnl = subprocess.check_output(args, stderr=bb).splitlines()
# Deal with unmodified repositories
if len(fnl) == 1 and fnl[0] is 'clean':
return []
except subprocess.CalledProcessError as e:
if e.returncode == 128: # new repository
args = ['git', 'ls-files']
with open(os.devnull, 'w') as bb:
fnl = subprocess.check_output(args, stderr=bb).splitlines()
# Only return regular files.
fnl = [i for i in fnl if os.path.isfile(i)]
return fnl
def keywordfiles(fns):
"""Filter those files that have keywords in them
:fns: A list of filenames
:returns: A list for filenames for files that contain keywords.
"""
# These lines are encoded otherwise they would be mangled if this file
# is checked in my git repo!
datekw = 'JERhdGU='.decode('base64')
revkw = 'JFJldmlzaW9u'.decode('base64')
rv = []
for fn in fns:
with open(fn, 'rb') as f:
try:
mm = mmap.mmap(f.fileno(), 0, access=mmap.ACCESS_READ)
if mm.find(datekw) > -1 or mm.find(revkw) > -1:
rv.append(fn)
mm.close()
except ValueError:
pass
return rv
def main(args):
"""Main program.
:args: command line arguments
"""
# Check if git is available.
checkfor(['git', '--version'])
# Check if .git exists
if not os.access('.git', os.F_OK):
print('No .git directory found!')
sys.exit(1)
print('{}: Updating modified files.'.format(args[0]))
# Get modified files
files = modifiedfiles()
if not files:
print('{}: Nothing to do.'.format(args[0]))
sys.exit(0)
files.sort()
# Find files that have keywords in them
kwfn = keywordfiles(files)
for fn in kwfn:
os.remove(fn)
args = ['git', 'checkout', '-f'] + kwfn
subprocess.call(args)
if __name__ == '__main__':
main(sys.argv)
如果您不希望关键字扩展混乱您的git历史记录,可以使用污迹和清理过滤器。我在~/.gitconfig
;
[filter "kw"]
clean = kwclean
smudge = kwset
kwclean和kwset都是Python脚本。
#!/usr/bin/env python
# -*- coding: utf-8 -*-
#
# Author: R.F. Smith <rsmith@xs4all.nl>
# $Date: 2013-11-24 22:20:54 +0100 $
#
# To the extent possible under law, Roland Smith has waived all copyright and
# related or neighboring rights to kwset.py. This work is published from
# the Netherlands. See http://creativecommons.org/publicdomain/zero/1.0/
"""Fill the Date and Revision keywords from the latest git commit and tag and
subtitutes them in the standard input."""
import os
import sys
import subprocess
import re
def gitdate():
"""Get the date from the latest commit in ISO8601 format.
"""
args = ['git', 'log', '-1', '--date=iso']
dline = [l for l in subprocess.check_output(args).splitlines()
if l.startswith('Date')]
try:
dat = dline[0][5:].strip()
return ''.join(['$', 'Date: ', dat, ' $'])
except IndexError:
raise ValueError('Date not found in git output')
def gitrev():
"""Get the latest tag and use it as the revision number. This presumes the
habit of using numerical tags. Use the short hash if no tag available.
"""
args = ['git', 'describe', '--tags', '--always']
try:
with open(os.devnull, 'w') as bb:
r = subprocess.check_output(args, stderr=bb)[:-1]
except subprocess.CalledProcessError:
return ''.join(['$', 'Revision', '$'])
return ''.join(['$', 'Revision: ', r, ' $'])
def main():
"""Main program.
"""
dre = re.compile(''.join([r'\$', r'Date:?\$']))
rre = re.compile(''.join([r'\$', r'Revision:?\$']))
currp = os.getcwd()
if not os.path.exists(currp+'/.git'):
print >> sys.stderr, 'This directory is not controlled by git!'
sys.exit(1)
date = gitdate()
rev = gitrev()
for line in sys.stdin:
line = dre.sub(date, line)
print rre.sub(rev, line),
if __name__ == '__main__':
main()
和
#!/usr/bin/env python
# -*- coding: utf-8 -*-
#
# Author: R.F. Smith <rsmith@xs4all.nl>
# $Date: 2013-11-24 22:20:54 +0100 $
#
# To the extent possible under law, Roland Smith has waived all copyright and
# related or neighboring rights to kwclean.py. This work is published from the
# Netherlands. See http://creativecommons.org/publicdomain/zero/1.0/
"""Remove the Date and Revision keyword contents from the standard input."""
import sys
import re
## This is the main program ##
if __name__ == '__main__':
dre = re.compile(''.join([r'\$', r'Date.*\$']))
drep = ''.join(['$', 'Date', '$'])
rre = re.compile(''.join([r'\$', r'Revision.*\$']))
rrep = ''.join(['$', 'Revision', '$'])
for line in sys.stdin:
line = dre.sub(drep, line)
print rre.sub(rrep, line),
在$PATH
中的目录中安装了这两个脚本(在文件名的末尾没有扩展名,就像通常的可执行文件一样),并且设置了可执行位。
在我的存储库的.gitattributes
文件中,我选择了我希望关键字扩展的文件。因此对于例如Python文件;
*.py filter=kw
答案 2 :(得分:1)
如果您使用的是Linux,则可以使用以下内容。
import os
os.system("cp ./scriptname ./")