在使用python2.7中的numpy.load('my_data.npy')
加载大约70GB的数据时出现问题
这是错误:
my_data=np.load('my_data.npy')
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/home/.local/lib/python2.7/site-packages/numpy/lib/npyio.py", line 419, in load
pickle_kwargs=pickle_kwargs)
File "/home/.local/lib/python2.7/site-packages/numpy/lib/format.py", line 640, in read_array
array = pickle.load(fp, **pickle_kwargs)
EOFError
我的数据集形状为(400,300,256,256,19)
dataset=np.asarray(dataset)
numpy.save('my_data.npy',dataset)
非常感谢