scikit-learn模型训练的多处理引起了什么错误?

时间:2016-04-28 10:30:23

标签: python numpy file-io scikit-learn joblib

当我使用多处理支持训练我的模型时,它会在一段时间后发生这样的错误;

Failed to save <type 'numpy.ndarray'> to .npy file:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/sklearn/externals/joblib/numpy_pickle.py", line 271, in save
    obj, filename = self._write_array(obj, filename)
  File "/usr/local/lib/python2.7/dist-packages/sklearn/externals/joblib/numpy_pickle.py", line 231, in _write_array
    self.np.save(filename, array)
  File "/usr/local/lib/python2.7/dist-packages/numpy/lib/npyio.py", line 491, in save
    pickle_kwargs=pickle_kwargs)
  File "/usr/local/lib/python2.7/dist-packages/numpy/lib/format.py", line 584, in write_array
    array.tofile(fp)
IOError: 495340 requested and 502 written

我似乎因为空间投入而存在IOError,但当我用df -h检查时,每个驱动器都有足够的空间。

我怎么能解决这个问题?

0 个答案:

没有答案