我在Ubuntu 16.04系统上使用TensorFlow 1.10。当我尝试将per_process_gpu_memory_fraction
设置为10以允许GPU使用系统内存在非常大的RGB图像(12000、12000、3)上训练ResNet时,出现错误:
F:tensorflow/stream_executor/cuda/cuda_dnn.cc:91] Checked failed narrow == wide (-1990967296 vs 2304000000) checked narrowing failed; values not equal post-conversion Aborted (core dumped)
上面引用的代码块如下:
// Converts (via narrowing) a type T value to a type U, and checks that the
// value has no value change due to the conversion.
template <typename WideT, typename NarrowT>
NarrowT CheckedNarrowing(const WideT& wide) {
NarrowT narrow = wide;
CHECK_EQ(narrow, wide)
<< "checked narrowing failed; values not equal post-conversion";
return narrow;
}
稍小的图像(例如(10000,10000,3))不会产生此错误。我想知道到底是什么引起了这个问题,我该如何解决呢?