使用nolearn-DBN分类器,“ garray”对象没有属性“ size”

时间:2019-01-12 08:46:08

标签: python python-2.7 numpy python-nolearn

我正在研究openface。 Openface具有unknown classification python cod e。

我正在测试lfw-classification-unknown.py's火车零件。 它使用

进行了培训
nolearn-DBN classifier

我安装了nolearn version 0.5DBN classifier具有对/usr/local/lib/python2.7/dist-packages/gnumpy.py的函数调用,并且 我有错误

File "/usr/local/lib/python2.7/dist-packages/gnumpy.py", line 738, in as_numpy_array
    if self.size==0: return numpy.zeros(self.shape, dtype)
AttributeError: 'garray' object has no attribute 'size'

如何解决该错误?

整个错误是

Traceback (most recent call last):
  File "/usr/lib/python2.7/pdb.py", line 1314, in main
    pdb._runscript(mainpyfile)
  File "/usr/lib/python2.7/pdb.py", line 1233, in _runscript
    self.run(statement)
  File "/usr/lib/python2.7/bdb.py", line 400, in run
    exec cmd in globals, locals
  File "<string>", line 1, in <module>
  File "evaluation/lfw-classification-unknown.py", line 519, in <module>
    train(args)
  File "evaluation/lfw-classification-unknown.py", line 130, in train
    clf.fit(embeddings, labelsNum)
  File "/usr/local/lib/python2.7/dist-packages/nolearn/dbn.py", line 409, in fit
    self.use_dropout,
  File "/usr/local/lib/python2.7/dist-packages/gdbn/dbn.py", line 202, in fineTune
    err, outMB = step(inpMB, targMB, self.learnRates, self.momentum, self.L2Costs, useDropout)
  File "/usr/local/lib/python2.7/dist-packages/gdbn/dbn.py", line 296, in stepNesterov
    targetBatch = targetBatch if isinstance(targetBatch, gnp.garray) else gnp.garray(targetBatch)
  File "/usr/local/lib/python2.7/dist-packages/gnumpy.py", line 735, in __new__
    def __new__(cls, *args, **kwarg): return object.__new__(cls)
  File "/usr/lib/python2.7/bdb.py", line 53, in trace_dispatch
    return self.dispatch_return(frame, arg)
  File "/usr/lib/python2.7/bdb.py", line 88, in dispatch_return
    self.user_return(frame, arg)
  File "/usr/lib/python2.7/pdb.py", line 190, in user_return
    self.interaction(frame, None)
  File "/usr/lib/python2.7/pdb.py", line 209, in interaction
    self.print_stack_entry(self.stack[self.curindex])
  File "/usr/lib/python2.7/pdb.py", line 900, in print_stack_entry
    prompt_prefix)
  File "/usr/lib/python2.7/bdb.py", line 381, in format_stack_entry
    s = s + repr.repr(rv)
  File "/usr/lib/python2.7/repr.py", line 24, in repr
    return self.repr1(x, self.maxlevel)
  File "/usr/lib/python2.7/repr.py", line 34, in repr1
    s = __builtin__.repr(x)
  File "/usr/local/lib/python2.7/dist-packages/gnumpy.py", line 1133, in __repr__
    def __repr__(self): return self.as_numpy_array().__repr__().replace('array(', 'garray(').replace('\n', '\n ').replace(', dtype=float32', '').replace(', dtype=float64', '') # 64 happens for empty arrays
  File "/usr/local/lib/python2.7/dist-packages/gnumpy.py", line 738, in as_numpy_array
    if self.size==0: return numpy.zeros(self.shape, dtype)
AttributeError: 'garray' object has no attribute 'size'
> Uncaught exception. Entering post mortem debugging
Running 'cont' or 'step' will restart the program
> /usr/local/lib/python2.7/dist-packages/gnumpy.py(738)as_numpy_array()
-> if self.size==0: return numpy.zeros(self.shape, dtype)

编辑: 如果不在调试模式下,则错误如下。

Traceback (most recent call last):
  File "evaluation/lfw-classification-unknown.py", line 519, in <module>
    train(args)
  File "evaluation/lfw-classification-unknown.py", line 130, in train
    clf.fit(embeddings, labelsNum)
  File "/usr/local/lib/python2.7/dist-packages/nolearn/dbn.py", line 407, in fit
    self.use_dropout,
  File "/usr/local/lib/python2.7/dist-packages/gdbn/dbn.py", line 202, in fineTune
    err, outMB = step(inpMB, targMB, self.learnRates, self.momentum, self.L2Costs, useDropout)
  File "/usr/local/lib/python2.7/dist-packages/gdbn/dbn.py", line 303, in stepNesterov
    errSignals, outputActs, error = self.fpropBprop(inputBatch, targetBatch, useDropout)
  File "/usr/local/lib/python2.7/dist-packages/gdbn/dbn.py", line 262, in fpropBprop
    outputErrSignal = -self.outputActFunct.dErrordNetInput(targetBatch, self.state[-1], outputActs)
  File "/usr/local/lib/python2.7/dist-packages/gdbn/activationFunctions.py", line 138, in dErrordNetInput
    return acts - targets
  File "/usr/local/lib/python2.7/dist-packages/gnumpy.py", line 965, in __sub__
    else: return self + -as_garray(other) # if i need to broadcast, making use of the row add and col add methods is probably faster
  File "/usr/local/lib/python2.7/dist-packages/gnumpy.py", line 926, in __add__
    def __add__(self, other): return _check_number_types(self._broadcastable_op(as_garray_or_scalar(other), 'add'))
  File "/usr/local/lib/python2.7/dist-packages/gnumpy.py", line 614, in _broadcastable_op
    if reduce(operator.or_, ( other.shape[i] not in (1, self.shape[i]) for i in range(self.ndim)), False): raise ValueError('shape mismatch: objects cannot be broadcast to a single shape')
ValueError: shape mismatch: objects cannot be broadcast to a single shape

1 个答案:

答案 0 :(得分:1)

您还没有发布任何实际的代码,因此要确切地知道您的问题是不可能的。

编辑

从堆栈跟踪中可以明显地看出,您遇到的问题是由于pdb试图在调用garray之后立即获取并打印garray.__new__的值而引起的。这是在调用__init__之前,因此.size属性尚不存在。

似乎__new__代码中甚至没有必要重新定义gnumpy.garray,因此您可以通过打开/usr/local/lib/python2.7/dist-packages/gnumpy.py然后注释来解决问题。 735行(即定义为__new__的行)。

更简单,当您只使用脚本而不使用pdb(例如python lfw-classification-unknown.py)时会发生什么?似乎此特定错误将消失。另一方面,您可能最初是出于实际原因使用调试器的。您最初是否遇到其他错误?在这种情况下,这是XY problem,您应该只发布一个新问题,询问原始错误。

不幸的是,gnumpy.garray需要运行一个真正的NVidia GPU,而我没有,所以我不能直接自己测试这些解决方案。

一般问题

话虽这么说,但似乎在没有设置garray属性的情况下正在创建.size对象。这可能是由于您自己的代码或4个不同软件包(openface加上3个依赖项)中的任何一个错误所致。这是一个大概的概述。

openface依赖于nolearn,后者依赖于gbdn,后者依赖于gnumpy。详细信息:

因此,大概是由于在garraysbuildDBN中创建DBN之一而造成了麻烦。仅在调用the gnumpy.garray._set_shape_info method时设置.size属性。粗略浏览garray的实现并没有发现在初始化期间无法调用_set_shape_info的任何明显方式。但是,确实跳出来的一件事是,至少有十几种不同的代码路径可能会导致garray的初始化。如果有一个边缘情况在没有调用_set_shape_info的情况下滑过,这并不奇怪。