Question

我尝试使用ReLU激活功能打印下一个输入数字。我训练了几次网络，但输出为0。

以下是我尝试实施的代码。谁能告诉我我做错了什么？

import numpy as np,random

class NeuralNetwork():

    def _init_(self):
       random.seed(1)
       self.weights = 0.5

    def relu(self,x):
       for i in range(0,len(x)):
          if x[i]>0:
             pass
          else:
             x[i]=0
       return x

    def relu_derv(self,x):
       for i in range(0,len(x)):
          if x[i]>0:
             x[i]=1
          else:
             x[i]=0
       return x

    def train(self,input ,output,iterations):
       for i in xrange(iterations):
          out = self.think(input)
          error = output-out
          adjustments = np.dot(input.T,error*self.relu_derv(out))
          self.weights += adjustments

    def think(self,input):
       return self.relu(np.dot(input,self.weights))


if _name_=="__main__":
neural= NeuralNetwork()
print "before train weights"
print neural.weights
input = np.array([1,2,3,4,5,6,7,8,9])
output = np.array([2,3,4,5,6,7,8,9,10]).T
print input
neural.train(input,output,100000)

print "after train weights"
print neural.weights
print "neural"
a=[13,15]
print neural.think(a)

Answer 1

代码中的调整变量值很大，因此当用它增加权重时，输出为0。我只是通过减少调整值来增加权重，我得到了输出。

 self.weights += adjustments/10000

对于输入18和19，输出为19和20。

ReLU神经网络仅返回0

1 个答案: