如何在keras中同时训练多个神经网络?

时间:2017-07-02 16:35:24

标签: python graph tensorflow neural-network keras

如何多次训练1个模型并将它们组合在输出层?

例如:

model_one = Sequential() #model 1
model_one.add(Convolution2D(32, 3, 3, activation='relu', input_shape=(1,28,28)))
model_one.add(Flatten())
model_one.add(Dense(128, activation='relu'))

model_two = Sequential() #model 2
model_two.add(Dense(128, activation='relu', input_shape=(784)))
model_two.add(Dense(128, activation='relu'))

model_???.add(Dense(10, activation='softmax')) #combine them here

model.compile(loss='categorical_crossentropy', #continu together
          optimizer='adam',
          metrics=['accuracy'])


model.fit(X_train, Y_train, #continu together somehow, even though this would never work because X_train and Y_train have wrong formats
      batch_size=32, nb_epoch=10, verbose=1)

我听说过我可以通过图表模型完成此操作,但我无法找到相关文档。

编辑:回复以下建议:

A1 = Conv2D(20,kernel_size=(5,5),activation='relu',input_shape=( 28, 28, 1))
---> B1 = MaxPooling2D(pool_size=(2,2))(A1)

抛出此错误:

AttributeError: 'Conv2D' object has no attribute 'get_shape'

1 个答案:

答案 0 :(得分:4)

图表符号会为你做。基本上,您为每个图层提供一个唯一的句柄,然后使用末尾括号中的句柄链接回上一层:

layer_handle = Layer(params)(prev_layer_handle)

请注意,第一层必须是Input(shape=(x,y)),之前没有连接。

然后,当你制作模型时,你需要告诉它它需要多个带有列表的输入:

model = Model(inputs=[in_layer1, in_layer2, ..], outputs=[out_layer1, out_layer2, ..])

最后,当您训练它时,您还需要提供与您的定义相对应的输入和输出数据列表:

model.fit([x_train1, x_train2, ..], [y_train1, y_train2, ..])

同时其他一切都是一样的,所以你只需要将上面的内容组合在一起就可以得到你想要的网络布局:

from keras.models import Model
from keras.layers import Input, Convolution2D, Flatten, Dense, Concatenate

# Note Keras 2.02, channel last dimension ordering

# Model 1
in1 = Input(shape=(28,28,1))
model_one_conv_1 = Convolution2D(32, (3, 3), activation='relu')(in1)
model_one_flat_1 = Flatten()(model_one_conv_1)
model_one_dense_1 = Dense(128, activation='relu')(model_one_flat_1)

# Model 2
in2 = Input(shape=(784, ))
model_two_dense_1 = Dense(128, activation='relu')(in2)
model_two_dense_2 = Dense(128, activation='relu')(model_two_dense_1)

# Model Final
model_final_concat = Concatenate(axis=-1)([model_one_dense_1, model_two_dense_2])
model_final_dense_1 = Dense(10, activation='softmax')(model_final_concat)

model = Model(inputs=[in1, in2], outputs=model_final_dense_1)

model.compile(loss='categorical_crossentropy', #continu together
              optimizer='adam',
              metrics=['accuracy'])

model.fit([X_train_one, X_train_two], Y_train,
          batch_size=32, nb_epoch=10, verbose=1)

可以在Functional Model API中找到文档。我建议您阅读其他问题或查看Keras' repo,因为文档目前没有很多示例。