在转移学习预训练模型上训练新数据集

时间:2020-02-05 10:35:56

标签: python deep-learning conv-neural-network transfer-learning imagenet

代码:

from keras.preprocessing import image as image_util 
from keras.applications.imagenet_utils import preprocess_input
from keras.applications.imagenet_utils import decode_predictions
from keras.applications import ResNet50
import numpy as np 
import argparse
import cv2
import time 

ap = argparse.ArgumentParser()
ap.add_argument("-i","--image",required= True,help ="path of the image")
args = vars(ap.parse_args())

# orig = cv2.imread(args["image"]) #Opencv function to load a image
start_time = time.time()
image = image_util.load_img(args["image"],target_size=(224,224))
image = image_util.img_to_array(image)

#print("!!!!!.....!!!!")
print(image.shape)


image = np.expand_dims(image,axis=0) #(224,224,3) --> (1,224,224,3)
#print("!!!!!.....!!!!")
print(image.shape)
image = preprocess_input(image)

#Loading the model 
model = ResNet50(weights="imagenet")
pred = model.predict(image)
#print("111!!!!!.....!!!!")
#print(pred)
p = decode_predictions(pred)
#print("222!!!!!.....!!!!")
#print(p)

for (i,(imagenetID,label,prob)) in enumerate(p[0]):
    print("{}. {}: {:.2f}%".format(i+1, label, prob*100))

ans = p[0][0]
ans = ans[1]
print("THE PREDICTED IMAGE IS: "+ans)

orig = cv2.imread(args["image"]) #Opencv function to load a image
(imagenetID,label,prob) = p[0][0]
cv2.putText(orig, "{},{:.2f}%".format(label,prob*100),(10,30),cv2.FONT_HERSHEY_COMPLEX,0.5,(0,0,0),1)
cv2.imshow("classification",orig)
cv2.waitKey(0)
print("--- %s seconds ---" % (time.time() - start_time))  

此代码可处理imagenet权重,并具有可对各种图像进行分类的预训练模型。 我需要训练一个新对象,即我自己的数据集。 (例如苹果)。 我该怎么做才能添加新数据集来更新权重?

1 个答案:

答案 0 :(得分:1)

一般方法是仅采用经过预训练的CNN的较低层(例如ResNet),并在现有CNN的顶部添加新层。

一旦有了模型,您可能应该在训练开始时锁定预训练的图层,以免破坏那些已经训练的权重,然后在渐变稳定后的几个周期后,您可以解锁这些图层并继续经过培训。

删除预训练网络顶层的最简单方法是将include_top参数设置为False

base_model = ResNet50(include_top=False, weights="imagenet") 

然后,您可以照常开始添加图层,即({n_classes是指您要分类的类数)

my_hidden1 = keras.layers.Dense(128, activation="relu")(base_model)
# rest of the custom layers
...
output = keras.layers.Dense(n_classes, activation="softmax")(previous_layer)
model = keras.Model(inputs=base_model.input, outputs=output)

将预训练的图层锁定在开始位置

for layer in base_model.layers:
    layer.trainable = False

然后,您可以compilefit几个新时期(即使学习率更高),即

optimizer = keras.optimizers.SGD(lr=0.2, momentum=0.9, decay=0.01)
model.compile(optimizer=optimizer, ...)
model.fit(...)

完成初始训练后,您可以解锁基础层并继续训练(通常,您希望在此阶段降低学习率)。

for layer in base_model.layers:
    layer.trainable = True

optimizer = keras.optimizers.SGD(lr=0.01, momentum=0.9, decay=0.001)
model.compile(...)
model.fit(...)

请注意,每次锁定或解锁这些图层时,您都必须运行compile