Question

如何为服务准备冻结的Tensorflow模型？ 请注意，official guide仅演示了如何使用检查点，但是我想使用冻结的模型。

我要使用frozen inception_v3 model添加SERVING元标记，例如that the model can be used with Tensorflow Serving。

使用summarize_graph检查冻结的模型inception_v3_2016_08_28_frozen.pb，可以找到模型输入和输出张量：

Found 1 possible inputs: (name=input, type=float(1), shape=[1,299,299,3])
No variables spotted.
Found 1 possible outputs: (name=InceptionV3/Predictions/Reshape_1, op=Reshape)
Found 23853946 (23.85M) const parameters, 0 (0) variable parameters, and 0 control_edges
Op types used: 489 Const, 379 Identity, 188 Mul, 188 Add, 95 Conv2D, 94 Sub, 94 Rsqrt, 94 Relu, 15 ConcatV2, 10 AvgPool, 4 MaxPool, 2 Reshape, 1 BiasAdd, 1 Softmax, 1 Squeeze, 1 Placeholder
To use with tensorflow/tools/benchmark:benchmark_model try these arguments:
bazel run tensorflow/tools/benchmark:benchmark_model -- --graph=assets/inception_v3_2016_08_28_frozen.pb --show_flops --input_layer=input --input_layer_type=float --input_layer_shape=1,299,299,3 --output_layer=InceptionV3/Predictions/Reshape_1

哪个产生输入张量input:0和输出张量InceptionV3/Predictions/Reshape_1:0。在我的脚本中，我使用它们两者来创建签名定义并保存更新后的版本。

model_path = './assets/inception_v3_2016_08_28_frozen.pb'
target_dir = './models/inception/3'

with tf.gfile.FastGFile(model_path, 'rb') as f:
    graph_def = tf.GraphDef()
    graph_def.ParseFromString(f.read())
    _ = tf.import_graph_def(graph_def, name='')

input_name = 'input'
output_name = 'InceptionV3/Predictions/Reshape_1'

with tf.Session() as sess:
    model_input = build_tensor_info(sess.graph.get_tensor_by_name(input_name + ':0'))
    model_output = build_tensor_info(sess.graph.get_tensor_by_name(output_name + ':0'))

    signature_definition = signature_def_utils.build_signature_def(
        inputs={input_name: model_input},
        outputs={output_name: model_output},
        method_name=signature_constants.PREDICT_METHOD_NAME)

    builder = saved_model_builder.SavedModelBuilder(target_dir)
    builder.add_meta_graph_and_variables(sess, [tag_constants.SERVING], signature_def_map={
        signature_constants.DEFAULT_SERVING_SIGNATURE_DEF_KEY: signature_definition
    }, clear_devices=True)
    builder.save()

不幸的是，我无法使如此创建的protobuffer文件起作用。测试工具label_image.py尽管可以与原始inception_v3_2016_08_28_frozen.pb文件一起使用，但无法产生正确的结果。

$ python3 tensorflow/examples/label_image/label_image.py --graph models/inception/3/saved_model.pb

Traceback (most recent call last):
  File "tensorflow/examples/label_image/label_image.py", line 118, in <module>
    graph = load_graph(model_file)
  File "tensorflow/examples/label_image/label_image.py", line 31, in load_graph
    graph_def.ParseFromString(f.read())
google.protobuf.message.DecodeError: Error parsing message

但是标签已设置

$ saved_model_cli show --dir models/inception/3
The given SavedModel contains the following tag-sets:
serve

如此更改的冻结模型有什么问题？以及如何正确地做到这一点？

将SERVING元标记添加到TensorFlow中的冻结模型

0 个答案: