OpenVINO:如何使用推理引擎构建OpenCV以启用从Model Optimizer加载模型

时间:2019-07-12 12:26:19

标签: python opencv cmake openvino

我安装了OpenVINO,并希望在Windows 10上运行以下代码。

exportText = resultText.getText().toString().trim(); //.trim() removes space before and after text
    if (!exportText.isEmpty()) {
         openDialog();
    } else {
        Toast.makeText(SpeechToText.this, "Input field empty...", Toast.LENGTH_SHORT).show();
    }

我想运行一个经过预训练的OpenVINO模型,但出现错误:

import numpy as np
import cv2
import sys

from get_face_id import face_id_getter
from check import check
from win10toast import ToastNotifier 

FP = 32

targetId = 0
toaster = None

if '-use_notifications' in sys.argv:
    toaster = ToastNotifier() 

if len(sys.argv) > 1 and '-m' in sys.argv:
    FP =  16
    targetId = cv2.dnn.DNN_TARGET_MYRIAD



cap = cv2.VideoCapture(0)

getter = None

if '-get_face_id' in sys.argv:
    getter = face_id_getter()

weights = 'face-detection-adas-0001/FP{}/face-detection-adas-0001.bin'.format(FP)
config = 'face-detection-adas-0001/FP{}/face-detection-adas-0001.xml'.format(FP)

weights_emotions, config_emotions, emotions = None, None, None



if len(sys.argv) > 1 and '-use_emotions' in sys.argv:
    weights_emotions = 'emotions-recognition-retail-0003/FP{}/emotions-recognition-retail-0003.bin'.format(FP)
    config_emotions = 'emotions-recognition-retail-0003/FP{}/emotions-recognition-retail-0003.xml'.format(FP)
framework = 'DLDT'

model = cv2.dnn.readNet(weights, config, framework)
model.setPreferableTarget(targetId=targetId)

if len(sys.argv) > 1 and '-use_emotions' in sys.argv:
    emotions = cv2.dnn.readNet(weights_emotions, config_emotions, framework)
    emotions.setPreferableTarget(targetId=targetId)

emotions_decode = ('neutral', 'happy', 'sad', 'surprise', 'anger')

names = ["Plotnikov Egor", "Vainberg Roman", "Sataev Emil", "Unknown person"]

emotion_text = None

while(True):
    ret, frame = cap.read()

    blob = cv2.dnn.blobFromImage(frame, size=(672, 384), crop=False)

    have_nots = False

    model.setInput(blob)
    ans = model.forward()
    for i in range(0, 200):
        x_min, y_min, x_max, y_max = np.array(ans[0, 0, i, 3:7]) * np.array([640, 480, 640, 480])
        if ans[0, 0, i, 2] > 0.5:
            cv2.rectangle(frame, (int(x_min), int(y_min)), (int(x_max), int(y_max)), ( 0, 255, 255))

            if len(sys.argv) > 1 and '-use_emotions' in sys.argv:
                blob_emotions = cv2.dnn.blobFromImage(frame[int(y_min):int(y_max), int(x_min):int(x_max)], size=(64, 64), crop=False)
                emotions.setInput(blob_emotions)
                ans_emotions = emotions.forward()[0, : , 0 , 0]
                ans_emotions = list(map(lambda x: 1 if x > 0.5 else 0, ans_emotions))
                _t = ''.join(list(map(str,ans_emotions))).find('1')
                if _t == -1:
                    _t = 0
                emotion_text = emotions_decode[_t]

            if '-get_face_id' in sys.argv:
                _ans = getter.get_answer(frame[int(y_min):int(y_max), int(x_min):int(x_max)])

                t = check('labels.txt', _ans)
                #print(names[t])
                font = cv2.FONT_HERSHEY_SIMPLEX 
                cv2.putText(frame,names[t],(int(x_min), int(y_min)), font, 1,(255,255,255),2,cv2.LINE_AA)
                if emotion_text != None:
                    cv2.putText(frame,emotion_text,(int(x_min), int(y_max)), font, 1,(255,255,255),2,cv2.LINE_AA)

            if '-use_notifications' in sys.argv and not have_nots:
                toaster.show_toast("Welcome, " + names[t],"")
                have_nots = True

    cv2.imshow('frame',frame)

    if cv2.waitKey(1) & 0xFF == ord('q'):
        break


cap.release()
cv2.destroyAllWindows() 

我需要使用推理引擎构建OpenCV。我没有编程经验,也不知道这意味着什么。

当我尝试这样做时: https://github.com/opencv/opencv/wiki/Intel%27s-Deep-Learning-Inference-Engine-backend

然后尝试

v\modules\dnn\src\dnn.cpp:2670: error: (-2:Unspecified error) Build OpenCV with Inference Engine to enable loading models from Model Optimizer. in function 'cv::dnn::dnn4_v20190122::Net::readFromModelOptimizer'
C:\ Program Files(x86)\ IntelSWTools \ openvino_2019.1.148 \ opencv \ samples中的

它给出一个错误说:

cmake \
  -DWITH_INF_ENGINE=ON \
  -DENABLE_CXX11=ON \
  ...

即使该文件夹中有CMakeLists.txt。

有人可以帮我吗?

3 个答案:

答案 0 :(得分:0)

您可以只使用OpenVINO的OpenCV。它已经使用英特尔的推理引擎进行了编译。

答案 1 :(得分:0)

您应该将OpenCV添加到您的环境变量中。

打开环境变量窗口:在搜索框中键入var dataUK = [ ['gb-wi', 5] ]; var data = [ ['gb', 20, 'https://code.highcharts.com/mapdata/countries/gb/gb-all.geo.json', dataUK] ]; function getGeoJSON(url, chart, data) { $.getJSON(url, function(geojson) { updateChart(geojson, chart, data); }); } function updateChart(geojson, chart, data) { if (!chart) { createChart(geojson) } else { chart.series[0].remove(); chart.addSeries({ data: data, mapData: geojson }); } } function createChart(geojson) { Highcharts.mapChart('container', { ..., series: [{ point: { events: { click: function() { getGeoJSON(this.url, this.series.chart, this.newData) } } }, keys: ['hc-key', 'value', 'url', 'newData'], mapData: geojson, ... }] }); }

environment variables编辑Path,插入OpenCV路径作为您的安装路径。就我而言,我添加了并且能够使用它。

System Variables

您还需要检查首选的后端和目标,以选择推断后端和目标硬件。

请参阅以下API参考:

答案 2 :(得分:0)

对我来说,解决方案是删除OpenCV Python库并安装 opencv-python-inference-engine

pip3 uninstall opencv-python
pip3 uninstall opencv-contrib-python
pip3 install opencv-python-inference-engine