在运行Flask服务的GCP App Engine服务接收图像时出现问题

时间:2018-08-29 12:45:19

标签: android google-app-engine flask google-cloud-platform

我正在开发一种应用,使用户能够拍摄照片并将其发送到Keras模型进行预测。该模型已通过使用Flask通过POST接收图像的Python脚本部署在Google App Engine服务中,并请求图像并调用该模型进行预测。这是Python代码:

import numpy as np
import flask
import io
import logging
import tensorflow as tf
from keras.preprocessing.image import img_to_array
from keras.applications import imagenet_utils
from keras.models import load_model
from PIL import Image


# initialize our Flask application and the Keras model
app = flask.Flask(__name__)
app.config['PROPAGATE_EXCEPTIONS'] = True
model = None

def recortar(image):
    # Function that centers and crop image. Please, asume that it works properly. Return is a numpy array.
    return image

@app.route("/predict", methods=["POST"])
def predict():
    model = load_model('modelo_1.h5')
    graph = tf.get_default_graph()
    data = {"success": False}

    if flask.request.method == "POST":
        if flask.request.files.get("image"):
            # read the image in PIL format
            image = flask.request.files["image"].read()
            image = Image.open(io.BytesIO(image))

            image = recortar(image)
            app.logger.info('Tamaño: '+str(image.size))
            image = img_to_array(image)
            image = np.expand_dims(image, axis=0)

            with graph.as_default():
                preds = model.predict(image)

            data['predictions'] = str(np.squeeze(preds).tolist())

            data["success"] = True  
            return flask.jsonify(data)
        else:
            return "No se ha obtenido la imagen"
    else:
        return "El HTTP request no era POST"

# if this is the main thread of execution first load the model and
# then start the server
if __name__ == "__main__":
    print(("* Loading Keras model and Flask starting server..."
        "please wait until server has fully started"))
    app.debug = True
    app.run()

通过curl发送图像效果很好:正如预期的那样,我从包含预测的服务器获得了JSON响应。这是CURL命令和服务器响应:

>> curl -X POST -F image=@nevus.jpg 'https://example.com/predict'
{"predictions":"[0.7404708862304688, 0.25952914357185364]","success":true}

然后,我尝试通过Android应用程序重复相同的过程,但得到500错误作为响应。在检查Stackdriver Error Reporting上的日志时,我看到以下stacktrace:AttributeError:

'NoneType' object has no attribute 'size'
at predict (/home/vmagent/app/main.py:73)
at dispatch_request (/env/lib/python3.6/site-packages/flask/app.py:1799)
at full_dispatch_request (/env/lib/python3.6/site-packages/flask/app.py:1813)
at reraise (/env/lib/python3.6/site-packages/flask/_compat.py:35)
at handle_user_exception (/env/lib/python3.6/site-packages/flask/app.py:1718)
at full_dispatch_request (/env/lib/python3.6/site-packages/flask/app.py:1815)
at wsgi_app (/env/lib/python3.6/site-packages/flask/app.py:2292)
at reraise (/env/lib/python3.6/site-packages/flask/_compat.py:35)
at handle_exception (/env/lib/python3.6/site-packages/flask/app.py:1741)
at wsgi_app (/env/lib/python3.6/site-packages/flask/app.py:2295)
at __call__ (/env/lib/python3.6/site-packages/flask/app.py:2309)
at handle_request (/env/lib/python3.6/site-packages/gunicorn/workers/sync.py:176)
at handle (/env/lib/python3.6/site-packages/gunicorn/workers/sync.py:135)

此错误涉及图像对象,因此我认为,由于代码之前工作正常,因此该错误一定是通过HTTP请求发送图像的方式。回想一下,当用户单击按钮时就拍摄了图像,因为该按钮发送了拍摄照片的意图。拍照后,用户可以单击“发送”按钮,我将其代码发布在下面。请注意,取向的位图对应于以位图格式拍摄的照片。

btn_enviarfoto.setOnClickListener(new View.OnClickListener() {
            @Override
            public void onClick(View v) {
                Log.d(TAG, "Botón \"enviar\" pulsado. Codificando imagen.");
                ByteArrayOutputStream stream = new ByteArrayOutputStream();
                orientedBitmap.compress(Bitmap.CompressFormat.PNG, 100, stream);
                byte[] byteArray = stream.toByteArray();
                orientedBitmap.recycle();
                uploadToServer(byteArray);
            }
        });

uploadToServer只是调用AsynchTask类的execute methong,如下所示:

private void uploadToServer(byte[] data) {
        Bitmap bitmapOrg = BitmapFactory.decodeByteArray(data, 0, data.length);
        Log.d(TAG, "Imagen codificada. Enviando al servidor.");
        ObtenerPrediccionTask task = new ObtenerPrediccionTask();
        task.execute(bitmapOrg);    
    }

最后也是最重要的是,这是ObtenerPrediccionTask类的代码:

public class ObtenerPrediccionTask extends AsyncTask<Bitmap, Void, String> {

    @Override
    protected String doInBackground(Bitmap... imagen) {
        ByteArrayOutputStream bao = new ByteArrayOutputStream();
        HttpURLConnection connection = null;
        DataOutputStream outputStream = null;
        String probabilidad_melanoma = "";
        JsonReader jsonReader = null;


        try {
            for (int i = 0; i < imagen.length; i++) {
                Bitmap imagen2 = imagen[i];
                imagen2.compress(Bitmap.CompressFormat.JPEG, 90, bao);
                byte[] ba = bao.toByteArray();
                InputStream fileInputStream = new ByteArrayInputStream(ba);


                URL url = new URL("https://example.com/predict"); // not the real URL

                String lineEnd = "\r\n";
                String twoHyphens = "--";
                String boundary = "xxxxxxxx";
                String str = twoHyphens + boundary + lineEnd;


                connection = (HttpURLConnection) url.openConnection();

                // Allow Inputs & Outputs
                connection.setDoInput(true);
                connection.setDoOutput(true);
                connection.setUseCaches(false);

                // Enable POST method
                connection.setRequestMethod("POST");

                connection.setRequestProperty("Connection", "Keep-Alive");
                connection.setRequestProperty("Content-Type", "multipart/form-data;boundary=" + boundary);

                outputStream = new DataOutputStream(connection.getOutputStream());
                outputStream.writeBytes(twoHyphens + boundary + lineEnd);
                outputStream.writeBytes("Content-Disposition: form-data; name=\"" +
                        "image" + "\";filename=\"" +
                        "foto.jpg" + "\"" + lineEnd);
                outputStream.writeBytes(lineEnd);

                int bytesAvailable = fileInputStream.available();
                int bufferSize = Math.min(bytesAvailable, 1024);
                byte[] buffer = new byte[bufferSize];

                // Read file
                int bytesRead = fileInputStream.read(buffer, 0, bufferSize);

                while (bytesRead > 0) {
                    outputStream.write(buffer, 0, bufferSize);
                    bytesAvailable = fileInputStream.available();
                    bufferSize = Math.min(bytesAvailable, 1024);
                    bytesRead = fileInputStream.read(buffer, 0, bufferSize);
                }

                outputStream.writeBytes(lineEnd);
                outputStream.writeBytes(twoHyphens + boundary + twoHyphens + lineEnd);

                // Responses from the server (code and message)
                int responseCode = connection.getResponseCode();
                connection.getResponseMessage();

                fileInputStream.close();
                outputStream.flush();
                outputStream.close();

                if (responseCode == HttpURLConnection.HTTP_OK) {
                    InputStream responseStream = new
                            BufferedInputStream(connection.getInputStream());

                    BufferedReader responseStreamReader =
                            new BufferedReader(new InputStreamReader(responseStream));

                    String line = "";
                    StringBuilder stringBuilder = new StringBuilder();

                    while ((line = responseStreamReader.readLine()) != null) {
                        stringBuilder.append(line).append("\n");
                    }
                    responseStreamReader.close();

                    String response = stringBuilder.toString();
                    Log.d(TAG, "Imagen recibida por el servidor y pasada al modelo. Esta es la respuesta: " + response);

                    jsonReader = new JsonReader(new StringReader(response));
                    probabilidad_melanoma = readJson(jsonReader);
                } else {
                    Log.d(TAG, Integer.toString(responseCode));
                }
            }
            return probabilidad_melanoma;
        } catch (MalformedURLException malformedURLException) {
            Log.e(TAG, malformedURLException.toString());
            return null;
        } catch (IOException io) {
            Log.e(TAG, io.toString());
            return null;
        } finally {
            if (connection != null) {
                connection.disconnect();
            }
        }
    }

    protected void onPostExecute(String probabilidad_melanoma) {
        if (probabilidad_melanoma != null) {
            Log.d(TAG, "Probabilidad melanoma: " + probabilidad_melanoma);
        } else {
            Log.w(TAG, "La respuesta ha sido nula");
        }
    }
}

readJson函数也可以正常工作,所以不要被它困扰。

最后一段代码是在SO中进行广泛搜索以找到一种正确发送图像的方法的结果,但是由于没有任何效果,我已经耗尽了所有想法。我的代码有什么问题?

1 个答案:

答案 0 :(得分:2)

崩溃回溯表明此行imageNone

        app.logger.info('Tamaño: '+str(image.size))

这意味着recortar()返回None,尽管您有评论:

# Function that centers and crop image. Please, asume that it works properly. Return is a numpy array.

所以您的the error must be in the way I send the image through the HTTP request假设可能是错误的。在花时间之前,我先添加检查以确保recortar()正常工作。