使用谷歌应用引擎将文件上传到blobstore时出现http 400错误

时间:2014-05-22 05:58:34

标签: java google-app-engine http servlets io

我尝试使用Google应用引擎blobstore上传文件。

它应该像这样工作:你调用BlobstoreService来获取一个上传URL,提供一个回调URL。客户端被重定向到上传URL,发送数据,然后当他们完成后,他们将被重定向到回调URL,其中包含几个代表blobstore密钥的参数。

我们将看到开发服务器与生产服务器的行为不同。

对于生产,我的代码到达完成上传,然后我没有得到重定向到我的回调URL,而是得到400错误响应(暗示我的请求有问题)。如何在生产中调试它?我不知道如何打开blobstore的日志记录。

所以我尝试在dev服务器上本地运行它。这一次,如果我没有设置内容长度'属性,我得到411(内容长度未设置)。但是如果我尝试设置该属性,我会得到IllegalStateException:已经连接了#39;这些例外都不会对生产产生影响。

所以我不知道接下来要去哪里。我需要让它与dev一起工作,希望我可以在本地调试blobstore,或者解决为什么它不能在生产中使用blobstore。

    public void upload(String uri, File file) throws IOException    {
    HttpURLConnection conn=null;
    HttpURLConnection conn2=null;
    FileInputStream fileInputStream = null;
    DataOutputStream dos=null;
    try {
        String lineEnd = "\r\n";
        String twoHyphens = "--";
        String boundary = "*****";
        int bytesRead, bytesAvailable, bufferSize;
        byte[] buffer;
        int maxBufferSize = 1 * 1024 * 1024; 
        // open a URL connection to the Servlet
        fileInputStream = new FileInputStream(file);
        URL url = new URL(uri);

        // Open a HTTP  connection to  the URL
        conn = (HttpURLConnection) url.openConnection();
        conn.setDoInput(true); // Allow Inputs
        conn.setDoOutput(true); // Allow Outputs
        conn.setUseCaches(false); // Don't use a Cached Copy
        conn.setInstanceFollowRedirects(false);
        conn.setRequestMethod("POST");
        conn.setRequestProperty("Connection", "Keep-Alive");
        conn.setRequestProperty("ENCTYPE", "multipart/form-data");
        conn.setRequestProperty("Content-Type", "multipart/form-data;boundary=" + boundary);
//          conn.setChunkedStreamingMode(1024);
        conn.setRequestProperty("content-length", String.valueOf(file.length()));   //caused IllegalStateException "Already connected" locally, but not remotely

        log("Orignal URL: " + conn.getURL());
        //conn.connect();   //TODO duplicates url.openConnection() above?
        conn.getInputStream();  //so we can follow the redirect
        String redirectedUrl = conn.getHeaderField("Location");
        log("Redirected URL: " + redirectedUrl);
        //this is horrible and messy but let's get it working then clean it up later

        conn.disconnect();
        url = new URL(redirectedUrl);

        // Open a new HTTP  connection to  the URL
        conn2 = (HttpURLConnection) url.openConnection();
        conn2.setDoInput(true); // Allow Inputs
        conn2.setDoOutput(true); // Allow Outputs
        conn2.setUseCaches(false); // Don't use a Cached Copy
        conn2.setInstanceFollowRedirects(false);
        conn2.setRequestMethod("POST");
        conn2.setRequestProperty("Connection", "Keep-Alive");
        conn2.setRequestProperty("ENCTYPE", "multipart/form-data");
        conn2.setRequestProperty("Content-Type", "multipart/form-data;boundary=" + boundary);
        conn2.setChunkedStreamingMode(maxBufferSize);
        conn2.setRequestProperty("Content-Length", String.valueOf(file.length()));
        conn2.connect();
        dos = new DataOutputStream(conn2.getOutputStream());

        dos.writeBytes(twoHyphens + boundary + lineEnd);
        dos.writeBytes("Content-Disposition: form-data; name=\"myFile\";filename=\""+file.getName()+"\"" + lineEnd);
        dos.writeBytes(lineEnd);

        // create a buffer of  maximum size
        bytesAvailable = fileInputStream.available();

        bufferSize = Math.min(bytesAvailable, maxBufferSize);
        buffer = new byte[bufferSize];

        // read file and write it into form...
        bytesRead = fileInputStream.read(buffer, 0, bufferSize); 

        while (bytesRead > 0) {
            dos.write(buffer, 0, bufferSize);
            bytesAvailable = fileInputStream.available();
            bufferSize = Math.min(bytesAvailable, maxBufferSize);
            bytesRead = fileInputStream.read(buffer, 0, bufferSize);  
        }

        // send multipart form data necesssary after file data...
        dos.writeBytes(lineEnd);
        dos.writeBytes(twoHyphens + boundary + twoHyphens + lineEnd);

        // Responses from the server (code and message)
        int serverResponseCode = conn2.getResponseCode();
        String serverResponseMessage = conn2.getResponseMessage();
        //we are expecting another redirect here
        log("aaaargh! 400 instead of 302! "+serverResponseCode+" to "+conn2.getHeaderField("Location"));
    }catch (IOException e)  {
        log(e.getMessage());
        throw e;
    }catch(Exception e) {
        log(e.getMessage());
        throw new IOException(e);
    }   finally {
        //close the streams //
        if (dos!=null)  {   
            try {
                dos.flush();
                dos.close();
            }catch(IOException ioe){}
        }
        if (fileInputStream!=null)
            try {
                fileInputStream.close();
            }catch(IOException ioe){}

        if (conn!=null )
            try {
                conn.disconnect();
            }catch(Exception ioe){}

        if (conn2!=null)
            try {
                conn2.disconnect();
            }catch(Exception ioe){}

    }
}

注意上面的serverResponseMessage字符串从生产blobstore返回为" Bad Request"

2 个答案:

答案 0 :(得分:1)

我不知道如何从Android客户端执行此操作,但我可以向您展示我们是如何从javascript客户端执行此操作的,因为可能会给您一些指示。

客户端很简单(这是一个angular.js控制器),我们得到要使用的URL并上传到它

// model file upload
    $scope.onFileSelect = function ($files) {
        $scope.uploadStatus = 'loading';
        for (var i = 0; i < $files.length; i++) {
            var file = $files[i];
            console.log(file);

            $http.get('/endpoints/prototype/' + $scope.prototype.key + '/file/url')
                .success((function (data) {
                        console.log(data);

                        $scope.upload = $upload.upload({
                            url: data,
                            withCredentials: true,
                            file: file
                        })
                        .success(function (data) {
                            console.log(data);
                            $scope.prototype.modelFile = data;
                        })
                        .error(function (data, status) {
                            console.error(data);
                            $scope.uploadStatus = 'error';
                            $scope.uploadError = status;
                        });
                }))
                .error((function (data, status) {
                    console.error(data);
                    $scope.uploadStatus = 'error';
                    $scope.uploadError = status;
                }));
        }
    };

服务器端,我们有一个端点,它返回用于帖子的URL(这是一个Spring MVC控制器)。请注意,我们在createUploadUrl()

中指定成功路径
@RequestMapping(value = "/endpoints/prototype/{key}/file/url", method = RequestMethod.GET)
@ResponseBody
public String getFileUploadUrl(@PathVariable("key") String prototypeKey) {
    final UploadOptions uploadOptions = Builder.withDefaults()
          .googleStorageBucketName("palmyra-prototype-store");

    return blobstoreService.createUploadUrl("/endpoints/prototype/" + prototypeKey + "/file", uploadOptions);
}

最后,在上传成功后调用的端点

@RequestMapping(value = "/endpoints/prototype/{key}/file", method = RequestMethod.POST)
@ResponseBody
public String handleFileUpload(@PathVariable("key") String prototypeKey, HttpServletRequest request) {
    final Map<String, List<BlobKey>> blobs = blobstoreService.getUploads(request);
    final Map<String, List<FileInfo>> allFileInfos = blobstoreService.getFileInfos(request);

    final List<BlobKey> blobKeys = blobs.get(INPUT_FILE_NAME);
    final List<FileInfo> fileInfos = allFileInfos.get(INPUT_FILE_NAME);

    if ((blobKeys == null) || (fileInfos == null)) {
        return "You failed to upload a model file for " + prototypeKey + " because the file was empty.";
    } else if ((blobKeys.size() == 1) && (fileInfos.size() == 1)) {
        final BlobKey blobKey = blobKeys.get(0);
        final FileInfo fileInfo = fileInfos.get(0);

        final Prototype prototype = prototypeService.findByKey(prototypeKey);
        prototype.setModelFile(blobInfoFactory.loadBlobInfo(blobKey).getFilename());
        prototype.setUploadedModelFile(fileInfo.getGsObjectName());

        prototypeService.updatePrototype(prototypeKey, prototype);

        return blobInfoFactory.loadBlobInfo(blobKey).getFilename();
    } else {
        return "One and only one file is allowed to be uploaded. The related prototype is " + prototypeKey +
              ". The number of blobs is " + blobKeys.size() + ", the number of files is " + fileInfos.size();
    }
}

就是这样,希望它可以帮助你解决问题。

答案 1 :(得分:0)

我通过使用更高级别的API而不是我尝试使用的低级HttpConnection代码来解决这个问题。

    public String uploadFile(String url, File f) throws Exception   {
    HttpClient httpClient = new DefaultHttpClient();    
    String str = "";
    HttpPost first = new HttpPost(url);  //a GET should work but I was getting 405
    HttpResponse firstResponse = httpClient.execute(first);
    str = firstResponse.getFirstHeader("Location").getValue();
    //Post image to generated url
    HttpPost second = new HttpPost(str);
    FileBody fileBody = new FileBody(f);
    MultipartEntity reqEntity = new MultipartEntity();
    reqEntity.addPart("file", fileBody);
    second.setEntity(reqEntity);
    httpClient = new DefaultHttpClient();
    HttpResponse secondResponse = httpClient.execute(second); 
    str = secondResponse.getFirstHeader("Location").getValue();
    log(str);
    return str;
}

此方法返回上传图片的服务网址。