按块上传视频文件

时间:2012-04-11 16:55:16

标签: java api upload vimeo scribe

是的,这是一个很长的问题,有很多细节...... 所以,我的问题是:我如何在段中将上传流式传输到Vimeo?

对于想要在自己的计算机上进行复制和调试的人:以下是您需要的内容:

  • 我的代码here
  • 包括找到here
  • 的Scribe库
  • 拥有一个至少大于10 MB的有效视频文件(mp4)并将其放在目录C:\test.mp4中,或将该代码更改为指向您所在的位置。
  • 就是这样!谢谢你帮帮我!

大更新:我在代码here中留下了一个有效的API Key和Secret for Secret for Vimeo。因此,只要您拥有Vimeo帐户,一旦您允许应用程序并输入令牌,所有代码都可以正常工作。只需将该链接中的代码复制到您喜欢的IDE上的项目中,看看是否可以通过我来解决这个问题。我会把奖金交给给我工作代码的人。谢谢!哦,不要指望长期使用这个Key和Secret。一旦这个问题得到解决,我就会删除它。 :)

问题概述:问题是当我将最后一块字节发送到Vimeo然后验证上传时,响应返回所有内容的长度仅为最后一块,而不是所有的块组合在一起。

SSCCE注意:我有我的整个SSCCE here。我把它放在其他地方所以它可以 C 可以使用。它不是非常 S hort(大约300行),但希望你发现它是 S 精灵包含的,它肯定是 E xample!)。但是,我在这篇文章中发布了我的代码的相关部分。

这就是它的工作方式:当您通过流媒体方式将视频上传到Vimeo时(请参阅上传API文档here以获取设置以达到这一点),您必须提供一些标题:端点,内容长度和内容类型。文档说它忽略了任何其他标题。您还要为其上传的文件提供字节信息的有效负载。然后签名并发送它(我有一个方法可以使用scribe)。

我的问题:当我在一个请求中发送视频时,一切都很有效。我的问题是在我上传几个较大的文件的情况下,我正在使用的计算机没有足够的内存来加载所有的字节信息并将其放入HTTP PUT请求中,因此我必须将其拆分为1 MB段。这是事情变得棘手的地方。该文档提到可以“恢复”上传,所以我试图用我的代码做到这一点,但它不能正常工作。下面,您将看到发送视频的代码。 请记住我的SSCCE为here

我尝试过的事情:我认为它与Content-Range标题有关...所以这里是我尝试改变内容范围的内容标题说......

  • 不向第一个块添加内容范围标题
  • 在内容范围标题中添加前缀(每个标题都包含前一个标题的组合):

    • “字节”
    • “bytes”(抛出连接错误,请参阅错误的最底部) - >它出现在documentation中,这是他们正在寻找的内容,但我很确定文档中存在拼写错误,因为它们的“简历”示例中包含内容范围标题:{{1它应该是1001-339108/339108。所以......是的......
    • “字节%20”
    • “字节:”
    • “bytes:”
    • “字节=”
    • “bytes =”
  • 不在内容范围标题中添加任何内容作为前缀

以下是代码:

1001-339107/339108

这是signAndSendToVimeo方法:

/**
* Send the video data
*
* @return whether the video successfully sent
*/
private static boolean sendVideo(String endpoint, File file) throws FileNotFoundException, IOException {
  // Setup File
  long contentLength = file.length();
  String contentLengthString = Long.toString(contentLength);
  FileInputStream is = new FileInputStream(file);
  int bufferSize = 10485760; // 10 MB = 10485760 bytes
  byte[] bytesPortion = new byte[bufferSize];
  int byteNumber = 0;
  int maxAttempts = 1;
  while (is.read(bytesPortion, 0, bufferSize) != -1) {
    String contentRange = Integer.toString(byteNumber);
    long bytesLeft = contentLength - byteNumber;
    System.out.println(newline + newline + "Bytes Left: " + bytesLeft);
    if (bytesLeft < bufferSize) {
      //copy the bytesPortion array into a smaller array containing only the remaining bytes
      bytesPortion = Arrays.copyOf(bytesPortion, (int) bytesLeft);
      //This just makes it so it doesn't throw an IndexOutOfBounds exception on the next while iteration. It shouldn't get past another iteration
      bufferSize = (int) bytesLeft;
    }
    byteNumber += bytesPortion.length;
    contentRange += "-" + (byteNumber - 1) + "/" + contentLengthString;
    int attempts = 0;
    boolean success = false;
    while (attempts < maxAttempts && !success) {
      int bytesOnServer = sendVideoBytes("Test video", endpoint, contentLengthString, "video/mp4", contentRange, bytesPortion, first);
      if (bytesOnServer == byteNumber) {
        success = true;
      } else {
        System.out.println(bytesOnServer + " != " + byteNumber);
        System.out.println("Success is not true!");
      }
      attempts++;
    }
    first = true;
    if (!success) {
      return false;
    }
  }
  return true;
}

/**
* Sends the given bytes to the given endpoint
*
* @return the last byte on the server (from verifyUpload(endpoint))
*/
private static int sendVideoBytes(String videoTitle, String endpoint, String contentLength, String fileType, String contentRange, byte[] fileBytes, boolean addContentRange) throws FileNotFoundException, IOException {
  OAuthRequest request = new OAuthRequest(Verb.PUT, endpoint);
  request.addHeader("Content-Length", contentLength);
  request.addHeader("Content-Type", fileType);
  if (addContentRange) {
    request.addHeader("Content-Range", contentRangeHeaderPrefix + contentRange);
  }
  request.addPayload(fileBytes);
  Response response = signAndSendToVimeo(request, "sendVideo on " + videoTitle, false);
  if (response.getCode() != 200 && !response.isSuccessful()) {
    return -1;
  }
  return verifyUpload(endpoint);
}

/**
* Verifies the upload and returns whether it's successful
*
* @param endpoint to verify upload to
* @return the last byte on the server
*/
public static int verifyUpload(String endpoint) {
  // Verify the upload
  OAuthRequest request = new OAuthRequest(Verb.PUT, endpoint);
  request.addHeader("Content-Length", "0");
  request.addHeader("Content-Range", "bytes */*");
  Response response = signAndSendToVimeo(request, "verifyUpload to " + endpoint, true);
  if (response.getCode() != 308 || !response.isSuccessful()) {
    return -1;
  }
  String range = response.getHeader("Range");
  //range = "bytes=0-10485759"
  return Integer.parseInt(range.substring(range.lastIndexOf("-") + 1)) + 1;
  //The + 1 at the end is because Vimeo gives you 0-whatever byte where 0 = the first byte
}

这是一些(一个例子......所有输出都可以找到here)printRequest和printResponse方法的输出:注意此输出根据/** * Signs the request and sends it. Returns the response. * * @param service * @param accessToken * @param request * @return response */ public static Response signAndSendToVimeo(OAuthRequest request, String description, boolean printBody) throws org.scribe.exceptions.OAuthException { System.out.println(newline + newline + "Signing " + description + " request:" + ((printBody && !request.getBodyContents().isEmpty()) ? newline + "\tBody Contents:" + request.getBodyContents() : "") + ((!request.getHeaders().isEmpty()) ? newline + "\tHeaders: " + request.getHeaders() : "")); service.signRequest(accessToken, request); printRequest(request, description); Response response = request.send(); printResponse(response, description, printBody); return response; } 的设置和contentRangeHeaderPrefix布尔值设置为更改(指定是否在第一个块上包含Content-Range标头)。

first

然后代码继续完成上传并设置视频信息(您可以在my full code中看到)。

编辑2 :尝试从内容范围中删除“%20”并收到此错误进行连接。我必须使用“bytes%20”或者根本不添加“bytes”...

We're sending the video for upload!


Bytes Left: 15125120


Signing sendVideo on Test video request:
    Headers: {Content-Length=15125120, Content-Type=video/mp4, Content-Range=bytes%200-10485759/15125120}

sendVideo on Test video >>> Request
Headers: {Authorization=OAuth oauth_signature="zUdkaaoJyvz%2Bt6zoMvAFvX0DRkc%3D", oauth_version="1.0", oauth_nonce="340477132", oauth_signature_method="HMAC-SHA1", oauth_consumer_key="5cb447d1fc4c3308e2c6531e45bcadf1", oauth_token="460633205c55d3f1806bcab04174ae09", oauth_timestamp="1334336004", Content-Length=15125120, Content-Type=video/mp4, Content-Range=bytes: 0-10485759/15125120}
Verb: PUT
Complete URL: http://174.129.125.96:8080/upload?ticket_id=5ea64d64547e38e5e3c121852b2d306d

sendVideo on Test video >>> Response
Code: 200
Headers: {null=HTTP/1.1 200 OK, Content-Length=0, Connection=close, Content-Type=text/plain, Server=Vimeo/1.0}


Signing verifyUpload to http://174.129.125.96:8080/upload?ticket_id=5ea64d64547e38e5e3c121852b2d306d request:
    Headers: {Content-Length=0, Content-Range=bytes */*}

verifyUpload to http://174.129.125.96:8080/upload?ticket_id=5ea64d64547e38e5e3c121852b2d306d >>> Request
Headers: {Authorization=OAuth oauth_signature="FQg8HJe84nrUTdyvMJGM37dpNpI%3D", oauth_version="1.0", oauth_nonce="298157825", oauth_signature_method="HMAC-SHA1", oauth_consumer_key="5cb447d1fc4c3308e2c6531e45bcadf1", oauth_token="460633205c55d3f1806bcab04174ae09", oauth_timestamp="1334336015", Content-Length=0, Content-Range=bytes */*}
Verb: PUT
Complete URL: http://174.129.125.96:8080/upload?ticket_id=5ea64d64547e38e5e3c121852b2d306d

verifyUpload to http://174.129.125.96:8080/upload?ticket_id=5ea64d64547e38e5e3c121852b2d306d >>> Response
Code: 308
Headers: {null=HTTP/1.1 308 Resume Incomplete, Range=bytes=0-10485759, Content-Length=0, Connection=close, Content-Type=text/plain, Server=Vimeo/1.0}
Body: 


Bytes Left: 4639360


Signing sendVideo on Test video request:
    Headers: {Content-Length=15125120, Content-Type=video/mp4, Content-Range=bytes: 10485760-15125119/15125120}

sendVideo on Test video >>> Request
Headers: {Authorization=OAuth oauth_signature="qspQBu42HVhQ7sDpzKGeu3%2Bn8tM%3D", oauth_version="1.0", oauth_nonce="183131870", oauth_signature_method="HMAC-SHA1", oauth_consumer_key="5cb447d1fc4c3308e2c6531e45bcadf1", oauth_token="460633205c55d3f1806bcab04174ae09", oauth_timestamp="1334336015", Content-Length=15125120, Content-Type=video/mp4, Content-Range=bytes%2010485760-15125119/15125120}
Verb: PUT
Complete URL: http://174.129.125.96:8080/upload?ticket_id=5ea64d64547e38e5e3c121852b2d306d

sendVideo on Test video >>> Response
Code: 200
Headers: {null=HTTP/1.1 200 OK, Content-Length=0, Connection=close, Content-Type=text/plain, Server=Vimeo/1.0}


Signing verifyUpload to http://174.129.125.96:8080/upload?ticket_id=5ea64d64547e38e5e3c121852b2d306d request:
    Headers: {Content-Length=0, Content-Range=bytes */*}

verifyUpload to http://174.129.125.96:8080/upload?ticket_id=5ea64d64547e38e5e3c121852b2d306d >>> Request
Headers: {Authorization=OAuth oauth_signature="IdhhhBryzCa5eYqSPKAQfnVFpIg%3D", oauth_version="1.0", oauth_nonce="442087608", oauth_signature_method="HMAC-SHA1", oauth_consumer_key="5cb447d1fc4c3308e2c6531e45bcadf1", oauth_token="460633205c55d3f1806bcab04174ae09", oauth_timestamp="1334336020", Content-Length=0, Content-Range=bytes */*}
Verb: PUT
Complete URL: http://174.129.125.96:8080/upload?ticket_id=5ea64d64547e38e5e3c121852b2d306d

4639359 != 15125120
verifyUpload to http://174.129.125.96:8080/upload?ticket_id=5ea64d64547e38e5e3c121852b2d306d >>> Response
Success is not true!
Code: 308
Headers: {null=HTTP/1.1 308 Resume Incomplete, Range=bytes=0-4639359, Content-Length=0, Connection=close, Content-Type=text/plain, Server=Vimeo/1.0}
Body: 

编辑1:更新了代码和输出。仍然需要帮助!

4 个答案:

答案 0 :(得分:6)

我认为你的问题可能只是这一行的结果:

request.addHeader("Content-Range", "bytes%20" + contentRange);

仅通过"bytes%20"

尝试并替换"bytes "

在您的输出中,您会看到相应的标头内容不正确:

Headers: {
    Content-Length=15125120,
    Content-Type=video/mp4,
    Content-Range=bytes%200-10485759/15125120     <-- INCORRECT
}

关于Content-Range ...

的主题

你是对的,一个示例最终内容块的范围应该是14680064-15125119/15125120。这是HTTP 1.1规范的一部分。

答案 1 :(得分:2)

下面

 String contentRange = Integer.toString(byteNumber + 1);

从1开始,而不是在第一次迭代时从0开始。

下面

 request.addHeader("Content-Length", contentLength);

你把整个文件的内容长度而不是当前块的长度。

答案 2 :(得分:0)

vimeo API页面说: “最后一步是调用vimeo.videos.upload.complete来排队视频以进行转码。此调用将返回video_id,然后您可以在其他调用中使用(设置标题,描述,隐私等)如果你不打电话给这种方法,视频将不会被处理。“

我将这段代码添加到最后并使其工作:

    request = new OAuthRequest(Verb.PUT, "http://vimeo.com/api/rest/v2");
    request.addQuerystringParameter("method", "vimeo.videos.upload.complete");
    request.addQuerystringParameter("filename", video.getName());
    request.addQuerystringParameter("ticket_id", ticket);
    service.signRequest(token, request);        

    response = request.send();

答案 3 :(得分:-1)

检查此:

String contentRange="bytes "+lastBytesSend+"-"+ ((totalSize - lastBytesSend)-1)+"/"+totalSize ;

request.addHeader("Content-Range",contentRange);