Tomcat 6.0大文件上传(> 2 GB)

时间:2012-03-03 03:20:54

标签: java file-upload

我在使用大于2GB的文件上传HTTP文件时遇到问题。服务器和客户端都是64位,因此从系统角度来看,必须没有2GB的限制。我做了以下事情:

  1. 在Apache中 LimitRequestBody = 0(http://httpd.apache.org/docs/2.0/mod/core.html#LimitRequestBody
  2. 在Tomcat连接器中 maxPostSize = 0(http://tomcat.apache.org/tomcat-5.5-doc/config/ajp.html
  3. 我正在使用apache commons文件上传。我还尝试使用ServerFileUpload setMaxFileSize方法设置最大文件大小。

    我能够上传小于2GB的文件(我成功尝试了1.88GB文件)。请指点我,我在这里错过了什么?

    更具体的说,ServletFileUpload.parseRequest方法在上传大文件时返回0 FileItems

    以下是代码段:

    if (isMultipartForm()) {
    try {
        DiskFileItemFactory factory = new DiskFileItemFactory();
        factory.setSizeThreshold(SIZE_THRESHOLD);//SIZE_THRESHOLD = 4MB
        ServletFileUpload upload = new ServletFileUpload(factory);
            //upload.setFileSizeMax(3000000000L); Tried this too
        upload.setProgressListener(progressListener);
        items = upload.parseRequest(request);
        if(items != null && items.size() == 0)
        return new CommandResultSet(false, "NoItemsFoundInRequest");
        return new CommandResultSet(true, "" + ( (items!=null) ? items.size() : ""));
    } catch(FileUploadException e) {
        e.printStackTrace();
        System.out.println("Exception in MultipartFormManager. Can not parse request.");    
        return new CommandResultSet(false, e.getMessage());
        }
    }
    

4 个答案:

答案 0 :(得分:2)

如果您使用的是common-fileupload 1.1或更旧版本,则无法上传(1.9888)~2GB。这里的问题是这个jar正在调用一个名为getContentLength的方法,该方法是int类型,因此您的请求只能处理大小为Integer.MAX_VALUE的大小。在像1.3这样的common-fileupload的最新版本中,这已经解决了。 希望这会有所帮助。

答案 1 :(得分:1)

我当然可能出现新的错误但我还没有发现即使64位浏览器也能处理大于2GB的上传。问题不是服务器而是浏览器。您会发现奇怪的是,大多数现代浏览器都会很乐意从标准服务器下载大于2GB的文件,无需特殊配置。

答案 2 :(得分:0)

如果您希望上传这些尺寸的文件,我不会依赖直接的浏览器上传。 Java applet甚至可能是Flash文件(不确定,如果可能,不是Flash人员)将是我的建议,因此您可以将文件分成块。如果上传中断,您可以从上次停止的位置恢复。

答案 3 :(得分:0)

Jsp code :
<script src="../lib/app/configurator.data.ajax.js" type="text/javascript"></script>
<script src="../lib/ui/jquery.fileupload.js"></script>
<html>

<script language="Javascript">
var varb = '';
var test = 0;
var count = 1;
$(function () {
var maxChunkSize = 30000000; //SET CHUNK SIZE HERE
var your_global_var_for_form_submit = '';

var params = {
        year: threeDSelectedYear,
        series: threeDSelectedSeries
};
/*File upload bind with form, 'fileupload' is my form id. As sumit triggers
    for file ulaod will submit my form*/
/* replaceFileInput: true, */
$('#fileupload').fileupload({
maxChunkSize: maxChunkSize,
url: efccustom.getEfcContext()+'upload/uploadZip?year='+threeDSelectedYear+'&series='+threeDSelectedSeries,             //URL WHERE FILE TO BE UPLOADED
    error: function (jqXHR, textStatus, errorThrown) {
    // Called for each failed chunk upload
        $(".fileupload-loading").html("");
         $('.ANALYZE_DIALOG').dialog("close");       
    },

    success: function (data, textStatus, jqXHR) {
    /*This event will be called on success of upload*/
    count = parseInt($('#counter').val()) + 1;
    $('#counter').val(count);

    $('#ttk').val(count);
    data.ttk = 7;
    console.log(" count ",count , data);
    },

    submit: function (e, data) {
    /*This event will be called on submit here i am
                     adding variable to form*/
    //console.log($('#zip_uploaded_file').val());      

    //console.log(data.originalFiles[0].name);            
    test = data.originalFiles[0];
    $('#fname').val(data.originalFiles[0].name);
    $('#trequests').val(Math.ceil(data.originalFiles[0].size/maxChunkSize));
    $('#counter').val('1');
    },

    progress: function (e, data) {
    /*PROGRESS BAR CODE WILL BE HERE */
        $(".fileupload-loading").html('<img src="../public/themeroller/images/throbber.gif" alt="Uploading Please Wait..." title="Uploading Please Wait...." />');       
    },

    add: function (e, data) {
    $('.browsedFileName').html(data.originalFiles[0].name);
    your_global_var_for_form_submit = data;
    },

    done: function (e, data) {

        ajaxcall.Data._get('upload/extractZipNCreateJson',params,function(data2) {
            alert("file upload success ");
             $(".fileupload-loading").html("");
             $('.ANALYZE_DIALOG').dialog("close");
        });


    }

});
/*This is my button click event on which i am submitting my form*/
  $('#button').click(function(){
    your_global_var_for_form_submit.submit();
  });
});
</script>

<html>

<body>


<form id="fileupload" enctype="multipart/form-data"> 
<div class="row fileupload-buttonbar">
<div class="span7">
<!--<input type="file" name="files" id="file" /> -->

<input type="file" id="zip_uploaded_file"  name="zip_uploaded_file"  />
<input type="hidden" name="counter" id="counter" value="1" />
<input type="hidden" name="fname" id="fname" value="" />
<input type="hidden" name="trequests" id="trequests" value="1" />

<input type="hidden" name="ttk" id="ttk" value="1" />
<input type="button" id="button" name="button" value="submit" />
 <span class='browsedFileName'></span>
</div>
</div>
<!-- The loading indicator is shown during file processing -->
<div class="fileupload-loading"></div>
</form>
</body>


Controller COde :
@RequestMapping(value = "/uploadZip", method = RequestMethod.POST, consumes = "multipart/form-data")
    @ResponseBody
    public ResponseEntity<String>
     uploadZip(HttpServletRequest request, HttpServletResponse response)
            throws IOException, IllegalArgumentException {
        try {       
        String year = request.getParameter("year");
        String series = request.getParameter("series");
        log.info(" year " + year + " series " + series);
        boolean isMultipart = ServletFileUpload.isMultipartContent(request);
        if (isMultipart) {

            FileItemFactory factory = new DiskFileItemFactory();
            ServletFileUpload upload = new ServletFileUpload(factory);
            List items = upload.parseRequest(request);
            Iterator iterator = items.iterator();

            HttpSession session = request.getSession();
            UserContext userContext = (UserContext) session
                    .getAttribute(ApplicationConstant.USER_CONTEXT);
            String userName = userContext.getUser();
            String workSpaceInUse = userContext.getCurrentWorkSpace();           
            FileItem item = null;
            boolean fileNotExistFlag;
            String fileExtension;
            while (iterator.hasNext()) {
                item = (FileItem) iterator.next();

                String content = item.getContentType();
                log.info(" content "+content);
                log.info(" File Type Getting Uploaded :"+content);
                if (!item.isFormField()) {
            /* Here in IOUtils the Third Parameter true tells that the small chunks of data that comes need to be added to the same File */
            IOUtils.copy(fileItem.getInputStream(), new FileOutputStream(new File(threeDPath+"/"+year+"/"+series+"/"+uploadZipFileName),true));               
                }
            }
            return null;
        }   
        }
        catch(Exception e) {
            return handleError(new RuntimeException("Unexpected error while uploading ZIP", e));
        }
        return null;
    }