java.lang.OutOfMemoryError上传大文件

时间:2013-10-29 10:40:50

标签: java glassfish

在Nick Wilson回答之前:

我正在Glassfish 3下开发Java EE 6 Web应用程序。主要特点是能够上传大文件(1Gb更大)。当我尝试上传文件(400MB大小)时,我收到 java.lang.OutOfMemoryError 异常:

Caused by: java.lang.OutOfMemoryError
at java.io.FileInputStream.readBytes(Native Method)
at java.io.FileInputStream.read(FileInputStream.java:272)
at com.google.common.io.ByteStreams.read(ByteStreams.java:899)
at com.google.common.io.ByteStreams.readFully(ByteStreams.java:733)
at com.google.common.io.ByteStreams.readFully(ByteStreams.java:714)
at org.richfaces.request.BaseUploadedFile.getData(BaseUploadedFile.java:68)
at EJB.FileUploadBean.listener(FileUploadBean.java:147)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.sun.el.parser.AstValue.invoke(AstValue.java:254)
at com.sun.el.MethodExpressionImpl.invoke(MethodExpressionImpl.java:302)
at com.sun.faces.facelets.el.TagMethodExpression.invoke(TagMethodExpression.java:105)
at org.richfaces.event.MethodExpressionEventListener.processEvent(MethodExpressionEventListener.java:125)

我已经在Glassfish JVM选项中增加了内存:

-XX:MaxPermSize=256m
-XX:PermSize=128m
-XX:NewRatio=2
-XX:+UseParallelGC
-Xmx2048m

我尝试使用以下代码上传文件,但两者都给出了同样的错误:

InputStream filecontent = null;
    int read = 0;
    final byte[] bytes = new byte[1024];

    OutputStream fop = null;
    File fout;
    if (file.getLength() > 0) {
        try {
            fout = new File(filename);
            fop = new FileOutputStream(fout);
            filecontent = item.getInputStream();
            if (!fout.exists()) {
                fout.createNewFile();
            }
            while ((read = filecontent.read(bytes)) != -1) {
                 fop.write(bytes, 0, read);
            }

 FileOutputStream fop = null;
    File fout;
    if (file.getLength() > 0) {
        try {
            fout = new File(filename);
            fop = new FileOutputStream(fout);

            if (!fout.exists()) {
                fout.createNewFile();
            }
            fop.write(item.getData());
            fop.flush();
            fop.close();

我该如何解决这个问题?

感谢

在Nick Wilson回答之后

我将代码更改为:

public void listener(FileUploadEvent event) throws Exception {
    ufile = new UploadFile();
    InputStream filecontent = null;
    UploadedFile item = event.getUploadedFile();
    if (item instanceof UploadedFile25) {
        filecontent = ((UploadedFile25) item).getInputStream();
    } else {

        filecontent = item.getInputStream();
    }
    UploadedText file = new UploadedText();
    file.setLength(item.getData().length);
    file.setName(item.getName());
    Date date = new Date();
    String epoch = fDir + String.valueOf(date.getTime());
    File fPath = new File(epoch);
    fPath.mkdir();

    //file.setData(item.getData());
    files.add(file);
    String filename = epoch + '/' + item.getName();

    int read = 0;
    final byte[] bytes = new byte[1024];

    OutputStream fop = null;
    File fout;
    if (file.getLength() > 0) {
        try {
            fout = new File(filename);
            fop = new FileOutputStream(fout);

            if (!fout.exists()) {
                fout.createNewFile();
            }
            while ((read = filecontent.read(bytes)) != -1) {
                fop.write(bytes, 0, read);
            }

但我收到同样的例外。

能够上传大文件(1Gb更大)。当我尝试上传文件(400MB大小)时,我收到 java.lang.OutOfMemoryError 异常:

Caused by: java.lang.OutOfMemoryError
at java.io.FileInputStream.readBytes(Native Method)
at java.io.FileInputStream.read(FileInputStream.java:272)
at com.google.common.io.ByteStreams.read(ByteStreams.java:899)
at com.google.common.io.ByteStreams.readFully(ByteStreams.java:733)
at com.google.common.io.ByteStreams.readFully(ByteStreams.java:714)
at org.richfaces.request.BaseUploadedFile.getData(BaseUploadedFile.java:68)
at EJB.FileUploadBean.listener(FileUploadBean.java:147)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.sun.el.parser.AstValue.invoke(AstValue.java:254)
at com.sun.el.MethodExpressionImpl.invoke(MethodExpressionImpl.java:302)
at com.sun.faces.facelets.el.TagMethodExpression.invoke(TagMethodExpression.java:105)
at org.richfaces.event.MethodExpressionEventListener.processEvent(MethodExpressionEventListener.java:125)

我已经在Glassfish JVM选项中增加了内存:

-XX:MaxPermSize=256m
-XX:PermSize=128m
-XX:NewRatio=2
-XX:+UseParallelGC
-Xmx2048m

我尝试使用以下代码上传文件,但两者都给出了同样的错误:

InputStream filecontent = null;
    int read = 0;
    final byte[] bytes = new byte[1024];

    OutputStream fop = null;
    File fout;
    if (file.getLength() > 0) {
        try {
            fout = new File(filename);
            fop = new FileOutputStream(fout);
            filecontent = item.getInputStream();
            if (!fout.exists()) {
                fout.createNewFile();
            }
            while ((read = filecontent.read(bytes)) != -1) {
                 fop.write(bytes, 0, read);
            }

 FileOutputStream fop = null;
    File fout;
    if (file.getLength() > 0) {
        try {
            fout = new File(filename);
            fop = new FileOutputStream(fout);

            if (!fout.exists()) {
                fout.createNewFile();
            }
            fop.write(item.getData());
            fop.flush();
            fop.close();

我该如何解决这个问题?

感谢

在Nick Wilson回答之后

我将代码更改为:

public void listener(FileUploadEvent event) throws Exception {
    ufile = new UploadFile();
    InputStream filecontent = null;
    UploadedFile item = event.getUploadedFile();
    if (item instanceof UploadedFile25) {
        filecontent = ((UploadedFile25) item).getInputStream();
    } else {

        filecontent = item.getInputStream();
    }
    UploadedText file = new UploadedText();
    file.setLength(item.getData().length);
    file.setName(item.getName());
    Date date = new Date();
    String epoch = fDir + String.valueOf(date.getTime());
    File fPath = new File(epoch);
    fPath.mkdir();

    //file.setData(item.getData());
    files.add(file);
    String filename = epoch + '/' + item.getName();

    int read = 0;
    final byte[] bytes = new byte[1024];

    OutputStream fop = null;
    File fout;
    if (file.getLength() > 0) {
        try {
            fout = new File(filename);
            fop = new FileOutputStream(fout);

            if (!fout.exists()) {
                fout.createNewFile();
            }
            while ((read = filecontent.read(bytes)) != -1) {
                fop.write(bytes, 0, read);
            }

但我收到同样的例外。

Caused by: java.lang.OutOfMemoryError
at java.io.FileInputStream.readBytes(Native Method)
at java.io.FileInputStream.read(FileInputStream.java:272)
at com.google.common.io.ByteStreams.read(ByteStreams.java:899)
at com.google.common.io.ByteStreams.readFully(ByteStreams.java:733)
at com.google.common.io.ByteStreams.readFully(ByteStreams.java:714)
at org.richfaces.request.BaseUploadedFile.getData(BaseUploadedFile.java:68)
at EJB.FileUploadBean.listener(FileUploadBean.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.sun.el.parser.AstValue.invoke(AstValue.java:254)
at com.sun.el.MethodExpressionImpl.invoke(MethodExpressionImpl.java:302)
at com.sun.faces.facelets.el.TagMethodExpression.invoke(TagMethodExpression.java:105)
at org.richfaces.event.MethodExpressionEventListener.processEvent(MethodExpressionEventListener.java:125)
... 38 more

我不知道如何解决: - (

2 个答案:

答案 0 :(得分:0)

您需要确保为JVM提供了适当的堆大小,检查配置并确保-Xms设置为512但-Xmx值远大于文件大小,特别是在加载时将整个文件存入内存。

答案 1 :(得分:0)

您应该能够从上传的文件中流式传输数据,而不是调用getData

 public void listener(FileUploadEvent event) throws Exception {
 UploadedFile item = event.getUploadedFile();
 InputStream is = item.getInputStream();
 .....

调用item.getData()将导致整个文件被加载到内存中。