Question

我正在尝试阅读几个大文件（超过100MB）。到目前为止，它总是在OutofMemory Error中间打破。有什么解决方案吗？

           FileInputStream fstream = new FileInputStream(f);
          // Get the object of DataInputStream
        DataInputStream dain = new DataInputStream(fstream);
        //  BufferedReader br = new BufferedReader(new InputStreamReader(in));

        BufferedReader in = new BufferedReader(new InputStreamReader(dain));
        String text = in.readLine();
        while(text != null) {
            stat(text);
            text = in.readLine();
        }

异常是这样的：

    Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOfRange(Arrays.java:2694)
at java.lang.String.<init>(String.java:234)
at java.io.BufferedReader.readLine(BufferedReader.java:349)
at java.io.BufferedReader.readLine(BufferedReader.java:382)

以下是Stat的作用：

    public void stat(String text) {
    String postTypeId = this.getXmlValue(text, "PostTypeId");
    String viewCountStr = this.getXmlValue(text, "ViewCount");
    String answerCountStr = this.getXmlValue(text, "AnswerCount");
    String userId = this.getXmlValue(text, "OwnerUserId");
    String postId = this.getXmlValue(text, "Id");
    String parentId = this.getXmlValue(text, "ParentId");
    String backUpId = this.getXmlValue(text, "LastEditorUserId");
    //Add post rel
    if(parentId==null) {
        if(!postTable.containsKey(postId)) 
            postTable.put(postId, new PostRel());
    } else {
        try{
        postTable.get(parentId).addAnswer(postId);
        }catch(Exception exp) {
        }
    }
              generalCount(postTypeId,viewCountStr,answerCountStr,userId,postId,parentId,backUpId);

}

在generalCount中，我试图插入另一个表：

            if(userTable.containsKey(userId)) {
        userTable.get(userId).addPost(postId);
        if(parentId!=null)
            userTable.get(userId).addAnswer(parentId);
    } else{
        UserPostInfo newInfo = new UserPostInfo();
        newInfo.addPost(postId);
        if(parentId!=null)
            newInfo.addAnswer(parentId);
        userTable.put(userId, newInfo);

Answer 1

Give the JVM more memory to work with
在阅读文件时使用更少的内存（您可以使用流数据吗？）
使用memory-mapped files

读取大文件时出现OutofMemoryError

1 个答案: