for循环C#中的内存不足异常

时间:2013-05-07 12:45:33

标签: c# visual-studio-2010 exception

我正在读一个二进制文件。如果我读了一个文件,我的代码工作正常。但是,当我读取文件夹中的文件时,我得到错误,粘贴在下面。我将添加一些我用来读取文件的代码。我正在读取字节数组中的文件:

byte[] b = File.ReadAllBytes(args);

并将数据存储在数组中(指示代码):

len=400000000;
public ArrayList rawData1 = new ArrayList();
UInt32[] fff = Enumerable.Repeat((UInt32)4095, len/4).ToArray();    


public ReadRawFiles{
            while (true){
            rawData1.Add((double)(BitConverter.ToUInt32(b, curPos) & fff[i]));
            i++;
            }
}
b=null; //clear array

如果我只读取一个文件,它可以工作,虽然很慢(大小约为40 MB)。但是当我添加文件夹的路径并再次阅读时,我收到错误。

List<ReadRawFiles> list = new List<ReadRawFiles>();
ReadRawFiles rawFiles;
foreach (var f in sFiles)
                    {
                      rawFiles = new ReadRawFiles(f.File,true,true);
                      list.Add(rawFiles);

                       //rawFiles=null; //clear??
                    }

我不太清楚垃圾收集器是如何工作的。如果我错过了什么,请告诉我。

提前多多感谢。

编辑: 代码: http://www.codesend.com/view/4aadd067dfd26ea88396afbd3cd3fc22/ http://www.codesend.com/view/f8f798224e54c28a00865ca9aff514e5/

System.OutOfMemoryException was unhandled
  Message=Exception of type 'System.OutOfMemoryException' was thrown.
  Source=System.Core
  StackTrace:
       at System.Linq.Buffer`1.ToArray()
       at System.Linq.Enumerable.ToArray[TSource](IEnumerable`1 source)
       at program.ReadRawFiles..ctor(String args, Nullable`1 flagraw, Nullable`1 dualChannel) in E:\projects\development\vs_test\WpfApplication1\WpfApplication1\param.cs:line 83
       at SePSI.MainWindow.Add_folder(Object sender, RoutedEventArgs e) in E:\projects\development\vs_test\WpfApplication1\WpfApplication1\MainWindow.xaml.cs:line 196
       at System.Windows.RoutedEventHandlerInfo.InvokeHandler(Object target, RoutedEventArgs routedEventArgs)
       at System.Windows.EventRoute.InvokeHandlersImpl(Object source, RoutedEventArgs args, Boolean reRaised)
       at System.Windows.UIElement.RaiseEventImpl(DependencyObject sender, RoutedEventArgs args)
       at System.Windows.UIElement.RaiseEvent(RoutedEventArgs e)
       at System.Windows.Controls.MenuItem.InvokeClickAfterRender(Object arg)
       at System.Windows.Threading.ExceptionWrapper.InternalRealCall(Delegate callback, Object args, Int32 numArgs)
       at MS.Internal.Threading.ExceptionFilterHelper.TryCatchWhen(Object source, Delegate method, Object args, Int32 numArgs, Delegate catchHandler)
       at System.Windows.Threading.DispatcherOperation.InvokeImpl()
       at System.Windows.Threading.DispatcherOperation.InvokeInSecurityContext(Object state)
       at System.Threading.ExecutionContext.runTryCode(Object userData)
       at System.Runtime.CompilerServices.RuntimeHelpers.ExecuteCodeWithGuaranteedCleanup(TryCode code, CleanupCode backoutCode, Object userData)
       at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state)
       at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean ignoreSyncCtx)
       at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)
       at System.Windows.Threading.DispatcherOperation.Invoke()
       at System.Windows.Threading.Dispatcher.ProcessQueue()
       at System.Windows.Threading.Dispatcher.WndProcHook(IntPtr hwnd, Int32 msg, IntPtr wParam, IntPtr lParam, Boolean& handled)
       at MS.Win32.HwndWrapper.WndProc(IntPtr hwnd, Int32 msg, IntPtr wParam, IntPtr lParam, Boolean& handled)
       at MS.Win32.HwndSubclass.DispatcherCallbackOperation(Object o)
       at System.Windows.Threading.ExceptionWrapper.InternalRealCall(Delegate callback, Object args, Int32 numArgs)
       at MS.Internal.Threading.ExceptionFilterHelper.TryCatchWhen(Object source, Delegate method, Object args, Int32 numArgs, Delegate catchHandler)
       at System.Windows.Threading.Dispatcher.InvokeImpl(DispatcherPriority priority, TimeSpan timeout, Delegate method, Object args, Int32 numArgs)
       at MS.Win32.HwndSubclass.SubclassWndProc(IntPtr hwnd, Int32 msg, IntPtr wParam, IntPtr lParam)
       at MS.Win32.UnsafeNativeMethods.DispatchMessage(MSG& msg)
       at System.Windows.Threading.Dispatcher.PushFrameImpl(DispatcherFrame frame)
       at System.Windows.Threading.Dispatcher.PushFrame(DispatcherFrame frame)
       at System.Windows.Application.RunDispatcher(Object ignore)
       at System.Windows.Application.RunInternal(Window window)
       at System.Windows.Application.Run(Window window)
       at System.Windows.Application.Run()
       at SePSI.App.Main() in E:\projects\development\vs_test\WpfApplication1\WpfApplication1\obj\x86\Debug\App.g.cs:line 0
       at System.AppDomain._nExecuteAssembly(RuntimeAssembly assembly, String[] args)
       at System.AppDomain.ExecuteAssembly(String assemblyFile, Evidence assemblySecurity, String[] args)
       at Microsoft.VisualStudio.HostingProcess.HostProc.RunUsersAssembly()
       at System.Threading.ThreadHelper.ThreadStart_Context(Object state)
       at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean ignoreSyncCtx)
       at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)
       at System.Threading.ThreadHelper.ThreadStart()
  InnerException: 

2 个答案:

答案 0 :(得分:4)

这里有一些非常低效的部分;将整个文件加载到一个内存中,将不清楚的fff数组加载到另一个文件中。持有ArrayList的第三个double(包括每个double拳击 - 这里非常糟糕。)

我强烈建议您尝试简化和流式数据,例如:

byte[] buffer = new byte[4];
List<double> rawData = new List<double>();
foreach(var path in paths)
{
    using(var file = File.OpenRead(path))
    {
        while(TryRead(file, buffer, 4))
        {
            const uint MASK = 4095;
            var val = BitConverter.ToUInt32(buffer, 0) & MASK;
            // note that this line looks really dodgy
            rawData.Add((double)val);
        }
    }
}

使用实用程序方法填充4个字节的整个块(或失败):

static bool TryRead(Stream s, byte[] buffer, int bytes)
{
    int read = s.Read(buffer, 0, bytes), offset;
    if (read <= 0) return false; // no more data

    bytes -= read;
    offset = read;
    while (bytes > 0 && (read = s.Read(buffer, offset, bytes)) > 0)
    {
        bytes -= read;
        offset += read;
    }
    if (bytes != 0) throw new EndOfStreamException();
    return true; // success
}

但我必须强调:

  • uint - 至 - double转换看起来不太可能;那是你如何阅读双重二进制文件
  • 将所有数据存储为double听起来同样不太可能 - 我无法想到任何有用的明显场景

答案 1 :(得分:1)

我认为应该是这样的:

while (true)
{
    rawData1.Add((double)(BitConverter.ToUInt32(b, curPos) & fff[i]));
    i++;
}

您没有终止条件,它将永远持续并继续通过递增i并将数据添加到rawData ArrayList来占用资源。