当我使用await Console.Out.WriteLineAsync时,程序永远不会完成

时间:2018-12-17 23:54:56

标签: c# .net async-await task-parallel-library tpl-dataflow

我正在.NET 4.7.1中使用DataFlow库。由于某种原因,当我在await Console.Out.WriteLineAsync(DateTime.Now.TimeOfDay.ToString());构造函数的async lambda中有ActionBlock时,程序永远不会终止。它只会输出DateTime.Now.TimeOfDay.ToString()行的行并随机停止,永远不会到达Console.WriteLine("Time elapsed:" + watch.Elapsed);,尽管在某些情况下我观察到控制台输出"Finished Reading the file"

 class Program
    {
        public static async Task Main(string[] args)
        {
            int numberOfLines = 0;
            Console.WriteLine("Number of cores used:" + Convert.ToInt32(Math.Ceiling((Environment.ProcessorCount * 0.75) * 2.0)));

            BufferBlock<string> queBuffer = new BufferBlock<string>(new DataflowBlockOptions { BoundedCapacity = 100000 });


            var processingBlock = new ActionBlock<string>(async inputline =>
            {
                Interlocked.Increment(ref numberOfLines);
                //Line that causes issue
                //await Console.Out.WriteLineAsync(DateTime.Now.TimeOfDay.ToString());
            }
            , new ExecutionDataflowBlockOptions()
            {
                MaxDegreeOfParallelism = 48,
                SingleProducerConstrained = true,
                BoundedCapacity = 500
            });

            queBuffer.LinkTo(processingBlock);
            //Start
            var watch = System.Diagnostics.Stopwatch.StartNew();
            Console.WriteLine("Processing started at:" + DateTime.Now);

            if (File.Exists(args[0]))
            {
                using (StreamReader sr = new StreamReader(args[0]))
                {
                    string line;
                    // Read and display lines from the file until the end of the file is reached.
                    while ((line = await sr.ReadLineAsync()) != null)
                    {
                        await queBuffer.SendAsync(line);
                    }
                }
                await Console.Out.WriteLineAsync("Finished Reading the file");
            }
            queBuffer.Complete();
            processingBlock.Complete();
            await Task.WhenAll(queBuffer.Completion, processingBlock.Completion);
            watch.Stop();
            Console.WriteLine("Time elapsed:" + watch.Elapsed);
            Console.WriteLine("Number of lines read:" + numberOfLines.ToString());           
        }
    }

但是,如果我取出引起问题的行,它将起作用并从文本文件中读取所有行。 W:\test>.\CompressAMS.exe token2-small.txt Number of cores used:24 Processing started at:12/17/2018 6:32:50 PM Finished Reading the file Time elapsed:00:00:00.3569824 Number of lines read:100000

1 个答案:

答案 0 :(得分:1)

完成后,您所拥有的是比赛条件。您在两个块上都调用Complete(),这迫使处理块停止接收消息,并且此时缓冲区可能仍然有数据要传递。然后,当您等待两个块都完成时,如果缓冲区没有发送完所有消息,它将永远不会完成,执行将挂在Finished Reading File上。

您可以安全地等待两个块,但只在缓冲区上调用Complete()并允许TDF将完成传播到下游处理块:

queBuffer.LinkTo(processingBlock, new DataflowLinkOptions() { PropagateCompletion = true });
/******/
queBuffer.Complete();
await Task.WhenAll(queBuffer.Completion, processingBlock.Completion);