使用PushStreamContent从HTTPClient上传

时间:2016-02-09 03:20:52

标签: c# http file-upload async-await dotnet-httpclient

我想将大量数据从客户端计算机上传到Web服务器。我跳到了PushStreamContent,所以我可以直接写入流,因为结果大小不一,而且可能相当大。

流程如下:

User runs query > Reader Ready Event Fires > Begin Upload

触发就绪事件后,侦听器会将其拾取并迭代结果集,将数据作为多部分表单上传:

Console.WriteLine("Query ready, uploading");
        byte[] buffer = new byte[1024], form = new byte[200];
        int offset = 0, byteCount = 0;
        StringBuilder rowBuilder = new StringBuilder();
        string builderS;
        var content = new PushStreamContent(async (stream, httpContent, transportContext) =>
        //using (System.IO.Stream stream = new System.IO.FileStream("test.txt", System.IO.FileMode.OpenOrCreate))
        {
            int bytes = 0;
            string boundary = createFormBoundary();
            httpContent.Headers.Remove("Content-Type");
            httpContent.Headers.TryAddWithoutValidation("Content-Type", "multipart/form-data; boundary=" + boundary);
            await stream.WriteAsync(form, 0, form.Length);
            form = System.Text.Encoding.UTF8.GetBytes(createFormElement(boundary, "file"));
            await stream.WriteAsync(form, 0, form.Length);
            await Task.Run(async () =>
            {
                foreach (var row in rows)
                {
                    for (int i = 0; i < row.Length; i++)
                    {
                        rowBuilder.Append(row[i].Value);
                        if (i + 1 < row.Length)
                            rowBuilder.Append(',');
                        else
                        {
                            rowBuilder.Append("\r\n");
                        }
                    }
                    builderS = rowBuilder.ToString();
                    rowBuilder.Clear();
                    byteCount = System.Text.Encoding.UTF8.GetByteCount(builderS);
                    bytes += byteCount;
                    if (offset + byteCount > buffer.Length)
                    {
                        await stream.WriteAsync(buffer, 0, offset);
                        offset = 0;
                        if (byteCount > buffer.Length)
                        {
                            System.Diagnostics.Debug.WriteLine("Expanding buffer to {0} bytes", byteCount);
                            buffer = new byte[byteCount];
                        }
                    }
                    offset += System.Text.Encoding.UTF8.GetBytes(builderS, 0, builderS.Length, buffer, offset);
                }
            });
            await stream.WriteAsync(buffer, 0, offset);
            form = System.Text.Encoding.UTF8.GetBytes(boundary);
            await stream.WriteAsync(form, 0, form.Length);
            await stream.FlushAsync(); //pretty sure this does nothing
            System.Diagnostics.Debug.WriteLine("Wrote {0}.{1} megabytes of data", bytes / 1000000, bytes % 1000000);

我认为如果我是服务器,上面的代码会很好用,只需添加stream.Close();即可完成它,但是因为我是客户端,所以关闭它会导致错误(TaskCancelled)。等待阅读也没有做任何事情,我认为因为除非我明确关闭流,否则PushStreamContent不会结束请求。话虽如此,写入文件会产生我希望上传的内容,所以一切都写得很完美。

关于我在这里可以做什么的任何想法?我可能完全滥用PushStreamContent但似乎应该是一个合适的用例。

1 个答案:

答案 0 :(得分:2)

所以解决方案起初有点令人困惑,但它似乎有意义,也许更重要的是,它有效:

using(var content = new MultipartFormDataContent()) 
{
  var pushContent = new PushStreamContent(async (stream, httpContent, transportContext) =>
  { 
    //do the stream writing stuff
    stream.Close();
  });
  content.add(pushContent);
  //post, put, etc. content here
}

这是有效的,因为传递给PushStreamContent方法的流不是实际的请求流,它是由HttpClient处理的流,就像将文件添加到请求流一样。结果,关闭它表示HttpContent的这一部分的输入结束,并允许最终确定请求。