例外:从DocumentDB查询时出现Microsoft.Azure.Documents.RequestRateTooLargeException

时间:2015-03-26 09:54:49

标签: c# bulkinsert azure-cosmosdb resque-retry

y查询类似于

this.ProcessRequestSync(() => this.Client.CreateDocumentQuery<Model>(this.DocumentDBCollectionLink).Where(d => d.name.Equals(name) && d.code.Equals(code) && d.Type.Equals(this.documentType) && d.CreatedBy.Equals(myName).ToList<Model>());

 public dynamic ProcessRequestSync(Func<dynamic> getRequest)
{
    var delay = TimeSpan.Zero;
    var minDelayTime = new TimeSpan(0, 0, 1);
    for (;;)
    {
        try
        {
            Thread.Sleep(delay);
            return getRequest();
        }
        catch (DocumentClientException documentClientException)
        {
            var statusCode = (int)documentClientException.StatusCode;
            if (statusCode == 429 || statusCode == 503)
            {
                string errorMessage = string.Format("failed at DocumentDB with {0} status and {1} retry time", statusCode, documentClientException.RetryAfter);
                this.Logger.Log(errorMessage );

                // Back off if the request rate is too large or the service is temporarily unavailable
                delay = TimeSpan.Compare(documentClientException.RetryAfter, minDelayTime) >= 0 ? documentClientException.RetryAfter: minDelayTime;
            }
            else
            {
                throw;
            }
        }
    }
}

这是requestRateTooLarge异常引发时重试逻辑的方法。

我不确定,它是否正常工作,

我收到异常:Microsoft.Azure.Documents.RequestRateTooLargeException同时查询和插入大约4000条记录,

我使用相同的重试逻辑进行插入,其工作正常。 我没有收到任何错误,也没有成功插入所有记录,但无法获取查询数据。

2 个答案:

答案 0 :(得分:5)

您还需要一个用于AggregateException的catch块,并检查AggregateException.InnerException是否是DocumentClientException并对StatusCode == 429执行相同的检查。由于查询执行是异步的,您可能会获得包含在内部的限制异常AggregateException。

如果您可以发布完整的复制品,我们可以明确地确定问题。

答案 1 :(得分:5)

基于@aravind Ramachandra和@Ryan CrawCour上面/下面的答案,这就是我用来解决问题的方法。

    public async Task SaveToDocDb(dynamic jsonDocToSave)
    {

        using (var client = new DocumentClient(endpoint, authKey))
        {
            var queryDone = false;
            while (!queryDone)
            {
                try
                {
                    await client.CreateDocumentAsync(docCollectionlink, jsonDocToSave);
                    queryDone = true; 
                }
                catch (DocumentClientException documentClientException)
                {
                    var statusCode = (int)documentClientException.StatusCode;
                    if (statusCode == 429 || statusCode == 503)   
                        Thread.Sleep(documentClientException.RetryAfter);
                    else
                        throw;
                }
                catch (AggregateException aggregateException)
                {
                    if(aggregateException.InnerException.GetType() == typeof(DocumentClientException)){

                        var docExcep = aggregateException.InnerException as DocumentClientException;
                        var statusCode = (int)docExcep.StatusCode;
                        if (statusCode == 429 || statusCode == 503)
                            Thread.Sleep(docExcep.RetryAfter);
                        else
                            throw;
                    }
                     else 
                       throw;
                }
            }
        }
    }