CODEWITHSUNDEEP
azure-cosmosdbazure-data-factoryazure-cosmosdb-sqlapi
user989988
user989988

Reputation: 3736

Throttling requests in Cosmos DB SQL API

I'm running a simple adf pipeline for storing data from data lake to cosmos db (sql api).

After setting database throughput to Autopilot 4000 RU/s, the run took ~11 min and I see 207 throttling requests. On setting database throughput to Autopilot 20,000 RU/s, the run took ~7 min and I see 744 throttling requests. Why is that? Thank you!

enter image description here

Upvotes: 0

Views: 1332

Answers (1)

Mike Ubezzi
Mike Ubezzi

Reputation: 1027

Change the Indexing Policy to None from Consistent for the ADF copy activity and then change back to Consistent when done.

Azure Cosmos DB supports two indexing modes:

  • Consistent: The index is updated synchronously as you create, update or delete items. This means that the consistency of your read queries will be the consistency configured for the account.
  • None: Indexing is disabled on the container. This is commonly used when a container is used as a pure key-value store without the need for secondary indexes. It can also be used to improve the performance of bulk operations. After the bulk operations are complete, the index mode can be set to Consistent and then monitored using the IndexTransformationProgress until complete.

How to modify the indexing policy:

Modifying the indexing policy

Upvotes: 1

Related Questions