CODEWITHSUNDEEP
google-app-enginegoogle-cloud-datastore
Karan Tongay
Karan Tongay

Reputation: 207

How can we increase the speed of single task execution in GAE Task Queue?

I have a single large task that is running in one of the task queues. Sometimes the task takes more than 24 hours to execute. I have optimized my code to the maximum and have achieved some speed to execute the task faster.

The task performs the operation of inserting the rows into the datastore which can be in millions.

Is there any way to increase the speed of that task by allocating more resources or by making changes in the instance configurations?

Please advise.

Upvotes: 0

Views: 122

Answers (1)

Dan Cornilescu
Dan Cornilescu

Reputation: 39824

You can get some speedup by choosing an instance type with a faster CPU (also more expensive) in the respective service/module config file.

But the percent reduction of the overall task duration depends significantly on the actual structure/operation of your app.

You'll get a speedup for what is actually executed by your instance (i.e. your app code), but not for the services executed by the GAE infra, like datastore and memcache RPCs for example - which can be significant.

Upvotes: 1

Related Questions