CODEWITHSUNDEEP
google-app-enginepull-queue
Javier Marín
Javier Marín

Reputation: 2106

App Engine - Pull queues max_concurrent_requests limit?

I'm using Google App Engine pull queues to send massive push notifications to APNS, GCM and OneSignal mostly following this architecture: https://cloudplatform.googleblog.com/2013/07/google-app-engine-takes-pain-out-of-sending-ios-push-notifications.html

enter image description here

The problem is that I'm hitting some kind of limit about how many tasks are leased at the same time: my Notification Workers lease 3 notifications at a time, but when there are more than about 30 workers running, leaseTasks() returns an empty array, even when there are hundreds or thousands of pending tasks. As far as I know, there is no limit about how many tasks are leased at the same time, so this behaviour is unexpected.

Upvotes: 0

Views: 87

Answers (1)

minou
minou

Reputation: 16563

Have you seen this limit of pull queues in the docs:

If you generate more than 10 LeaseTasks requests per queue per second, only the first 10 requests will return results. The others will return no results.

If you have 30 workers, it seems that you could easily hit this limit. Could you lease more tasks at a time and use fewer workers?

Upvotes: 0

Related Questions