CODEWITHSUNDEEP
pythongoogle-app-enginegoogle-cloud-datastore
dlebech
dlebech

Reputation: 1839

App Engine remote API cannot fetch entities above specific fetch limit

I am seeing some strange performance issues with a model.query().fetch() operation for a specific entity kind. I can fetch up to 1,200 entities using .fetch(limit) but at 1,201, the fetch completely breaks and never returns. To test it out, I tried running fetch for increasing limits:

1195 fetches took 0:00:02.832000
1196 fetches took 0:00:02.798000
1197 fetches took 0:00:02.948000
1198 fetches took 0:00:02.627000
1199 fetches took 0:00:02.746000
1200 fetches took 0:00:02.657000

After 1200, nothing happens and I have to manually cancel the fetch operation. This behavior is consistent over many runs of the same test.

I have about 14,000 entities of the given kind and each entity has about 10 properties which are mostly not indexed.

The question is: Is this a bug or am I missing some insight information?

Update: I can add that I see the problem in two different entity kinds now. They both break exactly at fetch(1201)

Upvotes: 0

Views: 85

Answers (1)

marcadian
marcadian

Reputation: 2618

I have encountered this problem before, this is due to limitation from using remote_api (my testing was only able to fetch 1000). The workaround is you deploy the code and test it from there.

Upvotes: 1

Related Questions