Luca Matteis
Luca Matteis

Reputation: 29267

Unserializing large Blobs from the Blobstore

I store large Blobs in the datastore. These are XML files that can be as large as 20mb. Storing a single 20mb XML file is fine, however the issue comes when I need to unserialize it.

There are all sorts of limitations to this:

How would you say I can handle this? I'm open to all sorts of solutions, but hopefully not something that involves using another hosting provider.

Upvotes: 2

Views: 180

Answers (2)

Boris Daich
Boris Daich

Reputation: 2461

go with GAE BackEnd they do not have configurable memory limit.

Upvotes: 0

systempuntoout
systempuntoout

Reputation: 74114

You should switch to a Sax Parser, streaming the data from the Blobstore with the BlobstoreInputStream class.
These libraries should help you to avoid the GAE RAM restriction.

Upvotes: 2

Related Questions