CODEWITHSUNDEEP
google-app-enginegwtblobstore
Aadhaar Mehrotra
Aadhaar Mehrotra

Reputation: 155

Backup GAE Data/Files from Blob Store to Google Cloud Storage / other space

In my application on Google App Engine, I have files/documents uploaded to Blob Store. The size of Blob Store has grown to more than 100 GB.

I am in search of a mechanism by which I can backup my blob store data, may be to some other server location or Google Cloud Storage or some other safe place.

Upvotes: 4

Views: 712

Answers (2)

Mark Doyle
Mark Doyle

Reputation: 4874

AFAIK there isn't a simple tool that you can use to backup your Blobstore data. There are at least a few approaches that you could take to write your own tool:

  1. Use cron.xml and a servlet (or some similar scheduling) to copy batches of your entity blobs to Google Cloud Storage and then download from there (see below for tools).
  2. Use remote-API or provide some other API (REST etc) where a remote tool you make can query your entities and then over a serving url (that you probably already have) download the Blobs to your local machine.

Those approaches are not very friendly and there are however tools such as GSUtil that would be helpful if you migrated your data to Google Cloud Storage (GCS). I've seen a few people migrate their data now that upload and serving with GCS is supported with the Blobstore API.

It's important to also note that the Files API for Blobstore is now deprecated (since 1.8.1?) and that there is a new preferred way through the App Engine GCS client.

Additionally if you check Posts about 1.8.1 Pre-release SDKs Available. you'll see that there is some indication from Google that blobs might be auto-migrated over to Cloud Storage (free of charge) before the end of the year (presumably close to when Blobstore will be deprecated). Depending on the urgency of your needs it may be feasible to just wait.

Upvotes: 2

Peter Knego
Peter Knego

Reputation: 80330

You can use Backup/Restore functionality of GAE Admin console.

Upvotes: -1

Related Questions