CODEWITHSUNDEEP
mysqlcassandragoogle-cloud-datastoregoogle-cloud-platformgoogle-cloud-sql
Lavanya Chennupati
Lavanya Chennupati

Reputation: 21

Advantages/disadvantages of Google Cloud SQL vs. Google Cloud Datastore for the given design goals

I am evaluating several of Google's storage options and was wondering if anyone had thoughts. I will be using the data storage as follows:

1) High number of read/insert on several columns (at least 50,000 entities). I would prefer to use Google Cloud Datastore (because of the cool indexing), but is it capable of handling this kind of a load? Also how many requests a second can be handled?

2) Less frequent update/delete (once per day). We would need the query to be indexed to query but this doesn't need to be very scalable. At any any time we might have not more than may be a 100,000 records. I would like to use Datastore, but will its updates and deletes perform adequately? Are there any problem with bulk deleting like in Cassandra?

In general, will there be any scalability issues with Google Cloud Datastore?

Upvotes: 2

Views: 1091

Answers (1)

Dan McGrath
Dan McGrath

Reputation: 42048

50,000-100,000 entities is a trivial amount for Cloud Datastore. Even Billions of entities will be fine.

For first question is a high number of reads/inserts on several columns. Without specific numbers on what 'high' means, it is hard to answer directly, so what follows is specific guidance:

  • A general rule is an average 1 write transaction per Entity-Group per second. If you don't use Entity-Groups (ability to hierarchically layout Entities), you can think simply as "per Entity"
  • You can update as many Entities per second as you want, millions of writes per second will be fine as long as they are on different entities
  • Cloud Datastore is based on Megastore/Bigtable and handles automatic sharding; you'll need to give the underlying tablet servers time to split as you increase your write load (ie, don't go from nothing to 1 million writes per second). An easy rule is once you're at 500 writes a second, allow for 10 mins per doubling of write rate. (1M Writes/Second after 1h50m, 2M after 2h, etc)

Upvotes: 3

Related Questions