CODEWITHSUNDEEP
amazon-sqspublish-subscribeamazon-snsgoogle-cloud-pubsubrequest-response
user1384205
user1384205

Reputation: 1291

Is there a GCP equivalent to AWS SQS?

Im curious to understand the implementation of GCP's PubSub. Although Pubsub seems to point to follow a Publish-Subscribe design pattern, it seems more close to AWS's SQS (queue) than AWS SNS (that use publish-subscribe model). Why is think this is, GCP's pubSub

  1. Allows upto 10,000 subscriptions per project.
  2. Allows filtering on subscriptions
  3. It even allows ordering (beta) - which should involve a FIFO queue somewhere.
  4. It exposes synchronous api for request/response pattern.

It makes me wonder if subscriptions in pub/sub are merely queues of SQS. I would like your opinions on this comparison. The confusion is due to lack of implementation details on PubSub and the obvious name indicating a certain design pattern.

Regards,

Upvotes: 23

Views: 39559

Answers (2)

Kamal Aboul-Hosn
Kamal Aboul-Hosn

Reputation: 17271

The division for messaging in GCP is along slightly different lines than what you may see in AWS. GCP breaks down messaging into three categories:

  • Torrents: Messaging pipelines that are designed to handle large amounts of throughput on pipes that are persistent. In other words, one creates a new pipeline rarely and sends messages over it for long periods of time. The scaling pattern for torrents is a relatively small number of pipelines transmitting a lot of data. For this category, Cloud Pub/Sub is the right product.
  • Trickles: Messaging pipelines that are largely ephemeral or require broadcast to a very large number of end-user devices. These pipelines have a low throughput but the number of pipelines can be extremely large. Firebase Cloud Messaging is the product that fits into this category.
  • Queues: Messaging pipelines where one has more control over the end-to-end message delivery. These pipelines are not really high throughput nor is the number of pipelines large, but more advanced properties are supported, e.g., the ability to delay or cancel the delivery of a message. Cloud Tasks fits in this category, though Cloud Pub/Sub is also adopting features that make it more and more viable for this use case.

So Cloud Pub/Sub is the publish/subscribe aspects of SQS+SNS, where SNS is used as a means to distribute messages to different SQS queues. It also serves as the big-data ingestion mechanism a la Kinesis. Firebase Cloud Messaging covers the portions of SNS designed to reach end user devices. Cloud Tasks (and Cloud Pub/Sub, more and more) provide functionality of a single queue in SQS.

Upvotes: 40

Coder
Coder

Reputation: 235

You are correct to say that GCP PubSub is close to AWS SQS. As far as I know, there is no exact SNS tool available in GCP, but I think the closest tool is GCM (Google Cloud Messaging). You are not the only one who has had this query: AWS SNS equivalent in GCP stack

Upvotes: 1

Related Questions