CODEWITHSUNDEEP
google-cloud-platformgoogle-cloud-dataflowgoogle-cloud-pubsub
Fedor Nikolaev
Fedor Nikolaev

Reputation: 87

GCP Dataflow pub/sub to pub/sub

I'm using gcp pub/sub. If there was exception while accepting new message, I put it to dead letter queue. I want to have an opportunity to reprocess message after reviewing. I tried to use Dataflow, but it just sends messages as soon as it came to dead letter queue. Any advices how can I solve it?

Upvotes: 0

Views: 686

Answers (1)

Aishwary Shukla
Aishwary Shukla

Reputation: 460

For temporary solution, maybe export data from dead letter topic to BigQuery using dataflow. Once you review the data, use any component to process and re-export data to pubsub from BigQuery. This way you can control when to export data. I know this is not ideal. But will help for short term.

Upvotes: 1

Related Questions