CODEWITHSUNDEEP
google-cloud-dataflowgoogle-cloud-pubsub
Vladimir Stoyak
Vladimir Stoyak

Reputation: 179

Dataflow Process does not retrieve queued messages after restart

We have a dataflow process subscribed to "Subscribtion A" on a "Topic A" processing messages in streaming mode.

According to PubSub documentation, if the messages are not pulled they will be retained for at least 7 days per subscription. Am I right to assume that if I stop my Dataflow process for an hour and then restart, it should process all the messages accumulated in the subscription while subscriber process was down before proceeding with the streaming messages?

In our case Dataflow process does not seem to pick up queued messages after restart. Is there any explicit configuration option that we are missing?

Upvotes: 0

Views: 248

Answers (1)

Vladimir Stoyak
Vladimir Stoyak

Reputation: 179

We tested it again and it does seem to work fine. It appears to be related to some other issues.

Upvotes: 1

Related Questions