CODEWITHSUNDEEP
google-cloud-dataflowgoogle-cloud-pubsub
Murli Krishnan
Murli Krishnan

Reputation: 45

dataflow watermark with pubsub source

In the apache beam documentation, it is mentioned that the watermarks for the pcollections are determined by the source. Considering pubsub as source, what is the logic that pubsub uses to derive the watermark. Any documentation around this to understand better.

Upvotes: 0

Views: 506

Answers (1)

Yelleti Priyanka
Yelleti Priyanka

Reputation: 137

To define the watermark, we need to focus on the aspect of late data. "Refer the link for pubsub logic below."

What is the watermark heuristic for PubsubIO running on GCD?

Upvotes: 1

Related Questions