CODEWITHSUNDEEP
apache-flink
f4x
f4x

Reputation: 137

Flink BroadcastProcessFunction vs "Broadcast Variables"

In flink app I need to pass a complex object to all downstream operators. I have found two things for it:

Could you advise when I should choose one of them and when?

Upvotes: 0

Views: 121

Answers (1)

David Anderson
David Anderson

Reputation: 43707

Broadcast variables were about sharing static configuration information during system initialization when doing batch processing with the now defunct DataSet API.

A BroadcastProcessFunction is used to process a stream of updates to broadcast state; this is part of the DataStream API. See the docs on The Broadcast State Pattern for more info.

A BroadcastProcessFunction or KeyedBroadcastProcessFunction is useful when you want to make a relatively small set of data available to all instances of a process function -- i.e., rules used by a rules engine, or foreign currency exchange rates.

Upvotes: 1

Related Questions