Reputation: 667
I need to split a stream of data using flink.
the 1st one named "myDs" - contains duplicate data
the 2nd one named "goodDataStream" should filter duplicates
the partial code is:
goodDataStream = myDs
.filter( new DedupeFilterFunction()) // does this line affects myDs also?
// createSync for goodDataStream
// createSync for myDs
my question is:
does it means that myDs sync also includes the new DedupeFilterFunction()
Thanks.
Upvotes: 0
Views: 224
Reputation: 3422
DataStream
is immutable. So in your case myDs
will not have the DedupeFilterFunction
applied.
Upvotes: 3