CODEWITHSUNDEEP
apache-sparkhashmap
Ashutosh Garg
Ashutosh Garg

Reputation: 1

Is there any way to read data from HashSet as spark structured streaming using readStream() method?

Reading data from HashMap using readStream() method of Spark Structured streaming method.

Upvotes: 0

Views: 70

Answers (1)

OneCricketeer
OneCricketeer

Reputation: 191973

No, there isn't

At the very least, you need to parallelize the map, but that then becomes an RDD or Dataframe if you apply a schema.

A stream in Spark (and similar frameworks) is that its an unbounded quantity of data. At any moment of a Hashmap or Hashset's existence, it has a fixed size(), therefore is not a stream

Upvotes: 1

Related Questions