Satheessh Chinnusamy
Satheessh Chinnusamy

Reputation: 443

spark RDD (Resilient Distributed Dataset) can be updated?

RDD can be updated? --- i.e. suppose we created a RDD from "a.txt" file. "a.txt" got updated. is possible to update RDD without reading entire file a.txt?

Upvotes: 1

Views: 408

Answers (1)

pulasthi
pulasthi

Reputation: 1750

RDD are immutable by definition hence you want be able to change the RDD when the "a.txt" file changes.

Upvotes: 1

Related Questions