Reputation: 240
Once we persist RDD in memory, for how long it will be there in memory? Can we access the same if we come out of spark shell ?
Upvotes: 0
Views: 226
Reputation: 415
if you come out of your shell then your RDD is no longer accessible or in memory for next instance of spark-shell or any other process.
Upvotes: 2