CODEWITHSUNDEEP
apache-sparkmemoryrdd
Jigar Gorakhiya
Jigar Gorakhiya

Reputation: 167

Spark RDD Memory

val rddMap = rdd.map(x=>x*x)
val rddReduce = rddMap.reduce((a:Int,b:Int) => a + b)

At which step will be the data loaded into the Memory of worker node?

Upvotes: 0

Views: 79

Answers (1)

Amardeep Flora
Amardeep Flora

Reputation: 1380

to load the data into memory, you need to use .cache in your code.

Upvotes: 1

Related Questions