CODEWITHSUNDEEP
apache-sparkrdd
gsuresh92
gsuresh92

Reputation: 241

Does spark support accessing RDD's across drivers

Let's say i created an RDD using RSpark, can i access that RDD using pyspark driver ? Does spark support accessing RDD's across drivers ?

Upvotes: 2

Views: 50

Answers (1)

Al M
Al M

Reputation: 557

Unfortunately it does not. You can store your RDD in HDFS and share it that way. If you want to store it in memory you can use Tachyon to store it.

Upvotes: 1

Related Questions