Kshitij Kulshrestha
Reputation: 2072
Convert RDD[Map[String,Double]] to RDD[(String,Double)]
I did some calculation and returned my values in a RDD containing scala map and now I want to remove this map and want to collect all keys values in a RDD.
Any help will be appreciated.
Upvotes: 0
Views: 708
Answers (1)
Kim Stebel
Reputation: 42045
You can call flatMap with the identity function to 'flatten' the structure of your RDD.
rdd.flatMap(identity)
Upvotes: 2
Related Questions
- Scala RDD[(String,String)] to RDD[String]
- Flatten RDD[(String,Map[String,Int])] to RDD[String,String,Int]
- java.lang.String cannot be cast to java.lang.Double Error when trying to return Map[(String, String),(Double, Double)] from RDD
- org.apache.spark.rdd.RDD[((String, Double), (String, Double))] to Dataframe in Scala
- How to convert an array of array of Doubles to an RDD[String]
- Spark: Converting RDD[(Long, Array[Double])] to RDD[(Long, Long, Double)]
- Scala Spark - convert RDD[List[scala.Double]] to RDD[scala.Double]
- Spark RDD[(String, String)] into RDD[Map[String, String]]
- Convert RDD from type `org.apache.spark.rdd.RDD[((String, String), Double)]` to `org.apache.spark.rdd.RDD[((String), List[Double])]`
- How should I do to transform a RDD[String] to RDD[(String, String)]?