StackOverflow Questions for Tag: rdd

nagendra
nagendra

Reputation: 1965

What is a glom?. How it is different from mapPartitions?

Score: 17

Views: 20844

Answers: 4

Read More
spark_dream
spark_dream

Reputation: 346

Load a local file to spark using sc.textFile()

Score: 6

Views: 26735

Answers: 4

Read More
Mohit Aswani
Mohit Aswani

Reputation: 336

PicklingError: Could not serialize object: IndexError: tuple index out of range

Score: 19

Views: 20044

Answers: 3

Read More
a.moussa
a.moussa

Reputation: 3287

Convert RDD of LabeledPoint to DataFrame toDF() Error

Score: 0

Views: 1024

Answers: 1

Read More
Claudia Martins
Claudia Martins

Reputation: 89

Wide and Narrow transformations in Spark

Score: 0

Views: 9503

Answers: 2

Read More
Enno Victor
Enno Victor

Reputation: 51

ValueError: RDD is empty-- Pyspark (Windows Standalone)

Score: 2

Views: 12136

Answers: 2

Read More
sebenitezg
sebenitezg

Reputation: 1

Pyspark mapPartition evaluates the function more times than expected

Score: 0

Views: 87

Answers: 2

Read More
jhseo
jhseo

Reputation: 91

scala spark rdd error : java.lang.ClassCastException: cannot assign instance of java.lang.invoke.SerializedLambda

Score: 9

Views: 9640

Answers: 1

Read More
imawful
imawful

Reputation: 135

RDD is not implemented error on pyspark.sql.connect.dataframe.Dataframe

Score: 0

Views: 1432

Answers: 1

Read More
Nizar
Nizar

Reputation: 722

Does Databricks Spark persist data after the first read (outside of Spark cache)

Score: 1

Views: 188

Answers: 1

Read More
AkhilaV
AkhilaV

Reputation: 483

How to read PDF files and xml files in Apache Spark scala?

Score: 6

Views: 17196

Answers: 4

Read More
a.moussa
a.moussa

Reputation: 3287

convert Rdd to dataframe

Score: -1

Views: 4669

Answers: 1

Read More
user5924094
user5924094

Reputation:

Convert PipelinedRDD to dataframe

Score: 2

Views: 10728

Answers: 1

Read More
Subhrangshu Adhikary
Subhrangshu Adhikary

Reputation: 404

How to map data from smaller table to a larger table in Spark and Cassandra? (Primary key of 1st Table is partition key of 2nd Table)

Score: 0

Views: 48

Answers: 1

Read More
Unknown
Unknown

Reputation: 1

Obtaining covariates ' standard errors in rdrobust package in R

Score: 0

Views: 48

Answers: 0

Read More
AntVal
AntVal

Reputation: 665

Obtaining covariates' estimates in rdrobust package

Score: 0

Views: 1056

Answers: 3

Read More
Arij SEDIRI
Arij SEDIRI

Reputation: 2158

Filter RDD by values PySpark

Score: 0

Views: 9601

Answers: 1

Read More
Sachin Shrivastava
Sachin Shrivastava

Reputation: 1

Find common data among two RDD in spark execution

Score: 0

Views: 26

Answers: 1

Read More
MRR
MRR

Reputation: 415

When filtering a left join JavaRDD, Absent (or Present) cannot be cast to Optional exception

Score: 0

Views: 673

Answers: 2

Read More
Bolshoi Booze
Bolshoi Booze

Reputation: 514

Spark partition size greater than the executor memory

Score: 5

Views: 5729

Answers: 2

Read More
PreviousPage 1Next