StackOverflow Questions for Tag: apache-spark-1.6

Kamil Sindi
Kamil Sindi

Reputation: 22822

Get first non-null values in group by (Spark 1.6)

Score: 11

Views: 28530

Answers: 3

Read More
Satyam
Satyam

Reputation: 665

Where is the reference for options for writing or reading per format?

Score: 21

Views: 27844

Answers: 2

Read More
Sam King
Sam King

Reputation: 2188

How to register S3 Parquet files in a Hive Metastore using Spark on EMR

Score: 7

Views: 8738

Answers: 3

Read More
Sean Nguyen
Sean Nguyen

Reputation: 13118

How to change hdfs block size in pyspark?

Score: 4

Views: 7402

Answers: 3

Read More
Sumit
Sumit

Reputation: 1430

Removing NULL , NAN, empty space from PySpark DataFrame

Score: 1

Views: 16167

Answers: 2

Read More
Mia21
Mia21

Reputation: 119

PySpark- How to use a row value from one column to access another column which has the same name as of the row value

Score: 5

Views: 5984

Answers: 2

Read More
chocopie_dono
chocopie_dono

Reputation: 3

CassandraSourceRelation not serializable when joining two dataframes

Score: 0

Views: 317

Answers: 1

Read More
Dasarathy D R
Dasarathy D R

Reputation: 345

Why does persist(StorageLevel.MEMORY_AND_DISK) give different results than cache() with HBase?

Score: 3

Views: 6899

Answers: 1

Read More
Dheeraj Chitara
Dheeraj Chitara

Reputation: 29

Exception in thread "main" java.lang.NoClassDefFoundError: org/ejml/simple/SimpleBase

Score: 2

Views: 1048

Answers: 1

Read More
a.moussa
a.moussa

Reputation: 3277

udf No TypeTag available for type string

Score: 1

Views: 2541

Answers: 1

Read More
Tom Wallace
Tom Wallace

Reputation: 413

PySpark serialization EOFError

Score: 39

Views: 19977

Answers: 3

Read More
Akhila Lankala
Akhila Lankala

Reputation: 203

Dynamic Allocation for Spark Streaming

Score: 8

Views: 5927

Answers: 1

Read More
Dzmitry Haikov
Dzmitry Haikov

Reputation: 219

How to use collect_set and collect_list functions in windowed aggregation in Spark 1.6?

Score: 17

Views: 59327

Answers: 2

Read More
Prasan
Prasan

Reputation: 111

How to replace NULL to 0 in left outer join in SPARK dataframe v1.6

Score: 7

Views: 12782

Answers: 3

Read More
THIS USER NEEDS HELP
THIS USER NEEDS HELP

Reputation: 3266

Combining Spark schema without duplicates?

Score: 3

Views: 4481

Answers: 2

Read More
chris
chris

Reputation: 43

Convert a (String, List[(String, String)]) to JSON object

Score: 1

Views: 312

Answers: 1

Read More
xin
xin

Reputation: 135

How to add double quotes to the string?

Score: 0

Views: 517

Answers: 1

Read More
Umesh Kacha
Umesh Kacha

Reputation: 13656

Spark CSV package not able to handle \n within fields

Score: 4

Views: 11410

Answers: 3

Read More
Satyam
Satyam

Reputation: 665

Why does single test fail with "Error XSDB6: Another instance of Derby may have already booted the database"?

Score: 4

Views: 2709

Answers: 3

Read More
voidpro
voidpro

Reputation: 1672

How to display mismatched report with a label in spark 1.6 - scala except function?

Score: 1

Views: 56

Answers: 1

Read More
PreviousPage 1Next