StackOverflow Questions for Tag: apache-spark-1.6

CodeDreamer
CodeDreamer

Reputation: 444

How to unit test Spark Streaming code?

Score: 1

Views: 1017

Answers: 1

Read More
Jorge Cespedes
Jorge Cespedes

Reputation: 597

Spark Streaming 1.6 + Kafka: Too many batches in "queued" status

Score: 1

Views: 1162

Answers: 1

Read More
Mnav505
Mnav505

Reputation: 13

Spark 1.6 - Overwrite directory with avro files failing using dataframes

Score: 1

Views: 182

Answers: 0

Read More
Naveen Yadav
Naveen Yadav

Reputation: 9

How to drop duplicates considering only subset of columns?

Score: 0

Views: 3778

Answers: 1

Read More
Alexvonrass
Alexvonrass

Reputation: 330

How to replace nulls in Vector column?

Score: 3

Views: 1059

Answers: 2

Read More
Suresh Sethuramaswamy
Suresh Sethuramaswamy

Reputation: 31

pyspark memory issue :Caused by: java.lang.OutOfMemoryError: Java heap space

Score: 2

Views: 1356

Answers: 1

Read More
Ani Menon
Ani Menon

Reputation: 28277

How to define partitions to Dataframe in pyspark?

Score: 0

Views: 267

Answers: 0

Read More
reapasisow
reapasisow

Reputation: 275

What to do with "WARN TaskSetManager: Stage contains a task of very large size"?

Score: 14

Views: 22469

Answers: 1

Read More
Mercury Trivival
Mercury Trivival

Reputation: 11

Error accessing Spark thrift Server

Score: 0

Views: 844

Answers: 2

Read More
Ahmet DAL
Ahmet DAL

Reputation: 4700

Why Spark application on YARN fails with FetchFailedException due to Connection refused?

Score: 9

Views: 20511

Answers: 2

Read More
prateek
prateek

Reputation: 1

Not able to load hive table into Spark

Score: 0

Views: 1032

Answers: 1

Read More
summerbulb
summerbulb

Reputation: 5879

Spark temp tables not found

Score: 2

Views: 981

Answers: 0

Read More
Joseratts
Joseratts

Reputation: 97

How to know which is the RDD type inferred by Spark using Scala

Score: 0

Views: 2384

Answers: 1

Read More
Mia21
Mia21

Reputation: 119

Pyspark: How to return a tuple list of existing non null columns as one of the column values in dataframe

Score: 2

Views: 2203

Answers: 3

Read More
RudyVerboven
RudyVerboven

Reputation: 1274

Specify default value for rowsBetween and rangeBetween in Spark

Score: 1

Views: 3480

Answers: 2

Read More
oracletohive
oracletohive

Reputation: 15

Oracle to Spark/Hive: how to convert use of "greatest" function to Spark 1.6 dataframe

Score: 1

Views: 451

Answers: 1

Read More
Sumit
Sumit

Reputation: 1450

Programmatically specifying the schema in PySpark

Score: 1

Views: 6881

Answers: 1

Read More
Mia21
Mia21

Reputation: 119

Pyspark- handling exceptions and raising RuntimeError in pyspark dataframe

Score: 0

Views: 2228

Answers: 1

Read More
Srinivas Bandaru
Srinivas Bandaru

Reputation: 321

How to use different Hive metastore for saveAsTable?

Score: 2

Views: 892

Answers: 2

Read More
Mia21
Mia21

Reputation: 119

flatMap doesn't preserve order when creating lists from pyspark dataframe columns

Score: 1

Views: 994

Answers: 2

Read More
PreviousPage 3Next