StackOverflow Questions for Tag: sparkcore

DA1
DA1

Reputation: 1

Dynamic Allocation cannot apply for executor because the pendingTask variable in driver has become negative

Score: 0

Views: 50

Answers: 0

Read More
user4649893
user4649893

Reputation:

JSON read from sparkcore to python

Score: 1

Views: 236

Answers: 2

Read More
Nebi M Aydin
Nebi M Aydin

Reputation: 278

Shuffle Partition vs Join Keys

Score: 0

Views: 99

Answers: 1

Read More
Jelly
Jelly

Reputation: 1318

Where App, used Spark, execute not-spark-context code

Score: 0

Views: 34

Answers: 1

Read More
codingprabhu
codingprabhu

Reputation: 3

How to optimise a left join where both the tables are quite big (1 tb size and other 250gb)

Score: 0

Views: 163

Answers: 0

Read More
Mariusz Kowalewski
Mariusz Kowalewski

Reputation: 161

Exception in thread "main" java.lang.IllegalAccessError: class org.apache.spark.storage.StorageUtils$

Score: 15

Views: 25123

Answers: 2

Read More
KennyBerga
KennyBerga

Reputation: 11

Combining data from JSON and CSV files using Spark Core in Python

Score: 1

Views: 136

Answers: 1

Read More
Pradip Sodha
Pradip Sodha

Reputation: 105

check whether is spark format exists or not

Score: 1

Views: 147

Answers: 1

Read More
Pankaj Shet
Pankaj Shet

Reputation: 189

Which component of the spark architecture convert the Spark Application to DAG?

Score: 0

Views: 184

Answers: 1

Read More
Sekhar Talupula
Sekhar Talupula

Reputation: 1

map transformation on Spark paired rdd

Score: 0

Views: 54

Answers: 1

Read More
dev-eloper
dev-eloper

Reputation: 110

Override Spark Core_2.12 (v3.3.0) logging configuration

Score: 2

Views: 354

Answers: 0

Read More
Chethan G B
Chethan G B

Reputation: 27

How to Override log4j with log4j2 version to resolve "SocketServer class vulnerable to deserialization" for apache-core_2.12 version

Score: 0

Views: 2606

Answers: 1

Read More
user17490324
user17490324

Reputation: 1

Is there a link between Spark Components and the Spark Ecosystem?

Score: 0

Views: 54

Answers: 1

Read More
Rahul Sharma
Rahul Sharma

Reputation: 5834

Spark-submit fails with yarn master, error- requirement failed at scala.Predef

Score: 0

Views: 2814

Answers: 3

Read More
acorntech
acorntech

Reputation: 63

Spark Driver does not have any worker allotted

Score: 1

Views: 953

Answers: 1

Read More
Julia Bel
Julia Bel

Reputation: 347

Regression issue between org.apache.commons.commons-email and spark

Score: 0

Views: 78

Answers: 0

Read More
Balu
Balu

Reputation: 13

spark-scala: Transform the dataframe to generate new column gender and vice versa

Score: 1

Views: 482

Answers: 3

Read More
Rocky
Rocky

Reputation: 51

how to get this below list using spark rdd?

Score: -2

Views: 100

Answers: 1

Read More
Vijay
Vijay

Reputation: 75

task tuning in spark and creating checkpoint for task

Score: 0

Views: 70

Answers: 0

Read More
shankar
shankar

Reputation: 225

From the following code how to convert a JavaRDD<Integer> to DataFrame or DataSet

Score: 0

Views: 457

Answers: 1

Read More
PreviousPage 1Next