StackOverflow Questions for Tag: apache-spark-2.3

Neeleshkumar S
Neeleshkumar S

Reputation: 776

Read specific file from multiple .gz file in Spark

Score: 0

Views: 373

Answers: 2

Read More
Akash Jain
Akash Jain

Reputation: 55

I have added a parcel for spark 2.4 and created a service for spark 2. But its invoking spark 1.6 shell

Score: 1

Views: 294

Answers: 0

Read More
Barak Freiman
Barak Freiman

Reputation: 21

Spark shuffle disk spill increase when upgrading versions

Score: -1

Views: 65

Answers: 1

Read More
Maviles
Maviles

Reputation: 3469

Pyspark self-join with error "Resolved attribute(s) missing"

Score: 2

Views: 5218

Answers: 1

Read More
Niko
Niko

Reputation: 680

Writing DataFrame as parquet creates empty files

Score: 3

Views: 4797

Answers: 1

Read More
Vincent Chalmel
Vincent Chalmel

Reputation: 652

Pyspark aggregate a StructType column as an Array of its elements for each line

Score: 1

Views: 3966

Answers: 1

Read More
nir
nir

Reputation: 3868

Spark - Operation not allowed: alter table replace columns

Score: 2

Views: 4198

Answers: 1

Read More
SarahData
SarahData

Reputation: 809

when is it not performance practical to use persist() on a spark dataframe?

Score: 11

Views: 9863

Answers: 2

Read More
adihere
adihere

Reputation: 81

Spark - No disk space left on Topic modelling

Score: 1

Views: 1164

Answers: 1

Read More
Ahmad Senousi
Ahmad Senousi

Reputation: 633

Convert pyspark dataframe to pandas dataframe

Score: 6

Views: 11517

Answers: 2

Read More
Shashank BR
Shashank BR

Reputation: 65

create new column in pyspark dataframe using existing columns

Score: 0

Views: 3288

Answers: 1

Read More
SarahData
SarahData

Reputation: 809

Repartitioning a pyspark dataframe fails and how to avoid the initial partition size

Score: 0

Views: 2165

Answers: 1

Read More
MichaelChirico
MichaelChirico

Reputation: 34703

Casting string like "[1, 2, 3]" to array

Score: 0

Views: 507

Answers: 1

Read More
rajusem
rajusem

Reputation: 79

Unable to query/select data those inserted through Spark SQL

Score: 0

Views: 887

Answers: 1

Read More
AlphaWolf
AlphaWolf

Reputation: 379

How to build zeppelin 0.8.0 with spark 2.3.2 inbuilt

Score: 0

Views: 289

Answers: 1

Read More
A Learner
A Learner

Reputation: 177

Sharing data across executors in Apache spark

Score: 0

Views: 985

Answers: 1

Read More
user3576279
user3576279

Reputation:

Cant save table to hive metastore, HDP 3.0

Score: 1

Views: 2234

Answers: 2

Read More
max04
max04

Reputation: 6805

Different behaviour of cache method for PySpark dataframes in Spark 2.3

Score: 1

Views: 649

Answers: 0

Read More
VB_
VB_

Reputation: 45692

Spark spark.sql.session.timeZone doesn't work with JSON source

Score: 2

Views: 3231

Answers: 0

Read More
PreviousPage 2Next