StackOverflow Questions for Tag: apache-spark-sql-repartition

Felipe Francesco

Reputation: 1

PySpark Job Fails with Executor Lost Error on AWS Glue

pysparkaws-glueparquetapache-spark-sql-repartition

Score: 0

Answers: 0

Vijeth Kashyap

Reputation: 233

AWS Glue 3.0: Partition Count changing by itself even after repartition

apache-sparkpysparkapache-spark-sqlaws-glueapache-spark-sql-repartition

Score: 0

Answers: 1

Martin Studer

Reputation: 2321

Shuffle map stage failure with indeterminate output: eliminate the indeterminacy by checkpointing the RDD before repartition

apache-sparkpysparkapache-spark-sqlazure-databricksapache-spark-sql-repartition

Score: 4

Answers: 2

luckyluke

Reputation: 654

Repartitioning a spark dataframe by column name(s)

apache-spark-sql-repartition

Score: 0

Answers: 0

Loganayaki mahalingam

Reputation: 53

Issue while converting string to date datatype of a column in Spark SQL

apache-sparkpysparkapache-spark-sqlapache-spark-sql-repartition

Score: 0

Answers: 0

Kaushik Ghosh

Reputation: 131

Selecting a Dataproc Cluster Size with autoscaling ON

performancepysparkautoscalinggoogle-cloud-dataprocapache-spark-sql-repartition

Score: 1

Answers: 0

Subhadip Roy

Reputation: 1

metadata driven DQ validation for multiple tables dynamically

pysparkapache-spark-sqlapache-spark-sql-repartition

Score: 0

Answers: 0

G.S.Tomar

Reputation: 308

Spark Grouped Record Processing

apache-sparkapache-spark-sqlspark3apache-spark-sql-repartitionapache-spark-3.0

Score: 0

Answers: 0

user23202697

Reputation: 1

Last SPARK Task taking forever to complete

scalaapache-sparkdatabricksapache-spark-sql-repartition

Score: 0

Answers: 0

aaa

Reputation: 105

Spark SQL repartition before insert operation

apache-sparkapache-spark-sqlhiveapache-spark-sql-repartition

Score: 1

Answers: 0

jarry jafery

Reputation: 1036

Spark SQL correlated subquery not identifying parent columns

sql-serverapache-sparkapache-spark-sqlapache-spark-sql-repartition

Score: 0

Answers: 0

ByronSchuurman

Reputation: 143

How to export SQL files in Synapse to sandbox environment or directly access these SQL files via notebooks?

azurepysparkapache-spark-sqlazure-synapseapache-spark-sql-repartition

Score: 0

Answers: 1

Blue Clouds

Reputation: 8153

repartition in memory vs file

apache-sparkpysparkpartition-byapache-spark-sql-repartition

Score: 0

Answers: 2

Gary

Reputation: 11

Hanging Task in Databricks

apache-sparkdatabricksuser-defined-functionsapache-spark-sql-repartition

Score: 1

Answers: 0

Praveen Kumar B N

Reputation: 141

If I repartition by column name does spark understand that it is repartitioned by that column when it is read back

apache-sparkpysparkapache-spark-sql-repartition

Score: 0

Answers: 1

Sanjay Bagal

Reputation: 119

PySpark Performance slow in Reading large fixed width file with long lines to convert to structural

apache-sparkpysparkfixed-widthgoogle-spark-operatorapache-spark-sql-repartition

Score: 0

Answers: 0

Pawel

Reputation: 1

Spark number of input partitions vs number of reading tasks

apache-sparkpysparkapache-spark-sqlapache-spark-sql-repartition

Score: 0

Answers: 1

figs_and_nuts

Reputation: 5743

How does pyspark repartition work without column name specified?

apache-sparkpysparkapache-spark-sqlapache-spark-sql-repartition

Score: 1

Answers: 1

pavan kumar

Reputation: 1

spark repartition issue for filesize

scalaapache-sparkhdfsapache-spark-sql-repartition

Score: 0

Answers: 1

figs_and_nuts

Reputation: 5743

understanding spark.default.parallelism

apache-sparkapache-spark-sqlapache-spark-sql-repartition

Score: 2

Answers: 1

PreviousPage 1Next