StackOverflow Questions for Tag: catalyst-optimizer

jack

Reputation: 1951

Spark reads all columns in filtering when using scala syntax

apache-sparkapache-spark-datasetcatalyst-optimizerframeless

Score: 0

Answers: 2

RyanCheu

Reputation: 3552

Why would finding an aggregate of a partition column in Spark 3 take very long time?

apache-sparkapache-spark-sqlspark3catalyst-optimizer

Score: 1

Answers: 1

alexanoid

Reputation: 25852

Apache Spark dataframe lineage trimming via RDD and role of cache

dataframeapache-sparkrdddata-lineagecatalyst-optimizer

Score: 3

Answers: 1

Zelazny7

Reputation: 40638

How to structure large queries in spark

pysparkapache-spark-sqldatabrickscatalyst-optimizer

Score: 2

Answers: 0

Rajat

Reputation: 5803

Does Spark SQL optimize lower() on both sides?

apache-sparkapache-spark-sqlcatalyst-optimizer

Score: 0

Answers: 1

wpunter

Reputation: 11

How do you inspect candidate logical plans of cost-based SQL optimizer in spark (scala)?

sqlapache-sparkcost-based-optimizercatalyst-optimizer

Score: 1

Answers: 0

dpolaczanski

Reputation: 396

is it possible to avoid second exchange when spark joins two datasets using joinWith?

apache-sparkjoinapache-spark-datasetcatalyst-optimizer

Score: 1

Answers: 0

Arjunlal M.A

Reputation: 151

Apache Spark What is the difference between requiredChildDistribution and outputPartitioning?

scalaapache-sparkapache-spark-sqlhdfscatalyst-optimizer

Score: 1

Answers: 0

Surendiran Balasubramanian

Reputation: 69

What is the role of Catalyst optimizer and Project Tungsten

apache-sparkapache-spark-sqlcatalyst-optimizer

Score: 5

Answers: 1

Vijaya Bhaskar

Reputation: 63

Dataframe API vs Spark.sql

dataframeapache-sparkcatalyst-optimizer

Score: 3

Answers: 3

Allen Han

Reputation: 1163

For "iterative algorithms," what is the advantage of converting to an RDD then back to a Dataframe

apache-sparkapache-spark-sqlrddcatalyst-optimizer

Score: 5

Answers: 1

cozos

Reputation: 945

How to create custom Spark-Native functions without forking/modifying Spark itself

apache-sparkuser-defined-functionscatalyst-optimizer

Score: 4

Answers: 0

Hamza EL KAROUI

Reputation: 79

Export a spark logical/physical plan?

apache-sparkapache-spark-sqlmetastorecatalyst-optimizer

Score: 1

Answers: 1

Allen Han

Reputation: 1163

Is it possible to outperform the Catalyst optimizer on highly skewed data using only RDDs

apache-sparkjoinapache-spark-sqlrddcatalyst-optimizer

Score: 1

Answers: 0

user276537

Reputation: 11

steps in spark physical plan not assigned to DAG step

apache-sparkhiveclouderahortonworks-data-platformcatalyst-optimizer

Score: 1

Answers: 1

Alon

Reputation: 11935

Spark internals: benefits of Project

apache-sparkinternalscatalyst-optimizer

Score: 1

Answers: 1

adream307

Reputation: 95

Rewrite LogicalPlan to push down udf from aggregate

scalaapache-sparkcatalyst-optimizer

Score: 3

Answers: 1

Anthony Arrascue

Reputation: 260

Long linear queries in Spark against a graph stored in Hive tables

scalaapache-sparkgraphapache-spark-sqlcatalyst-optimizer

Score: 0

Answers: 1

mauna

Reputation: 1118

What happened to the ability to visualize query plans in a Databricks notebook?

apache-sparkapache-spark-sqldatabrickscatalyst-optimizer

Score: 0

Answers: 1

BiS

Reputation: 503

Spark optimize "DataFrame.explain" / Catalyst

apache-sparkoptimizationinternalscatalyst-optimizer

Score: 0

Answers: 1

PreviousPage 1Next

StackOverflow Questions for Tag: catalyst-optimizer

Spark reads all columns in filtering when using scala syntax

Why would finding an aggregate of a partition column in Spark 3 take very long time?

Apache Spark dataframe lineage trimming via RDD and role of cache

How to structure large queries in spark

Does Spark SQL optimize lower() on both sides?

How do you inspect candidate logical plans of cost-based SQL optimizer in spark (scala)?

is it possible to avoid second exchange when spark joins two datasets using joinWith?

Apache Spark What is the difference between requiredChildDistribution and outputPartitioning?

What is the role of Catalyst optimizer and Project Tungsten

Dataframe API vs Spark.sql

For &quot;iterative algorithms,&quot; what is the advantage of converting to an RDD then back to a Dataframe

How to create custom Spark-Native functions without forking/modifying Spark itself

Export a spark logical/physical plan?

Is it possible to outperform the Catalyst optimizer on highly skewed data using only RDDs

steps in spark physical plan not assigned to DAG step

Spark internals: benefits of Project

Rewrite LogicalPlan to push down udf from aggregate

Long linear queries in Spark against a graph stored in Hive tables

What happened to the ability to visualize query plans in a Databricks notebook?

Spark optimize &quot;DataFrame.explain&quot; / Catalyst

For "iterative algorithms," what is the advantage of converting to an RDD then back to a Dataframe

Spark optimize "DataFrame.explain" / Catalyst