StackOverflow Questions for Tag: apache-spark-sql

Leandro Guimarães

Reputation: 59

Function to add weekdays from date

sqlapache-spark-sqldatabricksdatabricks-sql

Score: 0

Answers: 1

Shiva Ram

Reputation: 61

How to write data in the dataframe into single .parquet file(both data & metadata in single file) in HDFS?

apache-sparkpysparkapache-spark-sqlbiginsights

Score: 6

Answers: 2

Rahul Sharma

Reputation: 5834

What is the difference between sort and orderBy functions in Spark

apache-sparkapache-spark-sql

Score: 41

Answers: 4

Vibav Mahendran

Reputation: 29

How to intercept Spark SQL queries

apache-sparkapache-spark-sql

Score: 2

Answers: 1

Jason

Reputation: 1130

Spark Physical Plan: meaning of number of input batches in ColumnarToRow operator

apache-sparkpysparkapache-spark-sql

Score: 0

Answers: 2

Kania

Reputation: 31

Error on saving pyspark dataframe to parquet

pythonapache-sparkpysparkapache-spark-sql

Score: 1

Answers: 1

detcle

Reputation: 79

How to efficiently join two directories that are already partitioned

apache-sparkpysparkapache-spark-sql

Score: 1

Answers: 1

Suraj Pandey

Reputation: 107

Pyspark find columns with mismatched data

pythonapache-sparkpysparkapache-spark-sql

Score: 0

Answers: 1

detcle

Reputation: 79

Whether repartition() will always shuffle even before an action is triggered

apache-sparkpysparkapache-spark-sql

Score: 1

Answers: 1

David Sánchez

Reputation: 634

Does Spark exceptAll() requires both dataframe columns to be in same order?

apache-sparkpysparkapache-spark-sql

Score: 2

Answers: 1

S. Nasir

Reputation: 19

Unexpected PySpark filter behaviour

pythonpysparkfilterapache-spark-sql

Score: 1

Answers: 1

haihong zeng

Reputation: 71

AttributeError: 'NoneType' object has no attribute 'sc'

pysparkapache-spark-sql

Score: 7

Answers: 4

Shafaat Hussain

Reputation: 79

An error occurred while calling z:org.apache.spark.api.python.PythonRDD.collectAndServe

python-3.xapache-sparkpysparkapache-spark-sql

Score: 0

Answers: 1

harinath reddy

Reputation: 1

Apache Spark SQL Query Returns No Results for a Column in Azure Synapse Notebook

apache-sparkpysparkapache-spark-sql

Score: 0

Answers: 0

Rocky1989

Reputation: 399

Oozie spark action error which configuring

pysparkapache-spark-sqloozie-coordinatoroozie-workflow

Score: 0

Answers: 0

BelowZero

Reputation: 1383

Monotonically increasing id order

pythondataframeapache-sparkpysparkapache-spark-sql

Score: 0

Answers: 1

buxioli

Reputation: 1

converting datetime to string on Databricks SQL

sqlapache-spark-sqldatabricksdatabricks-sql

Score: 0

Answers: 1

DAJames

Reputation: 11

Databricks Widget into list

pythonapache-spark-sqlwidgetdatabricksdatabricks-sql

Score: 1

Answers: 2

Brian

Reputation: 139

Spark Large single Parquet file to Delta Failure with Spark SQL

apache-sparkapache-spark-sqlparquetazure-synapse

Score: 0

Answers: 1

kakripr

Reputation: 21

Get list of formats in Apache Spark (data sources)

pythonapache-sparkvalidationpysparkapache-spark-sql

Score: 2

Answers: 1

PreviousPage 1Next

StackOverflow Questions for Tag: apache-spark-sql

Function to add weekdays from date

How to write data in the dataframe into single .parquet file(both data &amp; metadata in single file) in HDFS?

What is the difference between sort and orderBy functions in Spark

How to intercept Spark SQL queries

Spark Physical Plan: meaning of number of input batches in ColumnarToRow operator

Error on saving pyspark dataframe to parquet

How to efficiently join two directories that are already partitioned

Pyspark find columns with mismatched data

Whether repartition() will always shuffle even before an action is triggered

Does Spark exceptAll() requires both dataframe columns to be in same order?

Unexpected PySpark filter behaviour

AttributeError: &#39;NoneType&#39; object has no attribute &#39;sc&#39;

An error occurred while calling z:org.apache.spark.api.python.PythonRDD.collectAndServe

Apache Spark SQL Query Returns No Results for a Column in Azure Synapse Notebook

Oozie spark action error which configuring

Monotonically increasing id order

converting datetime to string on Databricks SQL

Databricks Widget into list

Spark Large single Parquet file to Delta Failure with Spark SQL

Get list of formats in Apache Spark (data sources)

How to write data in the dataframe into single .parquet file(both data & metadata in single file) in HDFS?

AttributeError: 'NoneType' object has no attribute 'sc'