StackOverflow Questions for Tag: apache-spark

Burak Turan

Reputation: 11

Py4JJavaError : An error occurred while calling o745.save.\n: org.apache.spark.SparkException

apache-sparkpyspark

Score: 0

Answers: 0

uds0128

Reputation: 43

Distributed REST API Calls using SPARK with maintaining consistency

apache-sparkdistributed-computing

Score: 0

Answers: 0

Patterson

Reputation: 2827

Databricks Community Edition Cluster won't start

apache-sparkdatabricks

Score: 16

Answers: 2

kushagr bakshi

Reputation: 1

java.lang.ClassNotFoundException: com.datastax.oss.driver.shaded.guava.common.collect.ImmutableMap$Builder

apache-sparkapache-kafkacassandrajarspark-cassandra-connector

Score: -5

Answers: 0

Delevin Zhong

Reputation: 23

Caused by: java.lang.IllegalStateException: This connector was made for Scala null, it was not meant to run on Scala 2.12

scalaapache-sparkgoogle-cloud-platformgoogle-cloud-dataproc

Score: 1

Answers: 3

ralpar

Reputation: 11

Disable inferSchema for JDBC connections

apache-spark

Score: 1

Answers: 1

Chandra

Reputation: 199

How to calculate No of cores,executors, amount of memory in Spark Job

scalaapache-spark

Score: 0

Answers: 1

Shiva Ram

Reputation: 61

How to write data in the dataframe into single .parquet file(both data & metadata in single file) in HDFS?

apache-sparkpysparkapache-spark-sqlbiginsights

Score: 6

Answers: 2

Mohammad

Reputation: 1013

Join two PySpark DataFrames and get some of the columns from one DataFrame when column names are similar

dataframeapache-sparkjoinpyspark

Score: 0

Answers: 2

alza

Reputation: 57

Spark Structured Streaming, empty result for a stream-stream inner join to compute rolling averages

pythonapache-spark

Score: 0

Answers: 0

Matthew Thomas

Reputation: 861

partitionOverwriteMode dynamic and "logical" partitions

apache-sparkpysparkparquet

Score: 0

Answers: 1

Michael

Reputation: 1

Allocation of Executors in Callee/Caller Spark Notebooks

apache-sparkpysparkazure-synapse

Score: 0

Answers: 0

Rahul Sharma

Reputation: 5834

What is the difference between sort and orderBy functions in Spark

apache-sparkapache-spark-sql

Score: 41

Answers: 4

Saugat Mukherjee

Reputation: 1000

Suppress py4j.clientserver logs in pyspark (databricks)

apache-sparkpysparkdatabricksazure-databrickspy4j

Score: 0

Answers: 0

vikrant rana

Reputation: 4691

GoogleHadoopOutputStream: hflush(): No-op due to rate limit

apache-sparkgoogle-cloud-platformyarn

Score: 1

Answers: 1

thayanee ruennark

Reputation: 1

Dataflow Scio : Can't get the string result in the local language

javascalaapache-sparkgoogle-cloud-dataflowspotify-scio

Score: 0

Answers: 1

justjack2000

Reputation: 1

Is there any benefit to reducing size of Uber JAR for Spark?

apache-spark

Score: -1

Answers: 1

Ayush Goyal

Reputation: 392

Spark aggregate on different group of Column

scalaapache-sparkaggregate

Score: 1

Answers: 2

ymmu

Reputation: 31

bulk insert to clickhouse using spark

apache-sparkclickhouse

Score: 1

Answers: 1

diego

Reputation: 177

Spark trying to avoid use of collect()

pythonapache-sparkdatabricks

Score: 1

Answers: 1

PreviousPage 1Next

StackOverflow Questions for Tag: apache-spark

Py4JJavaError : An error occurred while calling o745.save.\n: org.apache.spark.SparkException

Distributed REST API Calls using SPARK with maintaining consistency

Databricks Community Edition Cluster won&#39;t start

java.lang.ClassNotFoundException: com.datastax.oss.driver.shaded.guava.common.collect.ImmutableMap$Builder

Caused by: java.lang.IllegalStateException: This connector was made for Scala null, it was not meant to run on Scala 2.12

Disable inferSchema for JDBC connections

How to calculate No of cores,executors, amount of memory in Spark Job

How to write data in the dataframe into single .parquet file(both data &amp; metadata in single file) in HDFS?

Join two PySpark DataFrames and get some of the columns from one DataFrame when column names are similar

Spark Structured Streaming, empty result for a stream-stream inner join to compute rolling averages

partitionOverwriteMode dynamic and &quot;logical&quot; partitions

Allocation of Executors in Callee/Caller Spark Notebooks

What is the difference between sort and orderBy functions in Spark

Suppress py4j.clientserver logs in pyspark (databricks)

GoogleHadoopOutputStream: hflush(): No-op due to rate limit

Dataflow Scio : Can&#39;t get the string result in the local language

Is there any benefit to reducing size of Uber JAR for Spark?

Spark aggregate on different group of Column

bulk insert to clickhouse using spark

Spark trying to avoid use of collect()

Databricks Community Edition Cluster won't start

How to write data in the dataframe into single .parquet file(both data & metadata in single file) in HDFS?

partitionOverwriteMode dynamic and "logical" partitions

Dataflow Scio : Can't get the string result in the local language