StackOverflow Questions for Tag: scala-spark

mandar

Reputation: 113

Caching Processed Data In Spark in the Event of Task Failures so as to Not Reprocess the same when the Task Restarts

apache-sparkscala-spark

Score: 0

Answers: 1

Shivam Sajwan

Reputation: 41

Ignoring codec because it collides with previously generated codec

scalacassandradatastax-java-driverspark-cassandra-connectorscala-spark

Score: 1

Answers: 1

PRATIK CHAPADGAONKAR

Reputation: 41

How to setup and run scala-spark in intellij?

scalaintellij-ideascala-spark

Score: 1

Answers: 3

Pragya Shukla

Reputation: 1

spark3 submit job is unable to read metadata of Hive avro table

avronosuchmethoderrorscala-sparkapache-spark-3.0

Score: 0

Answers: 0

Avik

Reputation: 41

charVarcharAsString is not trimming data/not working as expected for Oracle TargetTable

apache-sparkspark3scala-sparkapache-spark-3.0

Score: 0

Answers: 0

Gary Chan Chi Hang

Reputation: 89

Is there a way to partition/group by data where sum of column values per each group is under a limit?

apache-sparkpysparkdatabricksdatabricks-sqlscala-spark

Score: 0

Answers: 1

Noob

Reputation: 67

Scala spark query optimization

pythonapache-sparkpysparkapache-spark-sqlscala-spark

Score: 0

Answers: 1

Sarthak Sharma

Reputation: 21

org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus can't be cast to org.apache.spark.sql.execution.datasources.FileStatusWithMetadat

javascalaapache-sparkdelta-lakescala-spark

Score: 2

Answers: 1

Nikhil Padole

Reputation: 87

Convert spark scala dataset of one type to another

scalaapache-sparkapache-spark-sqlscala-spark

Score: 0

Answers: 1

Luca Genova

Reputation: 1

Scala Spark distributed run on Google Cloud Platform but worker not working

dataframeapache-sparkgoogle-cloud-platformdistributed-computingscala-spark

Score: 0

Answers: 0

vZ10

Reputation: 2676

Explode nested list of objects into DataFrame in Spark

scalaapache-sparkscala-spark

Score: 0

Answers: 1

Kewitschka

Reputation: 1661

Access newly created column in withinColumn

apache-sparkscala-spark

Score: -1

Answers: 3

Abishek

Reputation: 847

Spark Array column - Find max interval between two values

scalaapache-sparkpysparkapache-spark-sqlscala-spark

Score: 1

Answers: 2

isrikanthd

Reputation: 83

Divide a column value into multiple rows by number of months based on start date & end date columns

sqlpysparkapache-spark-sqlscala-spark

Score: -1

Answers: 2

alsetr

Reputation: 13

Spark broadcasts right dataset from left join, which causes org.apache.spark.sql.execution.OutOfMemorySparkException

apache-sparkscala-spark

Score: 0

Answers: 1

Jiaming Pei

Reputation: 1

Scala - Create Dataframe with only 1 row from a List using for comprehension

dataframescalaapache-sparkscala-spark

Score: 0

Answers: 1

Yue Wang

Reputation: 21

How to improve spark filter() performance on an array of struct?

scalaapache-sparkapache-spark-sqlscala-spark

Score: 1

Answers: 1

marc

Reputation: 319

Spark extract values from Json struct

apache-sparkpysparkstructscala-spark

Score: 0

Answers: 1

Vivek Gowda

Reputation: 1

How to apply custom logics on spark dataframe using scala

apache-sparkapache-spark-sqlapache-spark-datasetscala-spark

Score: -1

Answers: 1

Shiv Konar

Reputation: 43

Performance Implications of spark read

scalaapache-sparkoptimizationscala-spark

Score: 1

Answers: 2

PreviousPage 1Next

StackOverflow Questions for Tag: scala-spark

Caching Processed Data In Spark in the Event of Task Failures so as to Not Reprocess the same when the Task Restarts

Ignoring codec because it collides with previously generated codec

How to setup and run scala-spark in intellij?

spark3 submit job is unable to read metadata of Hive avro table

charVarcharAsString is not trimming data/not working as expected for Oracle TargetTable

Is there a way to partition/group by data where sum of column values per each group is under a limit?

Scala spark query optimization

org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus can&#39;t be cast to org.apache.spark.sql.execution.datasources.FileStatusWithMetadat

Convert spark scala dataset of one type to another

Scala Spark distributed run on Google Cloud Platform but worker not working

Explode nested list of objects into DataFrame in Spark

Access newly created column in withinColumn

Spark Array column - Find max interval between two values

Divide a column value into multiple rows by number of months based on start date &amp; end date columns

Spark broadcasts right dataset from left join, which causes org.apache.spark.sql.execution.OutOfMemorySparkException

Scala - Create Dataframe with only 1 row from a List using for comprehension

How to improve spark filter() performance on an array of struct?

Spark extract values from Json struct

How to apply custom logics on spark dataframe using scala

Performance Implications of spark read

org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus can't be cast to org.apache.spark.sql.execution.datasources.FileStatusWithMetadat

Divide a column value into multiple rows by number of months based on start date & end date columns