StackOverflow Questions for Tag: scala-spark
Reputation: 31
MountVolume.SetUp failed for volume "spark-conf-volume-driver" : configmap "spark-drv-27c9b887c306cb9c-conf-map" not found
Score: 3
Views: 2824
Answers: 1
Reputation: 133
Different behaviour of same query in Spark 2.3 vs Spark 3.2
Score: 1
Views: 917
Answers: 2
Reputation: 214
How Spark broadcast the data in Broadcast Join
Score: 0
Views: 559
Answers: 1
Reputation: 133
Why different behavior when mixed case are used, vs same case are used in spark 3.2
Score: 0
Views: 68
Answers: 1
Reputation: 11
spark scala exploding struct array throwing error ambigous reference to fields
Score: 0
Views: 90
Answers: 1
Reputation:
Convert Vector[String] to Dataframe in Scala Spark
Score: 0
Views: 113
Answers: 3
Reputation: 47
save dataframe with records limit but also make sure same value is not across multiple files
Score: 0
Views: 488
Answers: 1
Reputation: 11
Get the column names of the max and second value for each record in a scala dataframe
Score: 1
Views: 109
Answers: 2
Reputation: 1
Issues running Graph queries after upgrading Spark 2.4.3 to 3.1.3
Score: 0
Views: 50
Answers: 1
Reputation: 13
Performance degraded after upgrading from spark-cassandra-connector 2.4.0 to 3.1.0
Score: 1
Views: 327
Answers: 1
Reputation: 281
How to create Scala trait which stores data from other columns in dataset and then create new dataset with column storing the trait in Scala?
Score: 0
Views: 152
Answers: 1
Reputation: 727
How to integrate Intellij and Databricks, like when using the jdwp with a regular Spark cluster?
Score: 0
Views: 118
Answers: 0
Reputation: 25
Add a tag to the list in the DataFrame based on the threshold given for the values in the list in Scala Spark
Score: 0
Views: 149
Answers: 1
Reputation: 25
Add a tag to the list in the DataFrame based on the data from the second DataFrame
Score: 0
Views: 58
Answers: 1
Reputation: 1
inequality test of two columns from same dataframe in pyspark
Score: 0
Views: 1611
Answers: 1
Reputation: 11
DataFrame values Changing after adding columns using withColumn
Score: 0
Views: 130
Answers: 0
Reputation: 31
spark-submit error loading class with fatjar on macOS
Score: 1
Views: 105
Answers: 1
Reputation: 45
Why we use Val for Accumulators and not Var in scala?
Score: 0
Views: 48
Answers: 1
Reputation: 19
Coalesce dynamic column list from two datasets
Score: 0
Views: 354
Answers: 2