StackOverflow Questions for Tag: pyspark-pandas
ZygD
Reputation: 24478
Create column using Spark pandas_udf, with dynamic number of input columns
Score: 3
Views: 1336
Answers: 5
MyNameHere
Reputation: 305
For reach row in dataframe, how to extract elements from an array?
Score: 0
Views: 107
Answers: 2
Srinivasan
Reputation: 13
Compare two PySpark DataFrames and append the results side by side
Score: 0
Views: 42
Answers: 1
Prefect73
Reputation: 341
PySpark can't find existing file in Blob storage
Score: 0
Views: 49
Answers: 1
klenium
Reputation: 2617
Why is pyspark.pandas.frame.DataFrame showing index_col warnings?
Score: 1
Views: 30
Answers: 0
Chaitanya Kulkarni
Reputation: 1
Pandas on Spark API Date Operations
Score: 0
Views: 22
Answers: 0
Zach
Reputation: 1351
Pandas on Spark Resample: "Rule Code Not Supported" & "TypeError: Type datetime64[us] was not understood"
Score: 0
Views: 135
Answers: 0
DigiLearner
Reputation: 79
Read latest file grouped by monthYear in directory in pyspark
Score: 0
Views: 462
Answers: 1
Raja Sabarish PV
Reputation: 115
Writing Pyspark dataframe as parquet by PartitionBy dataframe becomes very slow
Score: 0
Views: 76
Answers: 1
Cody Dance
Reputation: 117
Pyspark (Pandas on Spark) OOM Error with Series.apply()
Score: 0
Views: 73
Answers: 0
Rohit Kadam
Reputation: 73
PySpark regex to get value between a string and hyphen
Score: 0
Views: 296
Answers: 1
DEVEN MALI
Reputation: 11
PySpark Deciling UDF Not Giving Output & Taking Lot of time to Run
Score: 1
Views: 32
Answers: 0
bernando_vialli
Reputation: 1019
How to group by percentile distributions for every variable in a dataset and output the mean/median in pyspark
Score: 1
Views: 490
Answers: 1
ascripter
Reputation: 6233
pyspark.pandas: Converting float64 column to TimedeltaIndex
Score: 0
Views: 61
Answers: 2
DigiLearner
Reputation: 79
In azure databricks gen2, I am trying to modify value of column in pandas dataframe. My code is working fine in gen1 but in gen2 it is throwing error
Score: 0
Views: 105
Answers: 1