CODEWITHSUNDEEP
pysparkdatabricksspark-notebook
Swapnil
Swapnil

Reputation: 1

Getting error message as NameError: name 'over' is not defined . Even after doing all necessary imports

emp_data_df.withColumn("Row_Number",row_number(),over(window))\
.withColumn("Rank",rank(),over(window))\
.withColumn("Dense_Rank",dense_rank(),over(window))\
.filter(col("Desnse_Rank")<=2)\
.show(truncate=False)

i am getting error message as NameError: name 'over' is not defined . How to resolve this?

Upvotes: 0

Views: 22

Answers (1)

karatekraft
karatekraft

Reputation: 195

Looks like you have a typo in your code. Instead of ',over()', it should be '.over()'

 emp_data_df.withColumn("Row_Number",row_number().over(window))\
.withColumn("Rank",rank().over(window))\
.withColumn("Dense_Rank",dense_rank().over(window))\
.filter(col("Desnse_Rank")<=2)\
.show(truncate=False)

Upvotes: 1

Related Questions