CODEWITHSUNDEEP
pysparkadditionnegate
fermi
fermi

Reputation: 197

Pyspark Function to Negate Column

Is there a built-in function to add a new column which is the negation of the original column?

Spark SQL has the function negative(). Pyspark does not seem to have inherited this function.

df_new = df.withColumn(negative("orginal"))

Upvotes: 5

Views: 6302

Answers (2)

Tim C.
Tim C.

Reputation: 179

I think it should be this to be syntax right, based on @pierre-gourseaud's answer:

df_new = df.withColumn("new_column_name", ~df["original"])  # Equivalent to "not original"

Upvotes: 0

Pierre Gourseaud
Pierre Gourseaud

Reputation: 2477

Assuming your column original is boolean :

df_new = df.withColumn(~df["original"])  # Equivalent to "not original"

Upvotes: 9

Related Questions