CODEWITHSUNDEEP
scalaapache-sparkapache-spark-sqlspark-structured-streaming
Truong-Giang Nguyen
Truong-Giang Nguyen

Reputation: 81

java.lang.NoSuchMethodError: org.apache.spark.sql.internal.SQLConf.useDeprecatedKafkaOffsetFetching()Z

I want to show spark dataframe and I used:

df.writeStream.outputMode("append").start().awaitTermination()

But when I got the error when run this line:

21/07/16 01:20:53 ERROR MicroBatchExecution: Query [id = f243e6e6-c02e-4e70-b5c3-6a821fd33232, runId = 312544cf-fea8-45b4-94a1-c052306538cf] terminated with error
java.lang.NoSuchMethodError: org.apache.spark.sql.internal.SQLConf.useDeprecatedKafkaOffsetFetching()Z

Upvotes: 3

Views: 4104

Answers (1)

Mahesh
Mahesh

Reputation: 95

Check the version of spark and version of dependencies you have added. Make sure both are having the same versions. This will resolve the issue.

Upvotes: 4

Related Questions