CODEWITHSUNDEEP
dataprocgoogle-cloud-dataproc-serverless
Warren Zhu
Warren Zhu

Reputation: 1495

How to change log level in dataproc serverless spark

In dataproc serverless, the underlying vm is hidden. How to change log level in dataproc serverless spark?

--properties ^@^spark.executor.extraJavaOptions=-Dlog4j.configuration=spark-log4j2.properties \
--files spark-log4j2.properties \

Upvotes: 0

Views: 205

Answers (1)

Warren Zhu
Warren Zhu

Reputation: 1495

Adding file: prefix worked.

--properties ^@^spark.executor.extraJavaOptions=-Dlog4j.configuration=file:spark-log4j2.properties \
--files spark-log4j2.properties \

Upvotes: 0

Related Questions