Zookeeper Startup Failed: Permission Denied for Log Files:

Question

I'm trying to set up a Kafka producer in a Spring Boot application to send messages to a specific topic. I'm getting a SerializationException. I've checked my serializer and the schema of the messages, but I can't figure out what's wrong. Any ideas?

Zookeeper wasn't successful. While the server attempted to start, there were errors encountered during the process. Here's a breakdown of the issues:

• Log4j Configuration Errors: The log4j configuration seems to be missing or incorrect. There are several errors indicating missing "File" or "DatePattern" options for various appenders used for logging. These appenders define where and how Zookeeper should store log messages.
• Permission Denied Errors: The server tried to access log files at specific locations but encountered permission denied errors. These locations include /home/emma_luk/kafka_2.13-3.6.1/bin/../logs/server.log, /home/emma_luk/kafka_2.13-3.6.1/bin/../logs/controller.log, and others. This suggests that the user running the Zookeeper server might not have the necessary permissions to write to these directories. 1234

I attempted to modify the log.dirs configuration in my Kafka properties file. Specifically, I changed the directory path from /tmp/kafka-logs to /tmp1/kafka-logs.

Expected Outcome: The expectation was likely that Kafka would now store its log files in the new directory /tmp1/kafka-logs. By removing the old tmp and tmp1 directories, I might have expected to clean up any old log data.

Answer 1

############################# Log Basics #############################

# A comma separated list of directories under which to store log files
# log.dirs=/tmp/kafka-logs
# added a new store log files
log.dirs=/var/log/kafka

In here we need a kafka directory. You can run:

sudo mkdir -p /var/log/kafka

and then

sudo chmod 777 /var/log/kafka

The tmp folder to which it was pointing initially is a temporary folder, so it's not very stable. You might have missed permissions or something and your kafka couldn't create logs there.

You won't need to change folders from now on.

You created a kafka folder in the /var/logs/ location and kafka is going to store logs there from now on.

What do I need to do if the folder is full again?

rm -rf /var/log/kafka/*