Apache Kafka brokers not sending metrics to Confluent Control Panel

Question

I have deployed a 5 brokers Apache Kafka cluster with the image confluentinc/cp-enterprise-kafka and a Confluent Control Panel container with the confluentinc/cp-enterprise-control-center image, seeking the following instructions https://docs.confluent.io/current/installation/docker/docs/quickstart.html#getting-started-with-docker-client

I activated the metrics supports as follow in each node and I have restarted them:

##################### Confluent Metrics Reporter #######################
# Confluent Control Center and Confluent Auto Data Balancer integration
#
# Uncomment the following lines to publish monitoring data for
# Confluent Control Center and Confluent Auto Data Balancer
# If you are using a dedicated metrics cluster, also adjust the settings
# to point to your metrics kakfa cluster.
metric.reporters=io.confluent.metrics.reporter.ConfluentMetricsReporter
confluent.metrics.reporter.bootstrap.servers=localhost:9092
#
# Uncomment the following line if the metrics cluster has a single broker
#confluent.metrics.reporter.topic.replicas=1

##################### Confluent Proactive Support ######################
# If set to true, and confluent-support-metrics package is installed
# then the feature to collect and report support metrics
# ("Metrics") is enabled.  If set to false, the feature is disabled.
#
confluent.support.metrics.enable=true

But:

• I'm getting a metric.reporters = [] in the KafkaConfig log section.

• I'm getting a this WARN in the Confluent Control Center log:

  [2018-06-19 16:56:35,739] WARN broker=1008 is not instrumented with ConfluentMetricsReporter (io.confluent.controlcenter.healthcheck.HealthCheck)

  [2018-06-19 16:56:35,739] WARN broker=1009 is not instrumented with ConfluentMetricsReporter (io.confluent.controlcenter.healthcheck.HealthCheck)

  [2018-06-19 16:56:35,739] WARN broker=1006 is not instrumented with ConfluentMetricsReporter (io.confluent.controlcenter.healthcheck.HealthCheck)

  [2018-06-19 16:56:35,739] WARN broker=1010 is not instrumented with ConfluentMetricsReporter (io.confluent.controlcenter.healthcheck.HealthCheck)

  [2018-06-19 16:56:35,739] WARN broker=1007 is not instrumented with ConfluentMetricsReporter (io.confluent.controlcenter.healthcheck.HealthCheck)

Obviously, I'm getting the Rocket Image

I have followed the following instructions but nothing.

• https://docs.confluent.io/current/control-center/docs/installation/troubleshooting.html
• https://docs.confluent.io/current/kafka/metrics-reporter/metrics-reporter.html

This is the Docker command I use to run the Apache Kafka container:

docker run -d --net=confluent  --name=kafka1 -e KAFKA_ZOOKEEPER_CONNECT=zookeeper1:2181 -e KAFKA_ADVERTISED_LISTENERS=PLAINTEXT://kafka1:9092 confluentinc/cp-enterprise-kafka

Can someone help me, please?

Answer 1

I'll point out the obvious.

Every broker needs that property file configured, not just one.

You need to restart Kafka after every change to that file. Since you're using Docker, you need to be respectful about not deleting your Kafka topic data (for example, use a volume mount)

You need to put a comma separated list of all five bootstrap servers on the line for the metrics reporter, not only localhost