Sathwik Matsa
Sathwik Matsa

Reputation: 43

How to verify the state of Kafka Migration from ZooKeeper to KRaft

I’m in the middle of migrating from Zookeeper to KRaft in my Kafka cluster running on Kubernetes. Following the official Zookeeper to KRaft migration guide, I provisioned the KRaft controller quorum, reconfigured the brokers, and restarted them in migration mode.

The documentation mentions that an INFO-level log should appear in the active controller once the migration is complete:

Completed migration of metadata from Zookeeper to KRaft.

However, I’m unsure if I missed this log or if the migration is simply taking too long (it’s been more than a day). I’m seeing the following logs from KRaftMigrationDriver:

[2025-01-15 18:26:13,481] TRACE [KRaftMigrationDriver id=102] Not sending RPCs to brokers for metadata delta since no relevant metadata has changed (org.apache.kafka.metadata.migration.KRaftMigrationDriver)
[2025-01-15 18:26:13,979] TRACE [KRaftMigrationDriver id=102] Did not make any ZK writes when handling KRaft delta (org.apache.kafka.metadata.migration.KRaftMigrationDriver)
[2025-01-15 18:26:13,981] TRACE [KRaftMigrationDriver id=102] Updated ZK migration state after delta in 1712653 ns. Transitioned migration state from ZkMigrationLeadershipState{kraftControllerId=102, kraftControllerEpoch=38, kraftMetadataOffset=419012, kraftMetadataEpoch=38, lastUpdatedTimeMs=1736667640219, migrationZkVersion=385284, controllerZkEpoch=146, controllerZkVersion=146} to ZkMigrationLeadershipState{kraftControllerId=102, kraftControllerEpoch=38, kraftMetadataOffset=419013, kraftMetadataEpoch=38, lastUpdatedTimeMs=1736667640219, migrationZkVersion=385285, controllerZkEpoch=146, controllerZkVersion=146} (org.apache.kafka.metadata.migration.KRaftMigrationDriver)

Does this mean the migration is still progressing or migration is complete and these logs indicate dual-write mode?

Upvotes: 0

Views: 35

Answers (0)

Related Questions