CODEWITHSUNDEEP
regexapache-kafka-connectdebezium
JDev
JDev

Reputation: 1832

In Debezium is there a way to route tables to different topics?

My tables:

  1. users
  2. clients
  3. notifications
  4. alerts

By default I want information to go to topic user_service.$tableName but for specific tables, I want the information in different tables.

Expected Output

  1. users => user_service.users
  2. clients => user_service.clients
  3. notifications => notification_service.notifications
  4. alerts => alert_service.alerts

I have the configuration that is working for one table like notifications but not sure how I can adjust if for multiple tables

Existing Config:

"transforms": "unwrap,Reroute",
"transforms.Reroute.type": "io.debezium.transforms.ByLogicalTableRouter",
"transforms.Reroute.topic.regex": "(.*)notifications",
"transforms.Reroute.topic.replacement": "notificaton_service.notifications",

Upvotes: 1

Views: 480

Answers (1)

JDev
JDev

Reputation: 1832

Got it working with

"transforms": "unwrap,Reroute",
"transforms.Reroute.type": "io.debezium.transforms.ByLogicalTableRouter",
"transforms.Reroute.topic.regex": "(.*)(notifications|alerts)",
"transforms.Reroute.topic.replacement": "$2_service.$2",

Upvotes: 1

Related Questions