reading data from Kafka and storing it in dynamo db

Question

I need to read data from multiple topics in Kafka broker and store the data in Dynamo DB. Any reference code or any specific method i can go ahead with.

I Tried using https://github.com/shikhar/kafka-connect-dynamodb but i couldn't get much help as am new to this.

Answer 1

One of the options to read from Kafka and write to Dynamo is Nifi.

Use ConsumeKafka Nifi Processor as consumer: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-9-nar/1.5.0/org.apache.nifi.processors.kafka.pubsub.ConsumeKafka/

and PutDynamoDB to write: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.5.0/org.apache.nifi.processors.aws.dynamodb.PutDynamoDB/

This also facilitates to do any quick transformation, forking etc.