CODEWITHSUNDEEP
hadoophbaseflume
Chhaya Vishwakarma
Chhaya Vishwakarma

Reputation: 1437

Multiple flume agent on same machine

I have a problem statement where i need to collect data from multiple machines(each machine forwarding data for different format) to centralized storage(Hbase).

I need to make a different table for each type of log collected.

How can i do it using flume? Is it possible to run multiple flume agent on same machine ? I can assign each type to one agent which will write to hbase.

Upvotes: 0

Views: 823

Answers (1)

Sarge
Sarge

Reputation: 2366

Just configure them all up in the same flume.conf and restart your agent.

You'll need a different source, channel and sink for each different stream of data. You can plumb them any way you wish.

Upvotes: 1

Related Questions