CODEWITHSUNDEEP
elasticsearchfilebeat
JeyJ
JeyJ

Reputation: 4070

Filebeat - shipping and processing configuration files in format key=value

I'm using Filebeat to send logs to Logstash and from there to ElasticSearch.

I want to send also configuration files but I would like to decode it and convert it to json or to any other format that will let me run aggregation queries based on the configuration keys and values.

My file :

key1=val1
key2=val2
key3=val3

In Kibana, I would like to do some aggregation based on key1 for example..

Is there any processor like decode_json or decode_csv that I can use ?

Upvotes: 0

Views: 172

Answers (1)

YLR
YLR

Reputation: 1540

The mecanism to parse this dataflow must be managed on logstash side, not on filebeat which must keep a minimal footprint on the host.

So in consideration of this point, you have to set the filter in the logstash configuration file which must looks like this :

filter{
  kv{}
}

For more details looks the official documentation here.

Upvotes: 1

Related Questions