CODEWITHSUNDEEP
kubernetesfluentd
Phill Barber
Phill Barber

Reputation: 21

How to customise fluentd config when using the kubernetes fluentd-elasticsearch addon

We'd like to customise the fluentd config that comes out of the box with the kubernetes fluentd-elasticsearch addon. It seems however that there is no easy way of doing this with the current supplied Docker images.

The following file: td-agent.conf is copied to the fluentd-es Docker image with no (apparent) way of us being able to customise it.

We need to customise this config file so that we can handle multi-line log entries as one event. Most likely this would invovle making use of the multiline format (as detailed here fluentd in_tail) which would obviously mean a change from the default config file.

Currently a multi line Java stack trace appears in Kibana as multiple entires which is not ideal.

Upvotes: 2

Views: 1611

Answers (2)

Ju_Der
Ju_Der

Reputation: 57

You can still have a look at this guy, edit the td-agent.conf and build your own fluentd-elasticsearch image :)

Upvotes: 0

Yu-Ju Hong
Yu-Ju Hong

Reputation: 7287

Unfortunately, I am not aware of any method to customize the config. You can either create your own image, open a feature request at issues.k8s.io, or even submit a PR to to enhance fluentd.

Upvotes: 1

Related Questions