Ali
Ali

Reputation: 1869

Filter out documents before indexing in Elasticsearch based on certain condition

I was wondering if I could filter our documents before indexing in Elasticsearch based on specific condition. For example, let's say I would like to drop a document from being index if field1="something". Is this something I can address via using out of the box processors in Elasticsearch and use "ingest node" to cover it? Can I write a custom processor if it doesn't exist?

Upvotes: 0

Views: 230

Answers (1)

ThomasC
ThomasC

Reputation: 8165

You cannot do this directly in Elasticsearch using pipelines (see this issue).

However, Logstash has a drop filter designed exactly for this and which may be useful in your case.

Upvotes: 2

Related Questions