CODEWITHSUNDEEP
indexinglucene
Ilija
Ilija

Reputation: 679

Indexing token bigrams in Lucene

I need to index bi-grams of words (tokens) in Lucene. I can produce n-grams and than index them, but I am wondering if there is something in Lucene which will do this for me. I found out that Lucene indexes only n-gram of chars. Any ideas?

Upvotes: 6

Views: 2344

Answers (3)

DerHeiligste
DerHeiligste

Reputation: 11

The class that you are looking for is the ShingleFilter: http://lucene.apache.org/java/2_4_0/api/org/apache/lucene/analysis/shingle/ShingleFilter.html

Upvotes: 1

bajafresh4life
bajafresh4life

Reputation: 12843

Use the NGramTokenizer:

http://lucene.apache.org/java/2_3_2/api/contrib-analyzers/org/apache/lucene/analysis/ngram/NGramTokenizer.html

Upvotes: 2

Hank Gay
Hank Gay

Reputation: 71939

Depending on why you need to index bi-grams, SpanQuery and/or SnowballAnalyzer may be helpful.

Upvotes: 0

Related Questions