CODEWITHSUNDEEP
information-retrieval
Nisanio
Nisanio

Reputation: 4097

besides BM25, whats other ranking functions exists?

besides BM25, what's other ranking functions exists? Where I found information on this topic?

Upvotes: 1

Views: 936

Answers (2)

Arman Fatahi
Arman Fatahi

Reputation: 3005

BM25 is one of term-based ranking algorithms. Nowadays there are concept-based algorithms as well.

BM25 if state-of-the-art of term based information retrieval; however, there are some challenges that term-based cannot overcome such as, relating synonyms, matching an abbreviation or recognizing homonyms. Here are the examples:

synonym: "buy" and "purchase"

antonym: "Professor" and "Prof."

homonym:

  • bow – a long wooden stick with horse hair that is used to play certain string instruments such as the violin
  • bow – to bend forward at the waist in respect (e.g. "bow down")

To deal with these problems, some are using concept-based models such as this article and this article.

Concept-based models are mostly using dictionaries or external terminologies to identify concepts and each have their own representation of concepts or weighting algorithms.

Upvotes: 1

jshen
jshen

Reputation: 11917

vanilla tf-idf is what is often used. If you want to learn about these things the best place to start is this book.

Upvotes: 0

Related Questions