CODEWITHSUNDEEP
elasticsearch
Leandro
Leandro

Reputation: 948

ElasticSearch vs Relational Database

I'm creating a microservice to handle the contacts that are created in the software. I'll need to create contacts and also search if a contact exists based on some information (name, last name, email, phone number). The idea is the following: A customer calls, if it doesn't exist we create the contact asking all his personal information. The second time he calls, we will search coincidences by name, last name, email, to detect that the contact already exists in our DB. What I thought is to use a MongoDB as primary storage and use ElasticSearch to perform the query, but I don't know if there is really a big difference between this and querying in a common relational database.

EDIT: Imagine a call center that is getting calls all the time from mostly different people, and we want to search fast (by name, email, last name) if that person it's in our DB, wouldn't ElasticSearch be good for this?

Upvotes: 23

Views: 37467

Answers (4)

James-Jesse Drinkard
James-Jesse Drinkard

Reputation: 15723

As always, it depends on your specific use case. You briefly described it, but how are you acually going to use the data?

If it's just something simple like checking if a customer exists and then creating a new customer, then use the RDMS option. Moreover, if you don't expect a large dataset, so that scaling isn't an issue (hence the designation that Elasticsearch is for BigData), but you have transactions and data integrity is important, then a RDMS will be the right fit. Some examples could be for tax, leasing, or financial reporting systems.

However, if you have a large dataset, you need a wide range of query capabilities, such as a fuzzy search or searches where the user can select multiple filters on the data or you want to do some predictive analysis on the data, then Elasticsearch is the clear choice.

For example, I worked on an web based app with a large customer base: 11 million, with 200+ hits per second at peak time for a find a doctor application. The customer could check some checkboxes to determine, specialty, spoken languages, ratings, hospitals, etc. all sorted by the distance from the users location with a 2 second or less response time. It would be very difficult for a RDMS to match that.

Upvotes: 2

Sorter
Sorter

Reputation: 10240

Indexed RDBMS works well for search

If your data is structured i.e. columns are clearly defined, searching 1 million records will also not be a problem in RDBMS.

When to use Elastic

  • Text Search: Searching words across multiple properties (e.g. description, name etc.)
  • JSON Store and search: If data being stored is in json format and later needs to be searched
  • Auto Suggestions: Elastic is better at providing autocomplete suggestions

Elastic as an application data provider

Elastic should not be seen as data store, even if you storing data in it. It is about how you perceive elastic. Elastic should be used to store and setup data for the application. It is the application which decides how and when to use elastic (search and suggestions). Elastic is not a nosql storage alternative if compared to RDBMS, you should use a nosql database instead.

This perception puts elastic in line with redis and kafka. These tools are key components of an application design and they are used to serve as events stores, search engines and cache etc. to the applications.

Database with Elastic

Your design should use both. For storing the contacts use the database, index the contacts for querying. Also make the data available in elastic for searching, autocomplete and related matches.

Upvotes: 3

Harald
Harald

Reputation: 5163

A relational database can store data and also index it.

A search engine can index data but also store it.

Relational databases are better in read-what-was-just-written performance. Search engines are better at really quick search with additional tricks like all kinds of normalization: lowercase, ä->a or ae, prefix matches, ngram matches (if indexed respectively). Whether its 1 million or 10 million entries in the store is not the big deal nowadays, but what is your query load? Well, there are only this many service center workers, so your query load is likely far less than 1qps. No problem for a relational DB at all. The search engine would start to make sense if you want some normalization, as described above, or you start indexing free text comments, descriptions of customers.

Upvotes: 33

Jasper Huzen
Jasper Huzen

Reputation: 1573

If you don't have a problem with performance, then keep it simple and use 1 single datastore (maybe with some caching in your application).

Elasticsearch is not meant to be a primary datastore so my advice is to use a simple relational database like Postgres and use simple SQL queries / a ORM mapper. If the dataset is not really large it should be fast enough.

When you have performance issues on searches you can use a combination of relation db and Elasticsearch. You can use Elasticsearch feeders to update ES with your data in you relational db.

Upvotes: 19

Related Questions