CODEWITHSUNDEEP
solrhbasehue
Abhilash
Abhilash

Reputation: 33

Is it possible to retrieve Hbase data along with Solr data?

I have the pipeline of Hbase, Lily, Solr and Hue setup for search and visualization. I am able to search on the data indexed in Solr using Hue, except I cannot view all the required data since I do not have all the fields from Hbase stored in Solr. I'm not planning on storing all of the data as well.

So is there a way of retrieving those fields from Hbase along with the Solr response for visualizing the data with Hue?

From what I know, I believe it is possible to setup the Solr searchhandler to perform this, but I haven't been able to find a concrete example to help me understand better(I am very new to both Solr and Hbase, so examples help)

My question is similar to this question. But I am unable to comment there for further information.

Current Solution thanks to suggestion by Romain: Used HTML widget to provide a link for each record in Hue Search page back to the Hbase record on the Hbase Browser.

Upvotes: 2

Views: 453

Answers (1)

Ramzy
Ramzy

Reputation: 7148

One of the approach is, fetch the required id from the solr, and then get the actual data from Hbase. Well solr gives you the count based on your query and also some faceting features. Once those are fetched, and you always have the data in Hbase. Solr is best for index search. So given the speed and space compromise, this design can help. Another main reason is Hbase gives you good fetch times for entire row, when searched based on row key. So, the overall performance depends on your Hbase row key design also.

i think you are using lily Hbase indexer if I am not wrong. so by default the doc id is the hbase row key, which might make things easy

Upvotes: 1

Related Questions