Reputation: 745
I have an idea for an application make a search engine using tools Nutch, ES and Kibana. Nutch for crawling, ES for indexing and Kibana for the visualisation.
Currently, I have all the programs fine and I can successfully use them in terminal. My question is, is it possible to make a Java Application which incoporates Nutch, Es and Kibana all in one?
My idea for the application is that it will accept a URL for nutch to crawl, after crawling it will then accept terms to index. Finally, it will make a visualisation page with Kibana of the data.
Any pointers on how to do this?
Upvotes: 0
Views: 48
Reputation: 4854
Why do you want to have them as a single application? ES and Kibana are services and meant to run continuously. If you had StormCrawler (see comment above) that would be another continuous service. All you'd need to do is build a UI to send the URLs to a queue.
Upvotes: 0