CODEWITHSUNDEEP
hadoopbigdata
Laurynas Stašys
Laurynas Stašys

Reputation: 338

Accessing Hadoop data using REST service

I am trying to update HDP architecture so data residing in Hive tables can be accessed by REST APIs. What are the best approaches how to expose data from HDP to other services?

This is my initial idea:

I am storing data in Hive tables and I want to expose some of the information through REST API therefore I thought that using HCatalog/WebHCat would be the best solution. However, I found out that it allows only to query metadata. enter image description here

What are the options that I have here?

Thank you

Upvotes: 0

Views: 6485

Answers (3)

shankarsh15
shankarsh15

Reputation: 1967

You can very well use WebHDFS which is basically a REST Service over Hadoop.

Please see documentation below:

https://hadoop.apache.org/docs/r1.0.4/webhdfs.html

Upvotes: 1

lmccay
lmccay

Reputation: 396

What version of HDP are you running? The Knox component has been available for quite a while and manageable via Ambari.

Can you get an instance of HiveServer2 running in HTTP mode? This would give you SQL access through J/ODBC drivers without requiring Hadoop config and binaries (other than those required for the drivers) on the client machines.

Upvotes: 0

Ra_
Ra_

Reputation: 264

The REST API gateway for the Apache Hadoop Ecosystem is called KNOX

I would check it before explore any other options. In other words, Do you have any reason to avoid using KNOX?

Upvotes: 0

Related Questions