CODEWITHSUNDEEP
hadoopmapreducehivehdfshcatalog
lex
lex

Reputation: 1861

How to access Hive log information

I am trying to analyze the performance of the Hive queries. Though I was able to make Hive queries with Java but I still need to access the log information getting generated after each query. Instead of using a hack to read the latest log on the disk and using regex to extract the numbers I am looking for a graceful method if already available.

Any pointers will be helpful. Thanks in advance.

-lg

Upvotes: 0

Views: 1224

Answers (2)

K S Nidhin
K S Nidhin

Reputation: 2650

Once hive starts running a corresponding map-reduce job starts. The logs of this hadoop job can be found on the corresponding tasktracker on which each task runs.

Use jobclient API to retrieve these logs programmatically.

Upvotes: 0

Navneet Kumar
Navneet Kumar

Reputation: 3752

Query execution details like Status,Finished at, Finished in are displayed in Job Tracer, you can access job tracker programmatically . Related info at this link

How could I programmatically get all the job tracker and tasktracker information that is displayed by Hadoop in the web interface?

Upvotes: 1

Related Questions