CODEWITHSUNDEEP
resthadoopflumehortonworks-data-platformambari
Col
Col

Reputation: 371

Flume Metrics through REST API

I'm running hortonworks 2.3 and currently hooking into the REST API through ambari to start/stop the flume service and also submit configurations. This is all working fine, My issue is how do I get the metrics? Previously I used to run an agent with the parameters to produce the metrics to a http port and then read them in from there using this:

-Dflume.root.logger=INFO,console
-Dflume.monitoring.type=http
-Dflume.monitoring.port=XXXXX

However now that Ambari kicks off the agent I no longer have control over this. Any assistance appreciated :-)

Upvotes: 1

Views: 1456

Answers (2)

alili
alili

Reputation: 166

Using Ambari 2.6.2.0, http://{ipadress}:8080/api/v1/clusters/{your_cluster_name}/components/?ServiceComponentInfo/component_name=FLUME_HANDLER&fields=host_components/metrics/flume/flume gives flume metrics breakdown by components. Found the answer by giving a shot (and doing some cropping) to the API call provided to this JIRA issue (which complains about how slow fetching flume metrics is) https://issues.apache.org/jira/browse/AMBARI-9914?attachmentOrder=asc Hope this helps.

Upvotes: 2

Alexandre
Alexandre

Reputation: 153

I don't know if you still need the answer. That happens because Hortonworks, by default, disable JSON monitoring, they use their own metric class to send the metrics to Ambari Metrics. While you can't retrieve it from Flume directly, you still can retrieve it from Ambari REST API: https://github.com/apache/ambari/blob/trunk/ambari-server/docs/api/v1/index.md.

Good luck,

Upvotes: 0

Related Questions