CODEWITHSUNDEEP
user-interfaceapache-flinkflink-streaming
Cassie
Cassie

Reputation: 3099

Streaming metrics for Flink application

I have set up Flink UI for application running in Intellij IDEA. I would like to get some streaming metrics like - scheduling delay and processing time. However, I can not find the anywhere in UI. Should there be some specific setup for that or should I explicitly submit app jar?

Currently, Flink UI for the job looks like this:

st

Upvotes: 0

Views: 461

Answers (2)

David Anderson
David Anderson

Reputation: 43499

All of the task metrics are exposed in the web UI, as Dominik mentioned, but for other metric scopes (e.g., job metrics) only some selected metrics are displayed. You can access all of the metrics via the REST API or by connecting a metrics reporter to send the metrics to an external metrics system.

I don't think any attempt has been to made to measure scheduling delay, but in the job metrics you will find things like restarting time and uptime.

Upvotes: 1

Dominik Wosiński
Dominik Wosiński

Reputation: 3864

In the UI you should have a tab Task Metrics when You select the currently running job. This tab allows You to choose a task and see all the metrics that are available. Although, I am not sure if the scheduling delay is one of currently available metrics.

Probably the better idea is to refer to expose the metrics for some collector of Your choice, You can find more info in the documentation: https://ci.apache.org/projects/flink/flink-docs-stable/monitoring/metrics.html.

Upvotes: 0

Related Questions