Luis Alves
Luis Alves

Reputation: 1286

Flink throughput per task (or node)

How can I calculate the throughput of a task or node in Flink? The only reference to throughput that I can find in Flink's documentation is related with the Meter. But I'm not sure if this does what I need. Can someone confirm if it does?

Upvotes: 1

Views: 452

Answers (1)

Robert Metzger
Robert Metzger

Reputation: 4542

In Flink 1.2 there will be metrics for throughput per task.

In 1.1 you have to build something yourself. You could use this flatMap operator as an example to measure throughput: https://github.com/rmetzger/flink-state-watermarks/blob/master/src/main/java/com/dataartisans/utils/ThroughputLogger.java

Upvotes: 2

Related Questions