CODEWITHSUNDEEP
apache-flinkflink-streamingrocksdb
user239874
user239874

Reputation: 33

View Size of Flink State Maintained By Each Operator

I use Flink1.8 for java to perform stateful calculations. My state is stored in RocksDB. Is it possible for me to determine the size of the state being maintained by each of my operators? My intent is to automatically/regularly report the total state size of each operator and trigger an alarm if they change dramatically.

Upvotes: 0

Views: 836

Answers (1)

David Anderson
David Anderson

Reputation: 43439

You can use this endpoint in Flink's REST API:

/jobs/:jobid/checkpoints/details/:checkpointid/subtasks/:vertexid

See the Flink 1.8 docs for more info: https://ci.apache.org/projects/flink/flink-docs-release-1.8/monitoring/rest_api.html#jobs-jobid-checkpoints-details-checkpointid-subtasks-vertexid

Upvotes: 3

Related Questions