CODEWITHSUNDEEP
apache-flink
Ahmad.S
Ahmad.S

Reputation: 809

Debugging on the remote cluster

I have a program which works fine in a local cluster but not running properly when executing in on the remote cluster. I would like to know, what are the best and common ways of debugging a program running on a remote Flink cluster? Any help is appreciated!

Upvotes: 2

Views: 1163

Answers (1)

Robert Metzger
Robert Metzger

Reputation: 4542

There are several ways to debug a Flink application on a remote cluster. Since using a real debugger is complicated, I would first try to log as much as possible to find out the error.

Another approach that could be helpful is using Flink's accumulators. With them, you can gather some statistics: For example when you have a filter, you can determine, how many elements passed the filter and so on.

The last resort is attaching a debugger to one of the Flink TaskManager JVMs.

Also check out my presentation on the topic: http://de.slideshare.net/robertmetzger1/apache-flink-hands-on

Upvotes: 4

Related Questions