CODEWITHSUNDEEP
apache-nifi
user5539487
user5539487

Reputation:

How Can I View FlowFile or STDOUT of Processor?

When things fail, I'd like to view the flow file, or the output (stdout+stderr) from the problematic processor. Is there an easy way to dump out all of the Flowfile's properties, or to just browse a Flowfile?

Upvotes: 13

Views: 4726

Answers (2)

David Medinets
David Medinets

Reputation: 5618

You can look at the Flowfile by uncompressing the flow.xml.gz file that is in the configuration directory. Of course, there is a lot of extraneous information there so it is not useful for debugging.

Looking at the STDOUT and STDERR of a processor would not help debugging either. Look instead at the flowfile content and attributes in the queues.

Upvotes: 0

Bryan Bende
Bryan Bende

Reputation: 18630

Processors usually have one or more relationships for failures and it is up to the data flow designer to determine what to do with these.

Some failures are due to temporary conditions like if a destination system was down, for those they would typically be looped back to the same processor to keep retrying until the destination comes back up.

Other failures are due to issues related to the data and likely don't make sense to retry because they will continue to fail. This set of failures you can route to PutFile processor to write them out to directory somewhere, or a PutEmail processor to notify you. Either of those would give you access to the raw data. If you want to see the flow file attributes you could use data provenance to look at all the flow files that passed through the PutFile/PutEmail processor.

Upvotes: 10

Related Questions