JY2k
Reputation: 2909
How to debug dataflow template udf output
The job is now outputting any successful rows. All of the InvokeUDF stage are outputting to ProcessedUDF.out0 rather than ProccessedUDF.out1. see
How can I debug this when using the template? Stackdriver is not showing any relevant logs.
Upvotes: 0
Views: 231
Answers (1)
JY2k
Reputation: 2909
I was sending the wrong format of message. This video helped me understand the issue.
Upvotes: 1
Related Questions
- Debugging a Google Dataflow Streaming Job that does not work expected
- Dataflow Flex Template validation failing with no reason given
- How to debug DataFlow exception
- GCP Dataflow template creation issue through python SDK
- Debugging Dataflow template GCS to BigQuery
- Dataflow unable to parse template file with custom template
- How to debug python dataflow beam.io.WriteToBigQuery
- Cannot generate templated dataflow in Python
- Cloud Dataflow Custom Template creation Issues
- Diagnosing failed Cloud Dataflow pipeline