Reading CSV header and saving with Dataflow Beam on Python

Question

How to read the first line and store header data in Apache Beam Python?

Answer 1

Check out this example. See how the UsCovidDataCsvReader parses the input.

The basic ideas are

• read the header and build a schema from it
• read the file with skip_header_lines=1
• parse the input with the schema to build a PCollection