CODEWITHSUNDEEP
apache-flinkflink-streamingflink-sql
LiJianing
LiJianing

Reputation: 32

how to extract column&table lineage from flink sql

I want to build a lineage system for a real-time data warehouse，how can I extract table and column lineage from flink sql?

Upvotes: 0

Views: 526

Answers (1)

morsapaes
morsapaes

Reputation: 491

In addition to the answer in the Flink User Mailing List, I'd like to point out that there is ongoing work in the community to integrate Flink with Apache Atlas. This could be a more viable option for data governance than building your own custom implementation.

You can get some pointers in the initial discussion.

Upvotes: 1

Related Questions