CODEWITHSUNDEEP
delta-lake
user16798185
user16798185

Reputation: 275

Delta Lake - Building Data Catalog

I'm new to Delta Lake and considering to use Delta lake for one of the project with S3 or GCS as file storage. I would like to understand how the data cataloging works. Does the open source delta lake automatically creates and maintains data catalog when we create delta tables or do we need call any APIs to register the table metadata with catalog? Any pointers to documentation would be helpful.

Upvotes: 0

Views: 1523

Answers (1)

Alex Ott
Alex Ott

Reputation: 87259

Delta Lake just writes files into some storage (cloud storage, HDFS, etc.). By itself it doesn't provide any data cataloging functionality, but it's could be used with Hive Metastore (via Spark), AWS Glue, etc. The answer really depends on what stack you're using for your project.

Upvotes: 1

Related Questions