jencake
Reputation: 161
Dynamically get the database name from a Databricks DLT pipeline
How do I dynamically get the database name from a DLT pipeline?
Upvotes: 3
Views: 401
Answers (1)
Jodiug
Reputation: 6098
I found this using spark.conf.getAll:
dlt_database_name = spark.conf.get("pipelines.schema")
We are using DLT from a database in hive_metastore, so I'm not sure yet if it would work for Unity Catalog.
Upvotes: 0
Related Questions
- How to separate Delta Live Tables production and development targets and repo branches?
- DLT notebook calls the same table definition multiple times
- Can a Delta Live Table (DLT) be passed as a parameter to a User Defined Functions (UDF) in Databricks?
- Databricks Delta Live Table - How To Simply Append A Batch Source To a DLT Table?
- Create a Database with name from variable on Databricks (in SQL, not in Spark)
- ADF - get table name from dataset
- Reading Databricks tables in Azure
- specify a database name in databricks sql connection parameters
- Extract table name from more than one schema length in Data Factory Expression
- How to pass dynamic table names for sink database in Azure Data Factory