CODEWITHSUNDEEP
databricksazure-databricks
Stefan Papp
Stefan Papp

Reputation: 2255

How do I pass content of variables from one notebook to another in a databricks workflow?

I am looking for a way to access data from other notebooks in a Databricks Workflow.

Meaning. I have some results in Notebook A and Notebook B that depends on Notebook A. Notebook B wants to access the results.

Upvotes: 1

Views: 8963

Answers (2)

joanlofe
joanlofe

Reputation: 3639

It seems this is now possible using the feature task values (announcement, docs).

This feature is useful to pass variables from a parent task to its childs. If you want to pass huge amounts of data between notebooks, I am afraid you need to write them anywhere else, as @Stefan Papp suggests.

Upvotes: 3

Stefan Papp
Stefan Papp

Reputation: 2255

When writing this question, the Workflows in Databricks are one year old.

It seems there is no way at the time of writing this by Databricks

https://community.databricks.com/s/question/0D53f00001kL6tpCAC/how-to-pass-outputs-from-a-python-task-to-a-notebook-task.

And the only way to do it would be to store it in a DB table

Upvotes: 1

Related Questions