CODEWITHSUNDEEP
pysparkdatabricksdatabricks-connect
Cam Bruce
Cam Bruce

Reputation: 5689

Running PySpark remotely on Databricks Cluster

I have an Azure Function that hosts an API and I would like to integrate some existing basic data access code that uses PySpark hosted in a DBX notebook into the function. Is this supported or should this code be refactored to use DBX SQL Connector?

I have seen various articles that mention DBX Connect - but also that it is not supported anymore. If that is the case, can you use PySpark without DBX Connect or am I better off refactoring this code?

Upvotes: 0

Views: 18

Answers (0)

Related Questions