CODEWITHSUNDEEP
apache-sparkpysparkdatabricks
Hello lad
Hello lad

Reputation: 18790

Databricks: how to convert Spark dataframe under %python to dataframe under %r

I have a Dataframe in %python environment, and try to use that in %r environment.

How can I convert a spark dataframe under %python to %r ?

Upvotes: 4

Views: 2647

Answers (1)

zero323
zero323

Reputation: 330183

It is not even worth trying. The idiomatic way is to register temporary view and let metastore do the rest. In Python:

df.createOrReplaceTempView("some_name")

in R:

sql("REFRESH TABLE some_name")
df <- sql("SELECT * FROM some_name")

Upvotes: 5

Related Questions