CODEWITHSUNDEEP
rdatabricksazure-databricks
Uttasarga Singh
Uttasarga Singh

Reputation: 27

R-Studio IDE on Databricks

I am trying to import a dataset from my Databricks File System (DBFS) to R-Studio- which is running on Databricks Cluster; and I am facing this issue below.

> sparkDF <- read.df(source = "parquet", path = "/tmp/lrs.parquet", header="true", inferSchema = "true")`

Error: Error in load : java.lang.SecurityException: No token to authorize principal at com.databricks.sql.acl.ReflectionBackedAclClient$$anonfun$com$databricks$sql$acl$ReflectionBackedAclClient$$token$2.apply(ReflectionBackedAclClient.scala:137) at com.databricks.sql.acl.ReflectionBackedAclClient$$anonfun$com$databricks$sql$acl$ReflectionBackedAclClient$$token$2.apply(ReflectionBackedAclClient.scala:137) at scala.Option.getOrElse(Option.scala:121) at com.databricks.sql.acl.ReflectionBackedAclClient.com$databricks$sql$acl$ReflectionBackedAclClient$$token(ReflectionBackedAclClient.scala:137) at com.databricks.sql.acl.ReflectionBackedAclClient$$anonfun$getValidPermissions$1.apply(ReflectionBackedAclClient.scala:86) at com.databricks.sql.acl.ReflectionBackedAclClient$$anonfun$getValidPermissions$1.apply(ReflectionBackedAclClient.scala:81) at com.databricks.sql.acl.ReflectionBackedAclClient.stripReflectionException(ReflectionBackedAclClient.scala:73) at com.databricks.sql.acl.Refle

The DBFS Location is correct, any suggestions or blogs are welcomed for this!

Upvotes: 0

Views: 865

Answers (2)

Raphael K
Raphael K

Reputation: 2353

The syntax for reading data with R on Databricks depends on whether you are reading into Spark or into R on the driver. See below:

# reading into Spark
sparkDF <- read.df(source = "parquet",
                   path = "dbfs:/tmp/lrs.parquet")


# reading into R
r_df <- read.csv("/dbfs/tmp/lrs.csv")

When reading into Spark, use the dbfs:/ prefix, when reading into R directly use /dbfs/.

Upvotes: 1

Uttasarga Singh
Uttasarga Singh

Reputation: 27

We should use dbfs before the directory path.

For Example: /dbfs/tmp/lrs.parquet

Upvotes: 0

Related Questions