CODEWITHSUNDEEP
databrickssymlinkdelta-lake
SunithaM
SunithaM

Reputation: 71

Azure Databricks - Unable to create symlink

I am trying to create symlink on databricks delta table which is on ADLS(Azure) with the below command.

%sql
%sql
GENERATE symlink_format_manifest FOR TABLE schema_name.`dbfs:/filepath`;

which fails with the below error: Error in SQL statement: NoSuchTableException: Table or view 'dbfs:/filepath' not found in database 'schema_name';

Upvotes: 0

Views: 935

Answers (1)

Dr. Casual
Dr. Casual

Reputation: 438

You should be referring to a delta table either by using

delta.`abfss://<file_system>@<account_name>.dfs.core.windows.net/<path>/<file_name>`

or when your ADLS is mounted to you DBFS:

delta.`/mnt/<path>/<file_name>`

or when using a hive table

delta.`/mnt/<path>/<file_name>`

you can't however link to a file on the filesystem that way

Upvotes: 1

Related Questions