mytabi
mytabi

Reputation: 779

databrick: spark read from Azure SQL DW error

Currently in my notebook which is using

spark.read \  
  .format("com.databricks.spark.sqldw")\  
  .option("url", myurl)

to read data from Azure SQL DW . But now suddenly there is error : Caused by: java.lang.IllegalArgumentException: Unexpected version returned: Microsoft Azure Synapse SQL Analytics - 10.0.10887.0 Dec 18 2019 21:47:50 Copyright (c) Microsoft Corporation Make sure your JDBC url includes a "database=" option and that it points to a valid Azure SQL Data Warehouse name. This connector cannot be used for interacting with any other systems than DW (e.g. Azure SQL Databases).

what's happening ???

when i use

spark.read \  
  .format("jdbc")\  
  .option("url", myurl)

this is ok . why ?

Upvotes: 1

Views: 497

Answers (1)

Aasim Khan
Aasim Khan

Reputation: 92

The problem occurred due to the change in the name of Azure Data Warehouse by Microsoft. I faced the same issue today and raised it to Microsoft Support. They are working on the rollback at the moment. Hope to see the resolution soon.

Upvotes: 1

Related Questions