CODEWITHSUNDEEP
sqlapache-spark-sqldatabricksdelta-lake
Anirban Nag 'tintinmj'
Anirban Nag 'tintinmj'

Reputation: 5762

Spark SQL Error while creating a Delta Table with NULL as column in Databricks

I am trying to create a Delta table from SELECT statement and a NULL value for column. There is no error coming when I create the table but it is throwing a error when trying to run select.

%sql
create or replace table test1 as (
  select
    col1,
    null as a,
  from
    table1
);

No error coming up.

%sql
select * from test1;

Error : IllegalStateException: Couldn't find a#31234 in [col1#31233]

Upvotes: 5

Views: 6290

Answers (1)

Kombajn zbożowy
Kombajn zbożowy

Reputation: 10693

It is because by writing null you created a column of type VOID - check your schema.

You need to cast it to a useful type, eg. STRING, when creating table:

create or replace table test1 as
  select
    col1,
    cast(null as string) as a,
  from
    table1;

Then the query will work.

Upvotes: 8

Related Questions