CODEWITHSUNDEEP
apache-sparkapache-spark-sqldatabricks
John
John

Reputation: 4006

Where are Databricks "create table using" options documented

I'm using Databricks "CREATE TABLE USING" functionality documented here using something like the following.

create table value_set.value_set_meta 
using csv 
options ( 
  header = "true", 
  delimiter = ",", 
  inferSchema = "false", 
  path = "/FileStore/tables/prod/global/value_set_meta" 
)

I'd like to know if there is an option to trim white spaces from all columns (and/or for specific columns). Where are the options that are allowed here listed and documented?

Upvotes: 1

Views: 1058

Answers (1)

mck
mck

Reputation: 42332

I bet the options are

ignoreLeadingWhiteSpace = "true",
ignoreTrailingWhiteSpace = "true",

because the other options look so similar to those documented in the pyspark csv reader. Not sure if trimming spaces from specific columns is possible though.

Upvotes: 1

Related Questions