CODEWITHSUNDEEP
sql-serverssisbcpsnowflake-cloud-data-platform
ROXOR7
ROXOR7

Reputation: 61

Inserting data in snowflake using Copy into from stage files

My copy into command is as follows:

"COPY INTO "+ @[User::SchemaName] + "." + @[User::tableName] +  "  file_format = (field_delimiter = '|',null_if = ('NULL', 'null'),empty_field_as_null=false,validate_UTF8=false)"

After copying when I do select distinct on a column the output is as shown below.

Is there anything wrong with my copy into command? Or the flat file?

1,2,3 three empty records as distinct

Upvotes: 2

Views: 1157

Answers (1)

Balaji-Snowflake
Balaji-Snowflake

Reputation: 191

You will have to examine your flat file. You have asked not to validate the utf8 data in your file format and also empty_field_as_null=false .

Examine your flat file to check if it is having any non utf8 characters and set the proper encoding.

you can use the file command on the flat file to see if it has any non utf values and based on that set the encoding.

example : file ITEM_STACK.1 ITEM_STACK.1: ISO-8859 text, with very long lines

Review the table in the following documentation for the encoding values

https://docs.snowflake.net/manuals/user-guide/intro-summary-loading.html#supported-character-sets-for-delimited-files

Upvotes: 2

Related Questions