CODEWITHSUNDEEP
amazon-web-servicesamazon-s3snowflake-cloud-data-platform
Sherin Shaziya
Sherin Shaziya

Reputation: 147

Copying files from AWS S3 to Snowflake Table - Copy executed with 0 files processed

COPY INTO mycsvtable
FROM @my_csv_stage/tutorials/dataloading/
PATTERN='.*test.dat'
on_error = 'skip_file';

COPY INTO mycsvtable
FROM @my_csv_stage/tutorials/dataloading/
PATTERN='.*test.*[.]dat'
on_error = 'skip_file';

I have multiple files named test in AWS S3 Bucket. I'm trying to copy those files to Snowflake table. When I run the COPY command, it's getting failed. I'm getting the error stating - Copy executed with 0 files processed.

Tried the above scripts. Looks like I need to make changes in the pattern. Any suggestions please?

Upvotes: 1

Views: 1636

Answers (1)

Gokhan Atil
Gokhan Atil

Reputation: 10039

If you want to ingest all files in the stage, you don't need to use pattern clause - you can just remove it.

If you need to specify the files by pattern, list the files and make sure that you have the files:

ls @my_csv_stage/tutorials/dataloading/

Lastly, maybe these files are already ingested, so you can also try using "FORCE = TRUE" option.

https://docs.snowflake.com/en/sql-reference/sql/copy-into-table.html#:~:text=the%20desired%20output.-,FORCE%20%3D%20TRUE%20%7C,-FALSE

COPY INTO mycsvtable
FROM @my_csv_stage/tutorials/dataloading/
on_error = 'skip_file' force=true;

Upvotes: 1

Related Questions