CODEWITHSUNDEEP
sqlpostgresqlcsv
sev
sev

Reputation: 1822

Adding column while loading csv in SQL

I have an existing table (NameList) in to which I would like to load the contents of multiple csv files (fileA.csv, fileB.csv ...). The columns of the table are identical to those of the csv except that I want to record for each row the id of the csv file it came from. The id would be taken from another table which contains the properties of each file.

The table with the list of files would look like this:

CREATE TABLE files
(
id serial,
fileName varchar(128),
path varchar(256),
PRIMARY KEY (id)
)

The table to insert the csv contents in to would look like:

CREATE TABLE NameList
(
FirstName varchar(40),
LastName varchar(40),
SourceFile_ID int,
FOREIGN KEY (SourceFile_ID) REFERENCES files(id)
)

The csv files would look as follows:

Name of file:
fileA.csv

Contents:
FirstName,LastName
John,Smith
.
.
.

The only thing relating to this I could find so far is this: Add extra column while importing csv data in table in SQL server table However they suggest to use a default value on the additional column which would not solve my problem since I need to have a different value for each file I add.

Upvotes: 1

Views: 1182

Answers (1)

Marko
Marko

Reputation: 1000

You could insert the data into a temporary table (https://www.postgresqltutorial.com/postgresql-temporary-table), update the column, then move the data to the main table.

This would avoid problems with 2 CSVs being loaded at once, because they'd be using different temp tables (as long as 2 different db sessions are used for the inserts). Even if only one session is used, you could have different names for the temp table for different CSVs.

Upvotes: 2

Related Questions