Reputation: 6945
I need a way to change the specific value of a column of a CSV file. For example I have this CSV file:
"Ip","Sites"
"127.0.0.1",10
"127.0.0.2",23
"127.0.0.3",50
and I need to change the value 23 to 30 of the row "127.0.0.2".
I use csv library: import csv
Upvotes: 39
Views: 139230
Reputation: 9704
This is the solution opening the csv file, changing the values in memory and then writing back the changes to disk.
r = csv.reader(open('/tmp/test.csv')) # Here your csv file
lines = list(r)
Content of lines:
[['Ip', 'Sites'],
['127.0.0.1', '10'],
['127.0.0.2', '23'],
['127.0.0.3', '50']]
Modifying the values:
lines[2][1] = '30'
Content of lines:
[['Ip', 'Sites'],
['127.0.0.1', '10'],
['127.0.0.2', '30'],
['127.0.0.3', '50']]
Now we only have to write it back to a file
with open('/tmp/output.csv', 'w', newline='', encoding='utf-8') as file:
writer = csv.writer(file)
writer.writerows(lines)
Upvotes: 68
Reputation: 29550
An alternative to the accepted answer is to:
fileinput
with inplace=True
to modify the file in-placecsv.DictReader
to access the column via header instead of indices (This only works if the CSV has headers)Test CSV:
Ip,Sites
127.0.0.1,10
127.0.0.2,23
127.0.0.3,50
Test Code:
import fileinput
with fileinput.input(files=('test.csv'), inplace=True, mode='r') as f:
reader = csv.DictReader(f)
print(",".join(reader.fieldnames)) # print back the headers
for row in reader:
if row["Ip"] == "127.0.0.2":
row["Sites"] = "30"
print(",".join([row["Ip"], row["Sites"]]))
The main difference is that you don't have to manually open the input file and create the output file, as inplace=True
already does that behind-the-scenes:
Optional in-place filtering: if the keyword argument
inplace=True
is passed tofileinput.input()
or to theFileInput
constructor, the file is moved to a backup file and standard output is directed to the input file (if a file of the same name as the backup file already exists, it will be replaced silently). This makes it possible to write a filter that rewrites its input file in place.
The loop goes over the CSV row-by-row (except for the header row), so you can do whatever processing you need on each row.
If you still want to retain the original, you could pass in a backup=".backup"
so that fileinput
creates a test.csv.backup file.
Also, note that with in-place editing, "standard output is directed to the input file", so print(..)
prints it out to the file instead of to the command line. If you want to actually print to the console, you need to specify stderr
as in print(..., file=sys.stderr)
.
Upvotes: 8
Reputation: 20936
You can use very powerful library called pandas. Here is the example.
import pandas as pd
df = pd.read_csv("test.csv")
df.head(3) #prints 3 heading rows
Output:
Ip Sites
0 127.0.0.1 10
1 127.0.0.2 23
2 127.0.0.3 50
Now if you want to change the value in the 'Sites' column in the 1st row, run:
df.set_value(1, "Sites", 30)
If you want to change all the values, where 'Ip' is equal to 127.0.0.2, run:
df.loc[df["Ip"]=="127.0.0.2", "Sites"] = 30
Finally, to save the values:
df.to_csv("test.csv", index=False)
Upvotes: 27
Reputation: 70314
You can't really replace values in the existing file. Instead, you need to:
What you can also do is read in the existing file line by line, writing it out to a new file, while replacing values on the fly. When done, close both files, delete the original and rename the new file.
Upvotes: 18