CODEWITHSUNDEEP
pythonpandascsvnumpydata-manipulation
Ali Arbab
Ali Arbab

Reputation: 1

Deleting rows from several CSV files using Python

I wanted to delete specific rows from every single csv. files in my directory (i.e. from row 0 to 33), but I have 224 separate csv. files which need to be done. I would be happy if you help me how can I use one code to carry out this.

Upvotes: 0

Views: 1520

Answers (3)

mohd4482
mohd4482

Reputation: 1918

Iterate over CSV files and use Pandas to remove the top 34 rows of each file then save it to an output directory.

Try this code after installing pandas:

from pathlib import Path
import pandas as pd

source_dir = Path('path/to/source/directory')
output_dir = Path('path/to/output/directory')

for file in source_dir.glob('*.csv'):
    df = pd.read_csv(file)
    df.drop(df.head(34).index, inplace=True)
    df.to_csv(output_dir.joinpath(file.name), index=False)

Upvotes: 0

Umar.H
Umar.H

Reputation: 23099

I think you can use glob and pandas to do this quite easily, I'm not sure if you want to write over your original files something I never recommend, so be careful as this code will do that. 

import os
import glob
import pandas as pd

os.chdir(r'yourdir')
allFiles = glob.glob("*.csv") # match your csvs
for file in allFiles:
   df = pd.read_csv(file)
   df = df.iloc[33:,] # read from row 34 onwards.
   df.to_csv(file)
   print(f"{file} has removed rows 0-33")

or something along those lines..

Upvotes: 2

josh waxman
josh waxman

Reputation: 211

This is a simple combination of two separate tasks.

First, you need to loop through all the csv files in a folder. See this StackOverflow answer for how to do that.

Next, within that loop, for each file, you need to modify the csv by removing rows. See this answer for how to read a csv, write a csv, and omit certain rows based on a condition.

One final aspect is that you want to omit certain line numbers. A good way to do this is with the enumerate function.

So code such as this will give you the line numbers.

import csv
input = open('first.csv', 'r')
output = open('first_edit.csv', 'w')
writer = csv.writer(output)
for i, row in enumerate(input):
    if i > 33:
        writer.writerow(row)
input.close()
output.close()

Upvotes: 0

Related Questions