CODEWITHSUNDEEP
pythonpython-2.7gzip
Darkdeamon
Darkdeamon

Reputation: 2079

How to unzip gz file using Python

I need to extract a gz file that I have downloaded from an FTP site to a local Windows file server. I have the variables set for the local path of the file, and I know it can be used by GZIP muddle.

How can I do this? The file inside the GZ file is an XML file.

Upvotes: 194

Views: 329753

Answers (9)

heinst
heinst

Reputation: 8786

From the documentation:

import gzip
with gzip.open('file.txt.gz', 'rb') as f:
    file_content = f.read()

Upvotes: 69

secsilm
secsilm

Reputation: 410

You can use gzip.decompress() to do it:

  1. read input file using rb mode;
  2. open output file using w mode and utf8 encoding;
  3. gzip.decompress() input bytes;
  4. decode what you get to str.
  5. write str to output file.
def decompress(infile, tofile):
    with open(infile, 'rb') as inf, open(tofile, 'w', encoding='utf8') as tof:
        decom_str = gzip.decompress(inf.read()).decode('utf-8')
        tof.write(decom_str)

Upvotes: 6

mgb
mgb

Reputation: 119

If you have the gzip (and gunzip) programs installed on your computer a simple way is to call that command from python:

import os
filename = 'file.txt.gz'
os.system('gunzip ' + filename)

optionally, if you want to preserve the original file, use

os.system('gunzip --keep ' + filename)

Upvotes: 3

SURIYA PRAKASH
SURIYA PRAKASH

Reputation: 39

It is very simple.. Here you go !!

import gzip

#path_to_file_to_be_extracted

ip = sample.gzip

#output file to be filled

op = open("output_file","w") 

with gzip.open(ip,"rb") as ip_byte:
    op.write(ip_byte.read().decode("utf-8")
    wf.close()

Upvotes: 4

Pedro J. Sola
Pedro J. Sola

Reputation: 121

If you are parsing the file after unzipping it, don't forget to use decode() method, is necessary when you open a file as binary.

import gzip
with gzip.open(file.gz, 'rb') as f:
    for line in f:
        print(line.decode().strip())

Upvotes: 9

whs2k
whs2k

Reputation: 771

Not an exact answer because you're using xml data and there is currently no pd.read_xml() function (as of v0.23.4), but pandas (starting with v0.21.0) can uncompress the file for you! Thanks Wes!

import pandas as pd
import os
fn = '../data/file_to_load.json.gz'
print(os.path.isfile(fn))
df = pd.read_json(fn, lines=True, compression='gzip')
df.tail()

Upvotes: 9

perfecto25
perfecto25

Reputation: 842

from sh import gunzip

gunzip('/tmp/file1.gz')

Upvotes: 12

Feiyang.Chen
Feiyang.Chen

Reputation: 485

Maybe you want pass it to pandas also.

with gzip.open('features_train.csv.gz') as f:

    features_train = pd.read_csv(f)

features_train.head()

Upvotes: 28

Matt
Matt

Reputation: 3103

import gzip
import shutil
with gzip.open('file.txt.gz', 'rb') as f_in:
    with open('file.txt', 'wb') as f_out:
        shutil.copyfileobj(f_in, f_out)

Upvotes: 297

Related Questions