CODEWITHSUNDEEP
amazon-web-servicesamazon-s3
Karl Young
Karl Young

Reputation: 241

AWS CLI - is there a way to extract tar.gz from S3 to home without storing the tar.gz?

To elaborate,

There is a tar.gz file on my AWS S3, let's call it example.tar.gz.

So, what I want to do is download the extracted contents of example.tar.gz to /var/home/.

One way to do it is to simply download the tar.gz, extract it, then delete the tar.gz.

However, I don't want to use space downloading the tar.gz file, I just want to download the extracted version or only store the extracted version.

Is this possible?

Thanks!

Upvotes: 15

Views: 20107

Answers (3)

Luis Andrés Juárez Sandoval
Luis Andrés Juárez Sandoval

Reputation: 57

Today I tested with Python Boto 3 and aws cli and I noticed that tar.gz is extracted automatically when the file is downloaded

Upvotes: 0

mostafazh
mostafazh

Reputation: 4215

What you need is the following:

aws s3 cp s3://example-bucket/file.tar.gz - | tar -xz

This will stream the file.tar.gz from s3 and extract it directly (in-memory) to the current directory. No temporary files, no extra storage and no clean up after this one command.

Make sure you write the command exactly as above.

Upvotes: 30

Jordan Wells
Jordan Wells

Reputation: 101

There isn't currently a way you can do this with S3.

You could create the following script though and just run it whenever you wish to download the tar. Just as long as you have the IAM role / access keys setup.

!#/bin/bash
aws s3 cp s3://$1/$2 $3
tar -xvf $3
rm $3

Then just call the script using ./myScript BUCKET_NAME FILE_LOCATION OUTPUT_FILE

Upvotes: -2

Related Questions