CODEWITHSUNDEEP
python-3.xamazon-web-servicesamazon-s3aws-lambda
gözde yıldız
gözde yıldız

Reputation: 7

How to upload downloaded file to s3 bucket using Lambda function

I saw different questions/answers but I could not find the one that worked for me. Hence, I am really new to AWS, I need your help. I am trying to download gzip file and load it to the json file then upload it to the S3 bucket using Lambda function. I wrote the code to download the file and convert it to json but having problem while uploading it to the s3 bucket. Assume that file is ready as x.json. What should I do then?

I know it is really basic question but still help needed :)

Upvotes: 0

Views: 6603

Answers (2)

John Rotenstein
John Rotenstein

Reputation: 270224

This code will upload to Amazon S3:

import boto3

s3_client = boto3.client('s3', region_name='us-west-2')  # Change as appropriate
s3._client.upload_file('/tmp/foo.json', 'my-bucket', 'folder/foo.json')

Some tips:

  • In Lambda functions you can only write to /tmp/
  • There is a limit of 512MB
  • At the end of your function, delete the files (zip, json, etc) because the container can be reused and you don't want to run out of disk space

Upvotes: 4

Lamanus
Lamanus

Reputation: 13581

If your lambda has proper permission to write a file into S3, then simply use boto3 package which is an AWS SDK for python.

https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/s3.html

Be aware that if the lambda locates inside of VPC then lambda cannot access to the public internet, and also boto3 API endpoint. Thus, you may require a NAT gateway to proxy lambda to the public.

Upvotes: 0

Related Questions