Praveen Kumar
Reputation: 362
aws ruby sdk - read a pretty large file from S3
I am trying to read around 1.5GB size from s3 using ruby sdk for aws. S3 gem is - gem 'aws-sdk' ( https://github.com/aws/aws-sdk-ruby )
most_recent_s3_object = s3_resource.bucket(bucket_name).objects.max_by(&:last_modified)
Here most_recent_s3_object class is Aws::S3::ObjectSummary
When I do most_recent_s3_object.get I get broken pipe error.
Is there a way around to get this file in a whole for this size?
Upvotes: 0
Views: 230
Answers (0)
Related Questions
- Stream a large file line by line from S3
- How to download the content of a file from S3 bucket into memory with Ruby
- How to read file from s3?
- Read CSV file uploaded in S3 amazon
- Upload large file to S3 from direct url aws-sdk in Ruby on Rails
- Reading a large file from S3 bucket
- Sax parsing a large file from S3
- Read Massive CSV File From S3
- Uploading Large File to S3 with Ruby Fails with Out of Memory Error, How to Read and Upload in Chunks?
- How can I download a large file from Amazon S3 through my Rails server, progressively