Reputation:
I have a monthly activity where i get hundreds of PDF files in a folder and i need to transfer those to an AWS server . Currently i do this activity manually . But i need to automate this process of transfer of all pdf files form my local folder to a specific folder in AWS . Also this process takes a lot of time ( approx 5 hours for 500 pdf files) . Is there a way to spped up the process?
Upvotes: 0
Views: 128
Reputation: 5729
While doing the copy from local
to AWS
you must be using some tool like winSCP
or any SSH client, so you could automate the same using the script.
scp [-r] /you/pdf/dir youruser@aswhost:/home/user/path/
If you want to do it with speed, you could run multiple scp
command
in parallel of multiple terminal and may split files
while creating to some logical grouped directories.
Upvotes: 1
Reputation: 1264
You can zip the files and transfer them. After transfer unzip the files. Or else write a program which iterates over all files in your folder and uploads files to s3 using S3 api methods.
Upvotes: 0