Copy multiple files from s3 bucket

Question

I am having trouble downloading multiple files from AWS S3 buckets to my local machine.

I have all the filenames that I want to download and I do not want others. How can I do that? Is there any kind of loop in aws-cli I can do some iteration?

There are hundreds of files I need to download so that it seems not possible to use one single command that takes all filenames as arguments.

Answer 1

You can run a bash script like this, but you will have to have all the filenames in a file like filename.txt then use it download them.

#!/bin/bash  

set -e  

while read line  

do  

  aws s3 cp s3://bucket-name/$line dest-path/  

done <filename.txt