CODEWITHSUNDEEP
pythongoogle-cloud-platformgoogle-cloud-storagegsutil
david
david

Reputation: 1265

how do I download multiple files using gsutil?

I am trying to download multiple files from UGC YouTube dataset. for this I installed Google Cloud SDK and used this command in Google Cloud SDK shell:

gsutil -m cp \
  "gs://ugc-dataset/original_videos/Animation/1080P/Animation_1080P-05f8.mkv" \
  "gs://ugc-dataset/original_videos/Animation/1080P/Animation_1080P-0c4f.mkv" \
  "gs://ugc-dataset/original_videos/Animation/1080P/Animation_1080P-18f5.mkv" \
  "gs://ugc-dataset/original_videos/Animation/1080P/Animation_1080P-209f.mkv" \
  "gs://ugc-dataset/original_videos/Animation/1080P/Animation_1080P-21dd.mkv" \
  "gs://ugc-dataset/original_videos/Animation/1080P/Animation_1080P-2fbe.mkv" \
  "gs://ugc-dataset/original_videos/Animation/1080P/Animation_1080P-2fff.mkv" \
  "gs://ugc-dataset/original_videos/Animation/1080P/Animation_1080P-3d67.mkv" \
  "gs://ugc-dataset/original_videos/Animation/1080P/Animation_1080P-3dbf.mkv" \
  "gs://ugc-dataset/original_videos/Animation/1080P/Animation_1080P-3e01.mkv" \
  "gs://ugc-dataset/original_videos/Animation/1080P/Animation_1080P-4214.mkv" \
  "gs://ugc-dataset/original_videos/Animation/1080P/Animation_1080P-4be3.mkv" \
  "gs://ugc-dataset/original_videos/Animation/1080P/Animation_1080P-4ea8.mkv" \
  "gs://ugc-dataset/original_videos/Animation/1080P/Animation_1080P-5083.mkv" \
  "gs://ugc-dataset/original_videos/Animation/1080P/Animation_1080P-58d3.mkv" \
  "gs://ugc-dataset/original_videos/Animation/1080P/Animation_1080P-5dd8.mkv" \
  "gs://ugc-dataset/original_videos/Animation/1080P/Animation_1080P-646f.mkv" \
  .

but when I entered the above command in the shell it produced this error:

The filename, directory name, or volume label syntax is incorrect.

but when I just try to download one file it works:

gsutil -m cp -r gs://ugc-dataset/original_videos/Animation/1080P/Animation_1080P-05f8.mkv "E:/UGC/Animation/output8mb"

what should I do to download multiple files?

Upvotes: 0

Views: 424

Answers (1)

Mazlum Tosun
Mazlum Tosun

Reputation: 6572

gsutil command can be used with glob style pattern to copy several files :

gsutil -m cp -r "gs://ugc-dataset/original_videos/Animation/1080P/Animation_*.mkv" \
  .

Upvotes: 1

Related Questions