Reputation: 139
I am trying to download a 157gb .zip
file from OneDrive (I have tried both curl
and wget
) to a machine on which I am ssh
connected. I usually run screen
, launch the download and then detach and disconnect. I have noticed that each time the download ends without error with an output of exactly 20GB, and this seems to be a limitation of OneDrive.
In fact, as you can read in this discussion:
Is there any way around this problem?
Upvotes: 1
Views: 4714
Reputation: 1
I confirm the 20GB limiitations which I could clearly see using the IDM (Internet Download Manager) application. The only quick solution solution I could find was to make enough space on a local drive and then use the Onedrive software on my windows PC to sync all data (around 100 GB). The sync as such was then surprisingly fast.
Upvotes: 0
Reputation: 36650
As first thing check if wget
do indeed see file of size 157GB under given URL, by doing
wget --spider URLTOFILE
you would get basic information about file withoud download it, filesize will be described as Length:
, then check if it does support Partial gimmick as follows
wget --server-response --spider URLTOFILE
and then check if output contain Accept-Ranges: bytes
, if yes then it might be possible to exploit Partial gimmick to get whole file, start following command
wget -c -O file.zip URLTOFILE
and then after it do get first 20GB then run it again and observe if it does download further part of your file.
Upvotes: 1