[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: fail to download big files correctly
|
From: |
Michael D. Setzer II |
|
Subject: |
Re: fail to download big files correctly |
|
Date: |
Fri, 17 Nov 2023 00:48:44 +1000 |
On 16 Nov 2023 at 13:45, grafgrimm77@gmx.de wrote:
Date sent: Thu, 16 Nov 2023 13:45:42 +0100
From: grafgrimm77@gmx.de
To: bug-wget@gnu.org
Subject: fail to download big files correctly
> Dear wget developers,
>
> I use "GNU Wget 1.21.4" and I have problems to download big files with
> wget. Unsure, what "big" exactly means.
>
> For example I download firefox-source, noto-font, linux-firmware and
> get checksum failures when using wget. These files are 340 MB to 1 GB.
>
> size in bytes:
> 356057052 linux-firmware-20231111.tar.xz
> 524717896 firefox-119.0.1.source.tar.xz
> 1062488324 noto-20231031.tar.gz
>
> Download is okay when using a web browser or curl.
>
> So my weak guess is that wget can not handle big file downloads.
> When I use wget several times to get the file, i always get another
> checksum after download finished with wget.
>
> No problems when downloading small files. Unsure, what "small" exactly
> means.
Not sure on windows version, but tested downloading a
2099451904 Fedora-Workstation-Live-x86_64-38-1.6.iso
using linux wget and wget2 programs.
Both downloaded files on my local 1G network and both times files
matched 100% with a binary compare. Downloaded Compared
deleted fie and repeated. Got about 90MB download speed.
Do know the wget2 had an issue with multi-threading with the 2.0
version, but the 2.1 version seems to handle up to 10 threads
without issues.
Only time I've used it with large files, and only locally with my
local machines. Only have a 50Mb download and 3Mb upload, so
not wanting to test.
There is a windows build with the 2.1 version
https://gitlab.com/gnuwget/wget2/-/releases
Has 64 bit version for windows.
>
> Greetings
> Graf Grimm
>
+------------------------------------------------------------+
Michael D. Setzer II - Computer Science Instructor (Retired)
mailto:mikes@guam.net
mailto:msetzerii@gmail.com
Guam - Where America's Day Begins
G4L Disk Imaging Project maintainer
http://sourceforge.net/projects/g4l/
+------------------------------------------------------------+