|Subject:||[Bug-wget] Development Ideas - Request 2 New Features|
|Date:||Thu, 13 Nov 2008 09:28:35 +0800|
Development Ideas - Request 2 New Features
Hi, I really think the following two features are very useful, and based the
current function of WGet, they are not too difficult to implement. It will be
a pleasant thing if they can be implemented in the new release of WGet.
Allow user to download the specific part (from lower_offset to upper_offset)
of a file, and save that part to a separate file.
When a huge file is downloaded, we can split it into several parts which can
be downloaded concurrently by running multiple instances of WGet at the same
time, in order to save time.
Suppose that: A huge file example.rar (for example 2,000,000,000 bytes) will
be downloaded from http://host/example.rar. We can concurrently run 4
instances of WGet as follows:
wget --download-length=0,500000000 http://host/example.rar
wget --download-length=500000000,500000000 http://host/example.rar
wget --download-length=1000000000,500000000 http://host/example.rar
wget --download-length=1500000000,500000000 http://host/example.rar
The above 4 parts should be automatically saved as example(0..499999999).rar,
example(500000000..999999999).rar, example(1000000000..1499999999).rar and
After all the four parts are downloaded, we can merge then into a single 2 GB
Allow user to download the specific part(from lower_offset to upper_offset)
of a file, and automatically replace the corresponding part of the local file
with the same name.
When a huge achieve file has been downloaded, but unfortunately it is corrupted
for some reason. Since the file is very huge, redownloading it is a great
waste of time. Usually by some means (for example through the TEST function
of some achieve program), we can approximately know which small part of the
huge achieve file contains erroneous data, and we only want to download and
replace that corrupt part.
Suppose that: A huge file example.rar (for example 2,000,000,000 Bytes) has
been downloaded, but unfortunately it is corrupted for some reason. Through
the TEST function of WinRAR, we can infer only the data after the 98% exists
error, we only want to redownload and replace the 98%~100% part of the file
example.rar. we can run WGet as follows:
wget --replace-range=1940000000,- http://host/example.rar
wget --replace-range=97%,- http://host/example.rar
Note: here '-' represent the end of the file.
Development Ideas - Request 2 New Features.TXT
Description: Text document
|[Prev in Thread]||Current Thread||[Next in Thread]|