Re: [Bug-wget] wget tries to download already fully-downloaded files (FTP)

[Mark]

Hi,

On Tue, October 2, 2012 20:52, Ángel González wrote:
> Not happening here (wget 1.14):

I just confirmed I'm seeing the problem with wget 1.14. Here are the two
test run command lines I used:

(first run to initially download files)
~/wget -x -S --no-clobber --no-parent --recursive --level=inf --debug
--no-remove-listing --append-output=wget_log1.txt --progress=dot:mega
"ftp://ftp.microsoft.com/bussys/exchange/exchange-public/fixes/Eng/Exchg5.5/PostSP1/Store2-fix/";

(second run, using --continue instead of --no-clobber to avoid the other
bug I recently reported)
~/wget -x -S --continue --no-parent --recursive --level=inf --debug
--no-remove-listing --append-output=wget_log2.txt --progress=dot:mega
"ftp://ftp.microsoft.com/bussys/exchange/exchange-public/fixes/Eng/Exchg5.5/PostSP1/Store2-fix/";

Here's the first part of wget_log2.txt, showing wget trying to download
the fully-downloaded file. (Sorry for the length.)

DEBUG output created by Wget 1.14 on linux-gnu.

Using
‘ftp.microsoft.com/bussys/exchange/exchange-public/fixes/Eng/Exchg5.5/PostSP1/Store2-fix/.listing’
as listing tmp file.
--2012-10-03 12:08:01-- 
ftp://ftp.microsoft.com/bussys/exchange/exchange-public/fixes/Eng/Exchg5.5/PostSP1/Store2-fix/
           =>
‘ftp.microsoft.com/bussys/exchange/exchange-public/fixes/Eng/Exchg5.5/PostSP1/Store2-fix/.listing’
Resolving ftp.microsoft.com... 64.4.30.34
Caching ftp.microsoft.com => 64.4.30.34
Connecting to ftp.microsoft.com|64.4.30.34|:21... connected.
Created socket 4.
Releasing 0x00000000018ba490 (new refcount 1).
Logging in as anonymous ...
220 Microsoft FTP Service
--> USER anonymous

331 Anonymous access allowed, send identity (e-mail name) as password.
--> PASS Turtle Power!

230-Welcome to FTP.MICROSOFT.COM. Also visit
http://www.microsoft.com/downloads.
230 User logged in.
--> SYST

215 Windows_NT
--> PWD

257 "/" is current directory.
--> TYPE I

200 Type set to I.
changing working directory
Prepended initial PWD to relative path:
   pwd: '/'
   old:
'bussys/exchange/exchange-public/fixes/Eng/Exchg5.5/PostSP1/Store2-fix'
  new:
'/bussys/exchange/exchange-public/fixes/Eng/Exchg5.5/PostSP1/Store2-fix'
--> CWD
/bussys/exchange/exchange-public/fixes/Eng/Exchg5.5/PostSP1/Store2-fix

250 CWD command successful.
conaddr is: 64.4.30.34
--> PASV

227 Entering Passive Mode (64,4,30,34,61,21).
trying to connect to 64.4.30.34 port 15637
Created socket 5.
--> LIST -a

150 Opening BINARY mode data connection.

     0K                                                        170K=0.002s

Closed fd 5
226 Transfer complete.
10-19-98  11:00PM              3680140 PSP1STRA.EXE
10-19-98  11:00PM              7344152 Psp1stra.exe.old
10-19-98  11:00PM              3680153 Psp1stra.exe.old2
10-19-98  11:00PM              3254911 PSP1STRI.EXE
10-19-98  11:00PM              3235080 Psp1stri.exe.old
10-19-98  11:00PM              3254924 Psp1stri.exe.old2
10-19-98  11:00PM                 6345 Readme.txt
2012-10-03 12:08:03 (170 KB/s) -
‘ftp.microsoft.com/bussys/exchange/exchange-public/fixes/Eng/Exchg5.5/PostSP1/Store2-fix/.listing’
saved [387]

Name: 'PSP1STRA.EXE'
YYYY/MM/DD HH:MM - 1998/09/19 23:00
Timestamp: 908834400
File, size 3680140 bytes
Name: 'Psp1stra.exe.old'
YYYY/MM/DD HH:MM - 1998/09/19 23:00
Timestamp: 908834400
File, size 7344152 bytes
Name: 'Psp1stra.exe.old2'
YYYY/MM/DD HH:MM - 1998/09/19 23:00
Timestamp: 908834400
File, size 3680153 bytes
Name: 'PSP1STRI.EXE'
YYYY/MM/DD HH:MM - 1998/09/19 23:00
Timestamp: 908834400
File, size 3254911 bytes
Name: 'Psp1stri.exe.old'
YYYY/MM/DD HH:MM - 1998/09/19 23:00
Timestamp: 908834400
File, size 3235080 bytes
Name: 'Psp1stri.exe.old2'
YYYY/MM/DD HH:MM - 1998/09/19 23:00
Timestamp: 908834400
File, size 3254924 bytes
Name: 'Readme.txt'
YYYY/MM/DD HH:MM - 1998/09/19 23:00
Timestamp: 908834400
File, size 6345 bytes
--2012-10-03 12:08:03-- 
ftp://ftp.microsoft.com/bussys/exchange/exchange-public/fixes/Eng/Exchg5.5/PostSP1/Store2-fix/PSP1STRA.EXE
           =>
‘ftp.microsoft.com/bussys/exchange/exchange-public/fixes/Eng/Exchg5.5/PostSP1/Store2-fix/PSP1STRA.EXE’
==> CWD not required.
conaddr is: 64.4.30.34
--> PASV

227 Entering Passive Mode (64,4,30,34,52,90).
trying to connect to 64.4.30.34 port 13402
Created socket 5.
--> REST 3680140

350 Restarting at 3680140.
--> RETR PSP1STRA.EXE

125 Data connection already open; Transfer starting.
Length: 3680140 (3.5M), 0 remaining

        [ skipping 3072K ]
  3072K ,,,,,,,,                                             100% 0.00 =0s

Closed fd 5
226 Transfer complete.



-- Mark