[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Bug-wget] Using wget command to download from dynamic urls
From: |
Pratap Kumar Das |
Subject: |
Re: [Bug-wget] Using wget command to download from dynamic urls |
Date: |
Sun, 26 Jul 2009 13:28:50 +0530 |
Hi Tony,
Thanks for the= suggestion.
Well...the problem you mentioned was the first problem and now with the
suggested step I am able to surpass that by using -O command.
But still it doesn't download = the desired files. This is tested also on a
machine with normal linux parti= tion.
I am attaching the commands,logs a= nd the downloaded files.
-bash-3.00$ wget -O ieee_paper.pdf
"[1]http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&
amp;arnumber=5173739&isnumber=5173690"
--12:55:10-- [2]http://ie
eexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=5173739&isnumber =5173690
=> `ieee_paper.pdf'
Resolving iiscproxy1.serc.iisc.ernet.in... 10.16.40.12, 10.16.40.13, 10.16.
25.35, ...
Connecting to [3]iiscproxy1.serc.iisc.ernet.in|10.16.40.12|:3128...
connected.
Proxy request sent, awaiting response... 302 Moved Temporarily
Location: [4]http://ieeexplo
re.ieee.org/stamp/stamp.jsp?tp=&arnumber=5173739&isnumber=517690
[following]
--12:55:11-- [5]htt
p://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=5173739&is number=5173690
=> `ieee_paper.pdf'
Connecting t= o [6]iiscp= roxy1.serc.iisc.ernet.in|10.16.40.12|:3128...
connected.
Proxy request sent, awaiting response... 200 OK
Length: 612 [text/html]
100%[============= ========================= =================>]612
--.--K/s
12:55:= 12 (64.85 MB/s) - `ieee_paper.pdf' saved [612/612]
-bash-3.00$ du -h ie= ee_paper.pdf
4.0K ieee_paper.pdf
The ieee_paper.pdf is expected to be some MBs and = a valid pdf file...where
as the downloaded one is a normal text file. [3D"cid:33D@goomoji.gmail"]
-bash-3.00$ wget -O fi= refox.log "[7]http
://www.mozilla.com/products/download.html?product=firefox-3.5.1&os=
win&lang=en-US"
--13:02:19-- [8]http
://www.mozilla.com/products/download.html?product=firefox-3.5.1&os=
win&lang=en-US
=> `firefox.log'
Resolving iiscproxy1.serc.iisc.ernet.in... 10.16.40.11, 10.16.40.12, 10.16.
40.13, ...
Connecting to [9]iiscproxy1.serc.iisc.ernet.in|10.16.40.11|:3128...
connected.
Proxy request sent, awaiting response... 302 Moved Temporarily
Location: [10]http
://www.mozilla.com/en-US/products/download.html?product=firefox-3.5.1&
;os=win&lang=en-US [following]
--13:02:20--
[11]http://www.mozilla.com/en-US/products/download.html?product=firefox-3.
5= .1&os=win&lang=en-US
=> `firefox.exe'
Connecting to <= a href="http://iiscproxy1.serc.iisc.ernet.in/"
target="_blank">iiscprox= y1.serc.iisc.ernet.in|10.16.40.11|:3128...
connected.
Proxy request sent, awaiting response... 200 OK
Length: unspecified [text/html]
[ <=>
]33,598 41.58K/s
13:02:22 (41.55 KB/s) - `firef= ox.exe' saved [33598]
-bash-3.= 00$ du -h firefox.log
36K firefox.log
The firefox.log is expected to be some 16 MB and a valid exe file..= .where
as the downloaded one(attached) is a normal text file. =
[3D"cid:33D@goomoji.gmail"]
Is there any way to go from this and download the intended files just as d
one by using a gui browser? [3D"cid:B56@=]
I am using wget version 1.11.4
Thanks,
Pratap
On Sun, Jul 26, 2009 at 10= :37 AM, Tony Lewis <address@hidden>
wrote:
Pratap Kumar Das wrote:
> I am not being able to download the files which would be
> linked with dynamic urls (urls containing "*?*" in them whic= h is
probably
> used for redirection).
The "?" is not the problem. See these lines in the output y= ou included:
> Cannot write to `download.html?product=firefox-3.5.1&os=win&am
p;lang=en-US'
> (File name too long).
As far as I can tell, the "File name too long" error is onl= y generated
on
Windows machines so I'm assuming you're running on some version of
Windows.
For what it's worth, I am able to retrieve that file running wget in a<
br> cygwin shell running on Windows XP.
What version of wget are you using?
Tony
--
****************= **************************************
PRATAP KUMAR DAS
Research Scho= lar
VLSI Circuits and Systems Lab
Dept of Electrical Communication En= gineering
[13]I.I.Sc, Bangalore
560012
Mobile: +91944= 9974942
******************************************************
References
1. 3D"http://ieeexp=/
2. 3D"http://ieeexplore.ieee.org/stamp/stamp.jsp?tp= 3.
3D"http://iiscproxy1.serc.iisc.ernet.in=/
4. 3D"http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&a 5.
3D"http://ieeexplore.ieee.org/stamp/stamp.jsp 6.
3D"http://iiscproxy1.serc.iisc.ernet.in/"
7. 3D"http://www.mozilla.com/products/download.html?pr 8.
3D"http://www.mozilla.com/products/download.html?pr 9.
3D"http://iiscproxy1.serc.iisc.ernet.in=/
10. 3D"http://www.mozilla.com/en-US/products/download.html?pr 11.
3D"http://www.mozilla.com/en-US/products/download.h 12.
3D"mailto:address@hidden 13. 3D"http://I.I.Sc"/
ieee_paper.pdf
Description: Adobe PDF document
firefox.log
Description: Binary data