[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Bug-wget] HTTP URL syntax question
From: |
Smith, Peter M. (GSFC-6102) |
Subject: |
[Bug-wget] HTTP URL syntax question |
Date: |
Thu, 2 Dec 2010 16:11:24 -0600 |
Hi,
I am using wget to download some science data files. I am using the option of
having a text file contain the list of the URLs.
The URL contains a filename but also parameter and geographic region
information. When I perform the download operation the filename constructed
for the output file contains this extra information as part of the output
filename. On my MS Windows XP system the download step fails. On my linux
system the job completes correctly but the output filenames, as noted above,
contain the sub-setting information.
My text file (file1) of URLs contains lines such as...
http://goldsmr2.sci.gsfc.nasa.gov/opendap/MERRA/MAT1NXFLX.5.2.0/2010/01/MERRA300.prod.assim.tavg1_2d_flx_Nx.20100101.hdf?EOSGRID.Data%20Fields.TAUGWX[0:1:23][0:1:360][0:1:539],EOSGRID.Data%20Fields.PBLH[0:1:23][0:1:360][0:1:539],EOSGRID.Data%20Fields.DISPH[0:1:23][0:1:360][0:1:539]
I am running wget from the command terminal window
wget -i file1
I can override the output filename by ..
wget -i file1 -o file-output
but this is only workable for a text file containing one URL
Is there a way of overriding the output file name and still use a file
containing multiple URLs other than writing a perl script to process each line
of the text file.
Perhaps --content-disposition and use the header file CGI option to set the
output file names?
Thank you
Peter M. Smith
[Prev in Thread] |
Current Thread |
[Next in Thread] |
- [Bug-wget] HTTP URL syntax question,
Smith, Peter M. (GSFC-6102) <=