[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[bug #60246] When writing stdout into a pipe, wget never terminates

From: Darshit Shah
Subject: [bug #60246] When writing stdout into a pipe, wget never terminates
Date: Mon, 11 Oct 2021 16:39:44 -0400 (EDT)
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:93.0) Gecko/20100101 Firefox/93.0

Update of bug #60246 (project wget):

                Severity:              3 - Normal => 4 - Important          
                  Status:               Confirmed => In Progress            
             Assigned to:                    None => darnir                 


Follow-up Comment #2:

Okay, this is a crazy issue, and I'm surprised no one has reported it in so
many years! I think this issue has likely existed for 15 years if not more.

The problem is simple:
We pass the file descriptor of the file to which the downloaded document is
saved in order to parse it for any links. So, when you combine -p with -O-,
what you get is that Wget waits indefinitely on a read() call on stdout. Which
will _NEVER_ return anything.

In order to handle -p and -O properly, I think we should download to a
temporary file before parsing and then append it to the output file. This is
especially important when using -O-. When writing to a real file, we could
probably optimize the process by writing directly to the file and then calling
fseek() to only process the newly downloaded part of the file.

I would wager this is also an issue with -r -O-. 


Reply to this item at:


  Message sent via Savannah

reply via email to

[Prev in Thread] Current Thread [Next in Thread]