[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Bug-wget] [bug #44817] http/gzip compression

From: Ander Juaristi
Subject: [Bug-wget] [bug #44817] http/gzip compression
Date: Mon, 13 Apr 2015 12:11:15 +0000
User-agent: Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:37.0) Gecko/20100101 Firefox/37.0

Follow-up Comment #1, bug #44817 (project wget):

For me, the best place to decompress the response body would be at
fd_read_body(), just after the call to fd_read(). Let fd_read() return, and
uncompress the read bytes. Also, we should consider whether the data will be
written to warc compressed or uncompressed. In the latter, we should discuss
how to handle fd_read_line(), since it expects to encounter a line separator.

We could add an extra command line switch to let the user decide the supported
compression algorithms.

Finally, the best way to implement this would be using zlib, since it supports
the two most used compression algorithms on the web: gzip and deflate. Don't
forget to update the dependency list for bootstrap/autoconf.


Reply to this item at:


  Message sent via/by Savannah

reply via email to

[Prev in Thread] Current Thread [Next in Thread]