Re: dd does not handle input from pipes correctly (coreutils-5.93)

[Pádraig Brady]

Eric Blake wrote:

> According to James Youngman on 11/18/2005 1:28 AM:
>
> >Many systems now include the 'buffer' program (I have it here on an
> >Ubuntu box).  If you have it, try piping the data through 'buffer -z
> >4096' (or whatever PIPE_BUF is on your machine if it's not 4096).
>
>
> Is it worth adding buffer as one of the coreutils?

I would say yes. Note debian's buffer uses
2 processes and shared mem:
http://packages.qa.debian.org/b/buffer.html

You could also use select in 1 thread:
http://www.glines.org/software/buffer.html

Or 2 threads:
http://www.rcs.ei.tum.de/~maierkom/privat/software/mbuffer/

I've used all these many times [1],
generally when transferring over a network.
For e.g: tcpdump -w- | gzip | bfr | ssh address@hidden "dd of=eth0.pcap.gz"

Pádraig.

1 http://www.linux.ie/lists/old-list/5709index.html