[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Another rfe: "cp" this time
From: |
Bruce Korb |
Subject: |
Re: Another rfe: "cp" this time |
Date: |
Fri, 27 Apr 2012 10:22:42 -0700 |
Oh, just to be clear:
2012/4/27 Pádraig Brady <address@hidden>:
> Your suggestion of parallelizing the reads on the local
> host might help, especially when the processing of each
> block takes time. I.E. it would be more beneficial for
> gzip than for cp. You could get much the equivalent parallelization
> for cp by using tar to continuously read and buffer like:
>
> tar -c /cifs/ | (cd dest && tar -xp)
>
> This would be better for the local system,
> as you would have a single process writing to
> the dest, rather than multiple writers competing
> for that resource.
>
> Note the latency/throughput of the above, is dictated by
> the pipe buffer in the kernel which is 1M on my system
> (/proc/sys/fs/pipe-max-size).
The source is one .iso file. Local fs contention is not an issue, since
I am sure whatever throughput I manage to attain, it won't approach
the capacity of a local disk drive. Finally, if the resulting file winds up
with a scattered allocation, I can always clean that up with a local
copy. Copying a 4GB file locally takes no time at all -- by comparison.
My goal is to try to fill the pipe with CIFS data.
- Another rfe: "cp" this time, Bruce Korb, 2012/04/27
- Re: Another rfe: "cp" this time, Pádraig Brady, 2012/04/27
- Re: Another rfe: "cp" this time, Bruce Korb, 2012/04/27
- Re: Another rfe: "cp" this time, Pádraig Brady, 2012/04/27
- Re: Another rfe: "cp" this time, Bruce Korb, 2012/04/27
- Re: Another rfe: "cp" this time, Pádraig Brady, 2012/04/27
- Re: Another rfe: "cp" this time, Bruce Korb, 2012/04/27
- Re: Another rfe: "cp" this time, Bruce Korb, 2012/04/27
- Re: Another rfe: "cp" this time, Bruce Korb, 2012/04/30
Re: Another rfe: "cp" this time,
Bruce Korb <=
Re: Another rfe: "cp" this time, Andreas Schwab, 2012/04/27