coreutils
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Determination of file lists from selected folders without returning


From: Bernhard Voelker
Subject: Re: Determination of file lists from selected folders without returning directory names
Date: Tue, 18 Jul 2017 21:23:45 +0200
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.6.0

On 07/18/2017 05:37 PM, SF Markus Elfring wrote:
> Are there other programs (besides the tool “find”) which support
> such a data processing style?

Sorry you lost me.  What are we talking about?

This discussion mentions constructs with globbing *.txt and passing
their basenames as parameter to another script ... while worrying
about the performance of stripping off the directories part of each
item.

When globbing in such shell, you easily hit the maximum command line
length of the shell, here:

  $ xargs -r --show-limits </dev/null 2>&1 | grep '^Maximum .* actually use:'
  Maximum length of command we could actually use: 2089058

Furthermore, many file systems do not scale very
well with several hundred thousand of files inside a directory.

So how many files do you have: thousands, millions?
And if the files are furtherly processed by an external script, why should
a simple `basename` or ${name##*/} hurt the performance?

AFAICS your best bet is still based on find(1).

Have a nice day,
Berny



reply via email to

[Prev in Thread] Current Thread [Next in Thread]