Does --line-buffer affects performance penalty mentioned in https://lists.gnu.org/archive/html/parallel/2017-06/msg00009.html ?
> Dnia 22 sierpień 2017 o 00:28 Ole Tange <tange@gnu.org> napisał(a): > > > GNU Parallel 20170822 ('Barcelona') has been released. It is available > for download at: http://ftpmirror.gnu.org/parallel/ > > Haiku of the month: > > --line-buffer > touches files on disk no more > faster than before > -- Ole Tange > > New in this release: > > * --line-buffer no longer uses tempfiles. This is faster and makes it > possible for a single process to output more data than there is free > disk space. > > * Vote for GNU Parallel's community ads on > http://meta.unix.stackexchange.com/a/4356/2972 > http://meta.askubuntu.com/a/16750/22307 > http://meta.serverfault.com/a/9040/45704 > > * GNU Parallel was cited in: > https://springerplus.springeropen.com/articles/10.1186/s40064-016-2022-y > > * Edit images with GNU Parallel and ImageMagick > https://fedoramagazine.org/edit-images-parallel-imagemagick/ > > * Running Bash Commands in Parallel > https://dzone.com/articles/running-bash-commands-in-parallel-1 > > * Today I Learned: GNU parallel, plate tectonics > https://medium.com/@nornagon/today-i-learned-gnu-parallel-plate-tectonics-9fcf24045e63 > > * GNU Parallel Tutorial https://www.upf.edu/web/sct-sit/gnu-parallel-tutorial > > * Validating half a million TIFF files > http://www.dpoc.ac.uk/2017/08/17/validating-half-a-million-tiff-files-part-two/ > > * Blender and GNU Parallel > https://www.blendernation.com/2017/08/16/blender-gnu-parallel/ > > * Quick Introduction to GNU Parallel > https://github.com/LangilleLab/microbiome_helper/wiki/Quick-Introduction-to-GNU-Parallel > > * A simple distributed animation render example using GNU Parallel > https://gitlab.com/skororu/scripts > > * Do stuff on things, in parallel > http://blogs.fluidinfo.com/terry/2017/08/05/do-stuff-on-things-in-parallel/ > > * Bash And GNU Parallel NGS Bidniz > http://ino.pm/outreach/presentations/2014/03/genomics-wranglers/index.html > > * Using for loop vs Gnu parallel for BLAST > http://www.ettemalab.org/using-for-loop-vs-gnu-parallel-for-blast/ > > * 并行rsync https://gxnotes.com/article/175866.html > > * Bug fixes and man page updates. > > GNU Parallel - For people who live life in the parallel lane. > > > = About GNU Parallel = > > GNU Parallel is a shell tool for executing jobs in parallel using one > or more computers. A job can be a single command or a small script > that has to be run for each of the lines in the input. The typical > input is a list of files, a list of hosts, a list of users, a list of > URLs, or a list of tables. A job can also be a command that reads from > a pipe. GNU Parallel can then split the input and pipe it into > commands in parallel. > > If you use xargs and tee today you will find GNU Parallel very easy to > use as GNU Parallel is written to have the same options as xargs. If > you write loops in shell, you will find GNU Parallel may be able to > replace most of the loops and make them run faster by running several > jobs in parallel. GNU Parallel can even replace nested loops. > > GNU Parallel makes sure output from the commands is the same output as > you would get had you run the commands sequentially. This makes it > possible to use output from GNU Parallel as input for other programs. > > You can find more about GNU Parallel at: http://www.gnu.org/s/parallel/ > > You can install GNU Parallel in just 10 seconds with: (wget -O - > pi.dk/3 || curl pi.dk/3/) | bash > > Watch the intro video on http://www.youtube.com/playlist?list=PL284C9FF2488BC6D1 > > Walk through the tutorial (man parallel_tutorial). Your commandline > will love you for it. > > When using programs that use GNU Parallel to process data for > publication please cite: > > O. Tange (2011): GNU Parallel - The Command-Line Power Tool, ;login: > The USENIX Magazine, February 2011:42-47. > > If you like GNU Parallel: > > * Give a demo at your local user group/team/colleagues > * Post the intro videos on Reddit/Diaspora*/forums/blogs/ > Identi.ca/Google+/Twitter/Facebook/Linkedin/mailing lists > * Get the merchandise https://www.gnu.org/s/parallel/merchandise.html > * Request or write a review for your favourite blog or magazine > * Request or build a package for your favourite distribution (if it is > not already there) > * Invite me for your next conference > > If you use programs that use GNU Parallel for research: > > * Please cite GNU Parallel in you publications (use --citation) > > If GNU Parallel saves you money: > > * (Have your company) donate to FSF https://my.fsf.org/donate/ > > > = About GNU SQL = > > GNU sql aims to give a simple, unified interface for accessing > databases through all the different databases' command line clients. > So far the focus has been on giving a common way to specify login > information (protocol, username, password, hostname, and port number), > size (database and table size), and running queries. > > The database is addressed using a DBURL. If commands are left out you > will get that database's interactive shell. > > When using GNU SQL for a publication please cite: > > O. Tange (2011): GNU SQL - A Command Line Tool for Accessing Different > Databases Using DBURLs, ;login: The USENIX Magazine, April 2011:29-32. > > > = About GNU Niceload = > > GNU niceload slows down a program when the computer load average (or > other system activity) is above a certain limit. When the limit is > reached the program will be suspended for some time. If the limit is a > soft limit the program will be allowed to run for short amounts of > time before being suspended again. If the limit is a hard limit the > program will only be allowed to run when the system is below the > limit. >