[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Using gnu-parallel with processes that have an extended startup time
|
From: |
Diaa Sami |
|
Subject: |
Using gnu-parallel with processes that have an extended startup time |
|
Date: |
Tue, 16 Jul 2013 02:18:22 +0200 |
Hi,
I'm using gnu parallel with a custom python script that processes lines, one
line in, one or more lines out, and this script happens to have a long startup
time because of the kind of processing it has to perform on the input(it has to
load a dictionary in memory first).
I was wondering if gnu parallel can just keep the processes running and just
feed them records rather than starting a process for each block.
--
Diaa Sami