Re: SQLite3 or DB Problem with Multiple Variables (gnuparallel: message 1 of 20) (gnuparallel: message 2 of 20)

[Larry Ploetz]

I may not have made it obvious that I was using the git version of parallel in the most recent tests below. Sorry.

On 3/17/20 12:33 PM, Larry Ploetz wrote:

On 3/17/20 12:21 PM, Larry Ploetz wrote:

On 3/16/20 3:34 PM, Ole Tange wrote:

On Wed, Mar 11, 2020 at 7:53 PM Larry Ploetz <lploetz@gmail.com> wrote:

On 3/11/20 11:25 AM, Larry Ploetz - lploetz@gmail.com wrote:
On 3/11/20 9:52 AM, Larry Ploetz - lploetz@gmail.com wrote:

I think this should put a V1 and V2, along with the other joblog columns and stdout/stderr, but I'm getting this error.

You have found a bug.

Try the git version:

https://git.savannah.gnu.org/cgit/parallel.git/plain/src/parallel

/Ole

Well, I tried some things with CSV and got different errors:

larryp-MBP:parallel larry$ printf '%s %s\n' {a..d} | gtee >(cat >&2) | src/parallel -C' ' --sqla csv:///%2ftmp%2ffoo.csv/bar echo /{1}/{2}/
a b
c d
parallel: Error: 
Execution ERROR: Cannot open /Users/larry/git/parallel/bar: No such file or directory (2) at /opt/local/lib/perl5/site_perl/5.30/darwin-thread-multi-2level/DBI/DBD/SqlEngine.pm line 1624.
 called from src/parallel at 12446.

 at /opt/local/lib/perl5/site_perl/5.30/darwin-thread-multi-2level/DBI/DBD/SqlEngine.pm line 1271.

larryp-MBP:parallel larry$ touch /tmp/foo.csv
larryp-MBP:parallel larry$ printf '%s %s\n' {a..d} | gtee >(cat >&2) | src/parallel -C' ' --sqla csv:///%2ftmp%2ffoo.csv/bar echo /{1}/{2}/
a b
c d
parallel: Error: 
Execution ERROR: Cannot open /Users/larry/git/parallel/bar: No such file or directory (2) at /opt/local/lib/perl5/site_perl/5.30/darwin-thread-multi-2level/DBI/DBD/SqlEngine.pm line 1624.
 called from src/parallel at 12446.

 at /opt/local/lib/perl5/site_perl/5.30/darwin-thread-multi-2level/DBI/DBD/SqlEngine.pm line 1271.

larryp-MBP:parallel larry$ rm /tmp/foo.csv
larryp-MBP:parallel larry$ mkdir /tmp/foo.csv
larryp-MBP:parallel larry$ printf '%s %s\n' {a..d} | gtee >(cat >&2) | src/parallel -C' ' --sqla csv:///%2ftmp%2ffoo.csv/bar echo /{1}/{2}/
a b
c d
parallel: Error: 
Execution ERROR: Cannot open /Users/larry/git/parallel/bar: No such file or directory (2) at /opt/local/lib/perl5/site_perl/5.30/darwin-thread-multi-2level/DBI/DBD/SqlEngine.pm line 1624.
 called from src/parallel at 12446.

 at /opt/local/lib/perl5/site_perl/5.30/darwin-thread-multi-2level/DBI/DBD/SqlEngine.pm line 1271.

larryp-MBP:parallel larry$ touch /tmp/foo.csv/bar
larryp-MBP:parallel larry$ printf '%s %s\n' {a..d} | gtee >(cat >&2) | src/parallel -C' ' --sqla csv:///%2ftmp%2ffoo.csv/bar echo /{1}/{2}/
a b
c d
parallel: Error: 
Execution ERROR: Cannot open /Users/larry/git/parallel/bar: No such file or directory (2) at /opt/local/lib/perl5/site_perl/5.30/darwin-thread-multi-2level/DBI/DBD/SqlEngine.pm line 1624.
 called from src/parallel at 12446.

 at /opt/local/lib/perl5/site_perl/5.30/darwin-thread-multi-2level/DBI/DBD/SqlEngine.pm line 1271.

larryp-MBP:parallel larry$ pwd
/Users/larry/git/parallel
larryp-MBP:parallel larry$ touch bar
larryp-MBP:parallel larry$ printf '%s %s\n' {a..d} | gtee >(cat >&2) | src/parallel -C' ' --sqla csv:///%2ftmp%2ffoo.csv/bar echo /{1}/{2}/
a b
c d
parallel: Error: 
Execution ERROR: Missing first row due to EOF - End of data in parsing input stream at /opt/local/lib/perl5/site_perl/5.30/darwin-thread-multi-2level/DBI/DBD/SqlEngine.pm line 1480.
 called from src/parallel at 12448.


larryp-MBP:parallel larry$ ls -l bar
-rw-r--r--  1 larry  staff  0 Mar 17 12:07 bar

I'm assuming it's OK to use the full DBTABLEURL (variable from the example) value on the command line.

However, with 1 variable this works, but completely disregards the directory:

larryp-MBP:parallel larry$ parallel --sqlandworker csv:///%2FBOGUS%2FBOGUS2/mytable3 seq ::: {1..10}

and just writes mytable3 in the CWD.

Thanks!
- Larry

I'm pretty sure this should work using sqlite3 instead of CSV

larryp-MBP:parallel larry$ printf '%s %s\n' {a..d} | gtee >(cat >&2) | src/parallel -C' ' --sqla sqlite3:///%2ftmp%2ffoo/mytable echo /{1}/{2}/
a b
c d
DBD::SQLite::db prepare failed: no such table: mytable [for Statement "SELECT * FROM mytable LIMIT 1;"] at src/parallel line 12445.

Thanks!
- Larry

pEpkey.asc
Description: application/pgp-keys