parallel: --joblog implemented. Testsuite missing.

--spreadstdin prototype. Testsuite missing.
This commit is contained in:
Ole Tange 2011-01-18 18:15:42 +01:00
parent 6ee0aee609
commit 48454a36ea
7 changed files with 1069 additions and 933 deletions

View file

@ -1,12 +1,5 @@
max_jobs_running could be resat if -j is a changed file. parallel: --joblog implemented. Testsuite missing.
dummy children was not killed if cmd line was too long. parallel: --spreadstdin prototype. Testsuite missing.
default number of jobs for --semaphore set to 1.
test25 had race condition.
test22 -j10 added.
test13 -j9 added.
test47 remote cleanup added before test.
test17 remote cleanup added before test.
parallel: spread arguments between all jobslots when reaching EOF of input
codecoverage codecoverage

View file

@ -143,12 +143,23 @@ download at: http://ftp.gnu.org/gnu/parallel/
New in this release: New in this release:
* --joblog makes a simple log of completed jobs.
* -X now spreads arguments between job slots when reaching last
argument. Use -j1 to avoid this.
* People on the email list have voted -j+0 to be the new default
instead of -j9.
* First review in Polish. Thanks to Patryk Krawaczyński. * First review in Polish. Thanks to Patryk Krawaczyński.
http://nfsec.pl/root/2458 http://nfsec.pl/root/2458
* Review in Spanish (in print). * Review in Spanish (in print).
https://www.linux-magazine.es/issue/67/moreinfo.html https://www.linux-magazine.es/issue/67/moreinfo.html
* Review in English. Thanks to Brian Gough.
http://blogs.fsfe.org/bjg/2011/01/gnu-parallel-a-map-operator-for-the-command-line/
* Review in French. Thanks to Denis Dordoigne. * Review in French. Thanks to Denis Dordoigne.
http://linuxfr.org/2010/12/29/27715.html http://linuxfr.org/2010/12/29/27715.html

File diff suppressed because it is too large Load diff

View file

@ -390,6 +390,17 @@ specified, and for B<-I>{} otherwise. This option is deprecated;
use B<-I> instead. use B<-I> instead.
=item B<--joblog> I<logfile> (beta testing)
Logfile for executed jobs. Saved a list of the executed jobs to
I<logfile> in the following format: sequence number, sshlogin, start
time as seconds since epoch, run time in seconds, bytes in files
transfered, bytes in files returned, command run.
To convert the times into ISO-8601 strict do:
B<perl -a -F"\t" -ne 'chomp($F[2]=`date -d \@$F[2] +%FT%T`); print join("\t",@F)'>
=item B<--jobs> I<N> =item B<--jobs> I<N>
=item B<-j> I<N> =item B<-j> I<N>

View file

@ -239,8 +239,9 @@ stdout parallel -k -l1 -n4 echo < files.xi
echo '### -l2 echo < files.xi' echo '### -l2 echo < files.xi'
stdout xargs -l2 echo < files.xi stdout xargs -l2 echo < files.xi
stdout parallel -k -l2 echo < files.xi stdout parallel -k -l2 echo < files.xi
echo '### -s30 -t echo < stairs.xi' echo '### -s30 -t echo < stairs.xi - xargs'
stdout xargs -s30 -t echo < stairs.xi stdout xargs -s30 -t echo < stairs.xi
echo '### -s30 -t echo < stairs.xi - parallel'
stdout parallel -k -X -s30 -t echo < stairs.xi stdout parallel -k -X -s30 -t echo < stairs.xi
echo '### -t echo this plus that < space.xi' echo '### -t echo this plus that < space.xi'
stdout xargs -t echo this plus that < space.xi stdout xargs -t echo this plus that < space.xi

View file

@ -38,7 +38,7 @@ echo '### Test empty input'
</dev/null parallel -j +0 echo </dev/null parallel -j +0 echo
echo '### Test -m' echo '### Test -m'
seq 1 2 | parallel -m echo seq 1 2 | parallel -k -m echo
echo '### Test :::' echo '### Test :::'
parallel echo ::: 1 parallel echo ::: 1

View file

@ -1055,7 +1055,7 @@ FIRST with 'single quotes' as well. IS OK
/src/gnu/autoconf-1.11/install.sh /src/gnu/autoconf-1.11/autoconf.info /src/gnu/autoconf-1.11/install.sh /src/gnu/autoconf-1.11/autoconf.info
/src/gnu/autoconf-1.11/standards.texi /src/gnu/autoconf-1.11/make-stds.texi /src/gnu/autoconf-1.11/standards.texi /src/gnu/autoconf-1.11/make-stds.texi
/src/gnu/autoconf-1.11/standards.info /src/gnu/autoconf-1.11/texinfo.tex /src/gnu/autoconf-1.11/standards.info /src/gnu/autoconf-1.11/texinfo.tex
### -s30 -t echo < stairs.xi ### -s30 -t echo < stairs.xi - xargs
echo 1 22 333 4444 55555 echo 1 22 333 4444 55555
1 22 333 4444 55555 1 22 333 4444 55555
echo 666666 7777777 88888888 echo 666666 7777777 88888888
@ -1066,6 +1066,7 @@ echo 55555 666666 7777777
55555 666666 7777777 55555 666666 7777777
echo 88888888 999999999 echo 88888888 999999999
88888888 999999999 88888888 999999999
### -s30 -t echo < stairs.xi - parallel
echo 1 22 333 4444 55555 echo 1 22 333 4444 55555
echo 666666 7777777 88888888 echo 666666 7777777 88888888
1 22 333 4444 55555 1 22 333 4444 55555