From cd9efa9ab87aff30e4447a43f7868dbd28d34e3d Mon Sep 17 00:00:00 2001 From: Ole Tange Date: Tue, 15 Jan 2013 00:20:59 +0100 Subject: [PATCH] parallel.pod: Batch jobqueue processor. --- doc/release_new_version | 4 ++-- src/parallel.pod | 28 +++++++++++++++++----------- 2 files changed, 19 insertions(+), 13 deletions(-) diff --git a/doc/release_new_version b/doc/release_new_version index d99e5500..c2f59c93 100644 --- a/doc/release_new_version +++ b/doc/release_new_version @@ -171,9 +171,9 @@ cc:Sandro Cazzaniga , Ryoichiro Suzuki , Jesse Alama -Subject: GNU Parallel 20130122 ('') released +Subject: GNU Parallel 20130122 ('Jyoti Singh Pandey') released -GNU Parallel 20130122 ('') has been released. It is +GNU Parallel 20130122 ('Jyoti Singh Pandey') has been released. It is available for download at: http://ftp.gnu.org/gnu/parallel/ New in this release: diff --git a/src/parallel.pod b/src/parallel.pod index 4f6f53bf..3ac3b772 100644 --- a/src/parallel.pod +++ b/src/parallel.pod @@ -2411,17 +2411,23 @@ system/batch manager: =item * -You will get a warning if you do not submit JobSlots jobs within the -first second. E.g. if you have 8 cores and use B<-j+2> you have to submit -10 jobs. These can be dummy jobs (e.g. B). You can also simply -ignore the warning. +You will get a warning if you do not submit JobSlots jobs within +the first second. E.g. if you have 8 cores and use -j+2 you have to +submit 10 jobs. These can be dummy jobs (e.g. echo foo). You can also +simply ignore the warning. For parallel versions 20110322 and higher, +the warnings will not appear. =item * -Jobs will be run immediately, but output from jobs will only be -printed when JobSlots more jobs has been started. E.g. if you have 10 -jobslots then the output from the first completed job will only be -printed when job 11 is started. +You have to submit JobSlot number of jobs before they will start, and +after that you can submit one at a time, and job will start +immediately if free slots are available. Output from the running or +completed jobs are held back and will only be printed when JobSlots +more jobs has been started (unless you use --ungroup or -u, in which +case the output from the jobs are printed immediately). E.g. if you +have 10 jobslots then the output from the first completed job will +only be printed when job 11 has started, and the output of second +completed job will only be printed when job 12 has started. =back @@ -2438,9 +2444,6 @@ B on each file put into B or subdirs of B. -The B<-u> is needed because of a small bug in GNU B. If that -proves to be a problem, file a bug report. - You can of course use B<-S> to distribute the jobs to remote computers: @@ -2451,6 +2454,9 @@ If the files to be processed are in a tar file then unpacking one file and processing it immediately may be faster than first unpacking all files. Set up the dir processor as above and unpack into the dir. +Using GNU Parallel as dir processor has the same limitations as using +GNU Parallel as queue system/batch manager. + =head1 QUOTING