mirror of
https://git.savannah.gnu.org/git/parallel.git
synced 2024-11-22 05:57:54 +00:00
Released as 20170222 ('13769')
This commit is contained in:
Ole Tange
parent
5ea9f57ba7
commit
68610ea9dd
83
NEWS
83
NEWS
|
|
@ -1,3 +1,86 @@
|
|||
20170222
|
||||
|
||||
* env_parallel now supports /bin/sh, ash, dash.
|
||||
|
||||
* --tee will pipe all data to all jobs. Used with --pipe/--pipepart
|
||||
and :::. Small example: seq 3333 | parallel --pipe --tee --tag 'grep
|
||||
{} | wc -l' ::: {0..9}
|
||||
|
||||
* If --results {replstr} ends in /: save in dir. Otherwise save as
|
||||
file. Example: parallel --results {} echo {} ::: a b c
|
||||
|
||||
* Vote for GNU Parallel's community ads on
|
||||
http://meta.unix.stackexchange.com/a/4356/2972
|
||||
http://meta.askubuntu.com/a/16750/22307
|
||||
http://meta.serverfault.com/a/9040/45704
|
||||
|
||||
* GNU Parallel was cited in: Low-delay forwarding with multiple
|
||||
candidates for VANETs using multi-criteria decision making
|
||||
http://ieeexplore.ieee.org/document/7835961/
|
||||
|
||||
* GNU Parallel was cited in: An Integrated Simulator and Dataset that
|
||||
Combines Grasping and Vision for Deep Learning
|
||||
https://arxiv.org/pdf/1702.02103.pdf
|
||||
|
||||
* GNU Parallel was cited in: A Bayesian model selection approach for
|
||||
identifying differentially expressed transcripts from RNA sequencing
|
||||
data http://onlinelibrary.wiley.com/doi/10.1111/rssc.12213/full
|
||||
|
||||
* GNU Parallel was cited in: The impact of copy number variation on
|
||||
gout, and the apple genome
|
||||
https://ourarchive.otago.ac.nz/bitstream/handle/10523/7060/BoocockJames2016MSc.pdf?sequence=3
|
||||
|
||||
* GNU Parallel was cited in: Determination of crystal structures of
|
||||
proteins of unknown identity using a marathon molecular replacement
|
||||
procedure: structure of Stenotrophomonas maltophilia
|
||||
phosphate-binding protein
|
||||
https://www.researchgate.net/publication/308186413_Determination_of_crystal_structures_of_proteins_of_unknown_identity_using_a_marathon_molecular_replacement_procedure_Structure_of_Stenotrophomonas_maltophilia_phosphate-binding_protein
|
||||
|
||||
* GNU Parallel was cited in: Reaction rates for reaction-diffusion
|
||||
kinetics on unstructured meshes
|
||||
http://aip.scitation.org/doi/10.1063/1.4975167
|
||||
|
||||
* GNU Parallel was cited in: Modeling prediction error improves power
|
||||
of transcriptome-wide association studies
|
||||
http://biorxiv.org/content/biorxiv/early/2017/02/14/108316.full.pdf
|
||||
|
||||
* GNU Parallel was cited in: Proper experimental design requires
|
||||
randomization/balancing of molecular ecology experiments
|
||||
http://biorxiv.org/content/biorxiv/early/2017/02/17/109280.full.pdf
|
||||
|
||||
* GNU Parallel was cited in: Experiment-based thermal micromagnetic
|
||||
simulations of the magnetization reversal for ns-range clocked
|
||||
nanomagnetic logic
|
||||
http://aip.scitation.org/doi/full/10.1063/1.4974021
|
||||
|
||||
* GNU Parallel was cited in: The University of Edinburgh’s systems
|
||||
submission to the MT task at IWSLT
|
||||
http://workshop2016.iwslt.org/downloads/IWSLT_2016_paper_27.pdf
|
||||
|
||||
* Fast-GBS uses GNU Parallel: https://bitbucket.org/jerlar73/fast-gbs
|
||||
|
||||
* Job: DevOps Engineer/Senior Systems Administrator in New York, New
|
||||
York
|
||||
http://rockefeller.jobs/new-york-ny/devops-engineersenior-systems-administrator/2DB3408EAC9E4617AD238550F31C7641/job/
|
||||
|
||||
* Training in GNU Parallel:
|
||||
https://www.carc.unm.edu/education-outreach/workshops--training/
|
||||
|
||||
* Training in GNU Parallel:
|
||||
http://www.hpc.lsu.edu/training/registration.php?topic=Parallel%20Serial%20Jobs%20Using%20GNU%20Parallel&date=February%2022,%202017&time=9:00%20AM%20-%2011:00%20AM&place=307%20Frey&deadline=2017-02-21%2016:30:00
|
||||
|
||||
* Batch Convert Images from PNG to JPEG
|
||||
http://coreygoldberg.blogspot.dk/2017/02/batch-convert-images-from-png-to-jpeg.html
|
||||
|
||||
* Accelerating Oxford Nanopore Basecalling
|
||||
http://fowlerlab.org/2017/01/26/accelerating-oxford-nanopore-basecalling/
|
||||
|
||||
* parallel и imagemagick в loop на bash
|
||||
https://www.linux.org.ru/forum/development/13190247
|
||||
|
||||
* Bug fixes and man page updates.
|
||||
|
||||
|
||||
20170206alpha
|
||||
|
||||
* --tee introduced.
|
||||
|
|
|
|||
12
README
12
README
|
|
@ -44,9 +44,9 @@ document.
|
|||
|
||||
Full installation of GNU Parallel is as simple as:
|
||||
|
||||
wget http://ftpmirror.gnu.org/parallel/parallel-20170206.tar.bz2
|
||||
bzip2 -dc parallel-20170206.tar.bz2 | tar xvf -
|
||||
cd parallel-20170206
|
||||
wget http://ftpmirror.gnu.org/parallel/parallel-20170222.tar.bz2
|
||||
bzip2 -dc parallel-20170222.tar.bz2 | tar xvf -
|
||||
cd parallel-20170222
|
||||
./configure && make && sudo make install
|
||||
|
||||
|
||||
|
|
@ -55,9 +55,9 @@ Full installation of GNU Parallel is as simple as:
|
|||
If you are not root you can add ~/bin to your path and install in
|
||||
~/bin and ~/share:
|
||||
|
||||
wget http://ftpmirror.gnu.org/parallel/parallel-20170206.tar.bz2
|
||||
bzip2 -dc parallel-20170206.tar.bz2 | tar xvf -
|
||||
cd parallel-20170206
|
||||
wget http://ftpmirror.gnu.org/parallel/parallel-20170222.tar.bz2
|
||||
bzip2 -dc parallel-20170222.tar.bz2 | tar xvf -
|
||||
cd parallel-20170222
|
||||
./configure --prefix=$HOME && make && make install
|
||||
|
||||
Or if your system lacks 'make' you can simply copy src/parallel
|
||||
|
|
|
|||
20
configure
vendored
20
configure
vendored
|
|
@ -1,6 +1,6 @@
|
|||
#! /bin/sh
|
||||
# Guess values for system-dependent variables and create Makefiles.
|
||||
# Generated by GNU Autoconf 2.69 for parallel 20170206.
|
||||
# Generated by GNU Autoconf 2.69 for parallel 20170222.
|
||||
#
|
||||
# Report bugs to <bug-parallel@gnu.org>.
|
||||
#
|
||||
|
|
@ -579,8 +579,8 @@ MAKEFLAGS=
|
|||
# Identity of this package.
|
||||
PACKAGE_NAME='parallel'
|
||||
PACKAGE_TARNAME='parallel'
|
||||
PACKAGE_VERSION='20170206'
|
||||
PACKAGE_STRING='parallel 20170206'
|
||||
PACKAGE_VERSION='20170222'
|
||||
PACKAGE_STRING='parallel 20170222'
|
||||
PACKAGE_BUGREPORT='bug-parallel@gnu.org'
|
||||
PACKAGE_URL=''
|
||||
|
||||
|
|
@ -1214,7 +1214,7 @@ if test "$ac_init_help" = "long"; then
|
|||
# Omit some internal or obsolete options to make the list less imposing.
|
||||
# This message is too long to be a string in the A/UX 3.1 sh.
|
||||
cat <<_ACEOF
|
||||
\`configure' configures parallel 20170206 to adapt to many kinds of systems.
|
||||
\`configure' configures parallel 20170222 to adapt to many kinds of systems.
|
||||
|
||||
Usage: $0 [OPTION]... [VAR=VALUE]...
|
||||
|
||||
|
|
@ -1281,7 +1281,7 @@ fi
|
|||
|
||||
if test -n "$ac_init_help"; then
|
||||
case $ac_init_help in
|
||||
short | recursive ) echo "Configuration of parallel 20170206:";;
|
||||
short | recursive ) echo "Configuration of parallel 20170222:";;
|
||||
esac
|
||||
cat <<\_ACEOF
|
||||
|
||||
|
|
@ -1357,7 +1357,7 @@ fi
|
|||
test -n "$ac_init_help" && exit $ac_status
|
||||
if $ac_init_version; then
|
||||
cat <<\_ACEOF
|
||||
parallel configure 20170206
|
||||
parallel configure 20170222
|
||||
generated by GNU Autoconf 2.69
|
||||
|
||||
Copyright (C) 2012 Free Software Foundation, Inc.
|
||||
|
|
@ -1374,7 +1374,7 @@ cat >config.log <<_ACEOF
|
|||
This file contains any messages produced by compilers while
|
||||
running configure, to aid debugging if configure makes a mistake.
|
||||
|
||||
It was created by parallel $as_me 20170206, which was
|
||||
It was created by parallel $as_me 20170222, which was
|
||||
generated by GNU Autoconf 2.69. Invocation command line was
|
||||
|
||||
$ $0 $@
|
||||
|
|
@ -2237,7 +2237,7 @@ fi
|
|||
|
||||
# Define the identity of the package.
|
||||
PACKAGE='parallel'
|
||||
VERSION='20170206'
|
||||
VERSION='20170222'
|
||||
|
||||
|
||||
cat >>confdefs.h <<_ACEOF
|
||||
|
|
@ -2880,7 +2880,7 @@ cat >>$CONFIG_STATUS <<\_ACEOF || ac_write_fail=1
|
|||
# report actual input values of CONFIG_FILES etc. instead of their
|
||||
# values after options handling.
|
||||
ac_log="
|
||||
This file was extended by parallel $as_me 20170206, which was
|
||||
This file was extended by parallel $as_me 20170222, which was
|
||||
generated by GNU Autoconf 2.69. Invocation command line was
|
||||
|
||||
CONFIG_FILES = $CONFIG_FILES
|
||||
|
|
@ -2942,7 +2942,7 @@ _ACEOF
|
|||
cat >>$CONFIG_STATUS <<_ACEOF || ac_write_fail=1
|
||||
ac_cs_config="`$as_echo "$ac_configure_args" | sed 's/^ //; s/[\\""\`\$]/\\\\&/g'`"
|
||||
ac_cs_version="\\
|
||||
parallel config.status 20170206
|
||||
parallel config.status 20170222
|
||||
configured by $0, generated by GNU Autoconf 2.69,
|
||||
with options \\"\$ac_cs_config\\"
|
||||
|
||||
|
|
|
|||
|
|
@ -1,4 +1,4 @@
|
|||
AC_INIT([parallel], [20170206], [bug-parallel@gnu.org])
|
||||
AC_INIT([parallel], [20170222], [bug-parallel@gnu.org])
|
||||
AM_INIT_AUTOMAKE([-Wall -Werror foreign])
|
||||
AC_CONFIG_HEADERS([config.h])
|
||||
AC_CONFIG_FILES([
|
||||
|
|
|
|||
|
|
@ -4,7 +4,7 @@
|
|||
|
||||
Check that documentation is updated (compare to web):
|
||||
|
||||
Fixet for 20161223
|
||||
Fixet for 20170222
|
||||
git diff last-release-commit
|
||||
Unmodified beta since last version => production
|
||||
Unmodified alpha since last version => beta
|
||||
|
|
@ -16,7 +16,9 @@ configure.ac: AC_INIT([parallel], [20100422], [bug-parallel@gnu.org])
|
|||
src/parallel: $Global::version = 20100422;
|
||||
README: parallel-20130222
|
||||
|
||||
YYYYMMDD=$(echo `yyyymmdd`+1 | bc)
|
||||
YYYYMMDD=`yyyymmdd`
|
||||
echo $YYYYMMDD
|
||||
perl -i -pe "s/20\d\d\d\d\d\d/$YYYYMMDD/" configure.ac
|
||||
perl -i -pe "/version/ and s/20\d\d\d\d\d\d/$YYYYMMDD/" src/parallel
|
||||
perl -i -pe "/version/ and s/20\d\d\d\d\d\d/$YYYYMMDD/" src/sql
|
||||
|
|
@ -64,28 +66,11 @@ eval `gpg-agent --daemon`
|
|||
make upload
|
||||
|
||||
# Only needed for alpha:
|
||||
YYYYMMDD=`yyyymmdd`
|
||||
export YYYYMMDD
|
||||
eval `gpg-agent --daemon`
|
||||
cp doc/parallel.directive parallel-$YYYYMMDD.tar.bz2.directive
|
||||
perl -i -pe "s/20\d\d\d\d\d\d/$YYYYMMDD/" parallel-*.tar.*directive
|
||||
gpg --clearsign --yes parallel-$YYYYMMDD.tar.bz2.directive
|
||||
|
||||
(echo '#!/bin/bash';
|
||||
echo;
|
||||
echo "# To check the signature run:"
|
||||
echo "# echo | gpg"
|
||||
echo "# gpg --auto-key-locate keyserver --keyserver-options auto-key-retrieve parallel-$YYYYMMDD.tar.bz2.sig"
|
||||
echo
|
||||
echo "echo | gpg 2>/dev/null"
|
||||
echo 'gpg --auto-key-locate keyserver --keyserver-options auto-key-retrieve $0'
|
||||
echo 'exit $?'
|
||||
echo
|
||||
gpg -ab -o - parallel-$YYYYMMDD.tar.bz2
|
||||
) > parallel-$YYYYMMDD.tar.bz2.sig
|
||||
|
||||
gpg --auto-key-locate keyserver --keyserver-options auto-key-retrieve parallel-$YYYYMMDD.tar.bz2.sig
|
||||
|
||||
../ftpsync/src/ftpsync parallel-$YYYYMMDD.tar.bz2{,.sig,*asc} ftp://ftp-upload.gnu.org/incoming/alpha/
|
||||
|
||||
# Takes up to 8 minutes
|
||||
make alphaupload
|
||||
|
||||
== Update OpenSUSE build system ==
|
||||
|
||||
|
|
@ -216,20 +201,57 @@ GNU Parallel 20170222 ('13769') <<[stable]>> has been released. It is available
|
|||
|
||||
Haiku of the month:
|
||||
|
||||
<<>>
|
||||
Alias and vars
|
||||
export them more easily
|
||||
With env parallel
|
||||
-- Ole Tange
|
||||
|
||||
New in this release:
|
||||
|
||||
https://www.linux.org.ru/forum/development/13190247
|
||||
http://coreygoldberg.blogspot.dk/2017/02/batch-convert-images-from-png-to-jpeg.html
|
||||
* env_parallel now supports /bin/sh, ash, dash.
|
||||
|
||||
http://tomkimpson.com/howto/gnuparallel/
|
||||
http://workshop2016.iwslt.org/downloads/IWSLT_2016_paper_27.pdf
|
||||
http://aip.scitation.org/doi/full/10.1063/1.4974021
|
||||
http://fowlerlab.org/2017/01/26/accelerating-oxford-nanopore-basecalling/
|
||||
http://rockefeller.jobs/new-york-ny/devops-engineersenior-systems-administrator/2DB3408EAC9E4617AD238550F31C7641/job/
|
||||
* --tee will pipe all data to all jobs. Used with --pipe/--pipepart and :::. Small example: seq 3333 | parallel --pipe --tee --tag 'grep {} | wc -l' ::: {0..9}
|
||||
|
||||
* If --results {replstr} ends in /: save in dir. Otherwise save as file. Example: parallel --results {} echo {} ::: a b c
|
||||
|
||||
* Vote for GNU Parallel's community ads on
|
||||
http://meta.unix.stackexchange.com/a/4356/2972
|
||||
http://meta.askubuntu.com/a/16750/22307
|
||||
http://meta.serverfault.com/a/9040/45704
|
||||
|
||||
* GNU Parallel was cited in: Low-delay forwarding with multiple candidates for VANETs using multi-criteria decision making http://ieeexplore.ieee.org/document/7835961/
|
||||
|
||||
* GNU Parallel was cited in: An Integrated Simulator and Dataset that Combines Grasping and Vision for Deep Learning https://arxiv.org/pdf/1702.02103.pdf
|
||||
|
||||
* GNU Parallel was cited in: A Bayesian model selection approach for identifying differentially expressed transcripts from RNA sequencing data http://onlinelibrary.wiley.com/doi/10.1111/rssc.12213/full
|
||||
|
||||
* GNU Parallel was cited in: The impact of copy number variation on gout, and the apple genome https://ourarchive.otago.ac.nz/bitstream/handle/10523/7060/BoocockJames2016MSc.pdf?sequence=3
|
||||
|
||||
* GNU Parallel was cited in: Determination of crystal structures of proteins of unknown identity using a marathon molecular replacement procedure: structure of Stenotrophomonas maltophilia phosphate-binding protein https://www.researchgate.net/publication/308186413_Determination_of_crystal_structures_of_proteins_of_unknown_identity_using_a_marathon_molecular_replacement_procedure_Structure_of_Stenotrophomonas_maltophilia_phosphate-binding_protein
|
||||
|
||||
* GNU Parallel was cited in: Reaction rates for reaction-diffusion kinetics on unstructured meshes http://aip.scitation.org/doi/10.1063/1.4975167
|
||||
|
||||
* GNU Parallel was cited in: Modeling prediction error improves power of transcriptome-wide association studies http://biorxiv.org/content/biorxiv/early/2017/02/14/108316.full.pdf
|
||||
|
||||
* GNU Parallel was cited in: Proper experimental design requires randomization/balancing of molecular ecology experiments http://biorxiv.org/content/biorxiv/early/2017/02/17/109280.full.pdf
|
||||
|
||||
* GNU Parallel was cited in: Experiment-based thermal micromagnetic simulations of the magnetization reversal for ns-range clocked nanomagnetic logic http://aip.scitation.org/doi/full/10.1063/1.4974021
|
||||
|
||||
* GNU Parallel was cited in: The University of Edinburgh’s systems submission to the MT task at IWSLT http://workshop2016.iwslt.org/downloads/IWSLT_2016_paper_27.pdf
|
||||
|
||||
* Fast-GBS uses GNU Parallel: https://bitbucket.org/jerlar73/fast-gbs
|
||||
|
||||
* Job: DevOps Engineer/Senior Systems Administrator in New York, New York http://rockefeller.jobs/new-york-ny/devops-engineersenior-systems-administrator/2DB3408EAC9E4617AD238550F31C7641/job/
|
||||
|
||||
* Training in GNU Parallel: https://www.carc.unm.edu/education-outreach/workshops--training/
|
||||
|
||||
* Training in GNU Parallel: http://www.hpc.lsu.edu/training/registration.php?topic=Parallel%20Serial%20Jobs%20Using%20GNU%20Parallel&date=February%2022,%202017&time=9:00%20AM%20-%2011:00%20AM&place=307%20Frey&deadline=2017-02-21%2016:30:00
|
||||
|
||||
* Batch Convert Images from PNG to JPEG http://coreygoldberg.blogspot.dk/2017/02/batch-convert-images-from-png-to-jpeg.html
|
||||
|
||||
* Accelerating Oxford Nanopore Basecalling http://fowlerlab.org/2017/01/26/accelerating-oxford-nanopore-basecalling/
|
||||
|
||||
* parallel и imagemagick в loop на bash https://www.linux.org.ru/forum/development/13190247
|
||||
|
||||
|
||||
* <<Possibly http://link.springer.com/chapter/10.1007%2F978-3-319-22053-6_46>>
|
||||
|
|
|
|||
|
|
@ -1,8 +1,13 @@
|
|||
<directory name="parallel" rev="198" srcmd5="9318690d85c9596edbdf7512e69cf3e6" vrev="1">
|
||||
<directory name="parallel" rev="199" srcmd5="d215e332e8e0d5d9886c7045abed4819" vrev="1">
|
||||
<entry md5="e6710d334a82f776e34c07bc276abdf0" mtime="1483271525" name="parallel-20161222.tar.bz2" size="1449836" />
|
||||
<entry md5="f1d1774a1904db762c292ffa4b542658" mtime="1485019214" name="parallel-20170122.tar.bz2" size="1459419" />
|
||||
<entry md5="581a8aafd56bced7f48e6c8cd270e76e" mtime="1485019214" name="parallel.spec" size="4313" />
|
||||
<entry md5="98cb0dfdc6fc764110a71ec591b24bb1" mtime="1487719474" name="parallel-20170222.tar.bz2" size="1479077" />
|
||||
<entry md5="62b6c8aa976dfd7dcc275fb8ad3f44c4" mtime="1487719474" name="parallel.spec" size="4313" />
|
||||
<entry md5="3ab86fea7800fb5f7cb87269a8df7aa8" mtime="1483271526" name="parallel_20161122.dsc" size="556" />
|
||||
<entry md5="5cfd9e7aac93d0d254293b4e6c284873" mtime="1483271527" name="parallel_20161122.tar.gz" size="1576406" />
|
||||
<entry md5="aca39e894b20e489d439ddaca9ad3281" mtime="1482416160" name="parallel_20161222.tar.gz" size="1603168" />
|
||||
<entry md5="ec73cfb6f7e961f209e94a30e3e4a57e" mtime="1485019214" name="parallel_20170122.dsc" size="556" />
|
||||
<entry md5="8790199a8f2e5d07e86ae9cf00c08a4c" mtime="1485019215" name="parallel_20170122.tar.gz" size="1635064" />
|
||||
<entry md5="58be920398402a5503f92d56b0343662" mtime="1487719475" name="parallel_20170222.dsc" size="556" />
|
||||
<entry md5="aaef171df3933dbeb3d15fd0dfb90b46" mtime="1487719475" name="parallel_20170222.tar.gz" size="1661902" />
|
||||
</directory>
|
||||
|
|
|
|||
|
|
@ -1,6 +1,6 @@
|
|||
Summary: Shell tool for executing jobs in parallel
|
||||
Name: parallel
|
||||
Version: 20170122
|
||||
Version: 20170222
|
||||
Release: 1.1
|
||||
License: GPL
|
||||
Group: Productivity/File utilities
|
||||
|
|
|
|||
|
|
@ -1,6 +1,6 @@
|
|||
Summary: Shell tool for executing jobs in parallel
|
||||
Name: parallel
|
||||
Version: 20170122
|
||||
Version: 20170222
|
||||
Release: 1.1
|
||||
License: GPL
|
||||
Group: Productivity/File utilities
|
||||
|
|
|
|||
|
|
@ -233,7 +233,7 @@ DISTCLEANFILES = parallel.1 env_parallel.1 sem.1 sql.1 niceload.1 \
|
|||
EXTRA_DIST = parallel sem sql niceload parcat env_parallel \
|
||||
env_parallel.ash env_parallel.bash env_parallel.csh \
|
||||
env_parallel.dash env_parallel.fish env_parallel.ksh \
|
||||
env_parallel.pdksh env_parallel.tcsh env_parallel.zsh \
|
||||
sem.pod parallel.pod env_parallel.pod niceload.pod \
|
||||
parallel_tutorial.pod parallel_design.pod \
|
||||
env_parallel.pdksh env_parallel.sh env_parallel.tcsh \
|
||||
env_parallel.zsh sem.pod parallel.pod env_parallel.pod \
|
||||
niceload.pod parallel_tutorial.pod parallel_design.pod \
|
||||
parallel_alternatives.pod $(DISTCLEANFILES)
|
||||
|
|
|
|||
|
|
@ -265,9 +265,9 @@ DISTCLEANFILES = parallel.1 env_parallel.1 sem.1 sql.1 niceload.1 \
|
|||
EXTRA_DIST = parallel sem sql niceload parcat env_parallel \
|
||||
env_parallel.ash env_parallel.bash env_parallel.csh \
|
||||
env_parallel.dash env_parallel.fish env_parallel.ksh \
|
||||
env_parallel.pdksh env_parallel.tcsh env_parallel.zsh \
|
||||
sem.pod parallel.pod env_parallel.pod niceload.pod \
|
||||
parallel_tutorial.pod parallel_design.pod \
|
||||
env_parallel.pdksh env_parallel.sh env_parallel.tcsh \
|
||||
env_parallel.zsh sem.pod parallel.pod env_parallel.pod \
|
||||
niceload.pod parallel_tutorial.pod parallel_design.pod \
|
||||
parallel_alternatives.pod $(DISTCLEANFILES)
|
||||
|
||||
all: all-am
|
||||
|
|
|
|||
0
src/env_parallel.ash
Normal file → Executable file
0
src/env_parallel.ash
Normal file → Executable file
0
src/env_parallel.sh
Normal file → Executable file
0
src/env_parallel.sh
Normal file → Executable file
|
|
@ -24,7 +24,7 @@
|
|||
use strict;
|
||||
use Getopt::Long;
|
||||
$Global::progname="niceload";
|
||||
$Global::version = 20170206;
|
||||
$Global::version = 20170222;
|
||||
Getopt::Long::Configure("bundling","require_order");
|
||||
get_options_from_array(\@ARGV) || die_usage();
|
||||
if($opt::version) {
|
||||
|
|
|
|||
|
|
@ -1361,7 +1361,7 @@ sub check_invalid_option_combinations {
|
|||
|
||||
sub init_globals {
|
||||
# Defaults:
|
||||
$Global::version = 20170208;
|
||||
$Global::version = 20170222;
|
||||
$Global::progname = 'parallel';
|
||||
$Global::infinity = 2**31;
|
||||
$Global::debug = 0;
|
||||
|
|
|
|||
|
|
@ -3357,7 +3357,7 @@ If you have a lot of hosts use '-j0' to access more hosts in parallel.
|
|||
If the workers are behind a NAT wall, you need some trickery to get to
|
||||
them.
|
||||
|
||||
If you can B<ssh> to a jump host, and reach the workers from there,
|
||||
If you can B<ssh> to a jumphost, and reach the workers from there,
|
||||
then the obvious solution would be this, but it B<does not work>:
|
||||
|
||||
parallel --ssh 'ssh jumphost ssh' -S host1 echo ::: DOES NOT WORK
|
||||
|
|
@ -3547,7 +3547,7 @@ can read into R or LibreCalc, then you can use B<--results>:
|
|||
|
||||
=head1 EXAMPLE: Use XML as input
|
||||
|
||||
The show Aflyttet on Radio 24syv publishes a RSS feed with their audio
|
||||
The show Aflyttet on Radio 24syv publishes an RSS feed with their audio
|
||||
podcasts on: http://arkiv.radio24syv.dk/audiopodcast/channel/4466232
|
||||
|
||||
Using B<xpath> you can extract the URLs for 2016 and download them
|
||||
|
|
@ -3628,6 +3628,44 @@ the parts directly to the program:
|
|||
parallel -Xj1 sort -m {} ';' rm {} >bigfile.sort
|
||||
|
||||
|
||||
=head1 EXAMPLE: Grouping input lines
|
||||
|
||||
When processing with B<--pipe> you may have lines grouped by a
|
||||
value. Here is I<my.csv>:
|
||||
|
||||
Transaction Customer Item
|
||||
1 a 53
|
||||
2 b 65
|
||||
3 b 82
|
||||
4 c 96
|
||||
5 c 67
|
||||
6 c 13
|
||||
7 d 90
|
||||
8 d 43
|
||||
9 d 91
|
||||
10 d 84
|
||||
11 e 72
|
||||
12 e 102
|
||||
13 e 63
|
||||
14 e 56
|
||||
15 e 74
|
||||
|
||||
Let us assume you want GNU B<parallel> to process each customer. In
|
||||
other words: You want all the transactions for a single customer to be
|
||||
treated as a single record.
|
||||
|
||||
To do this we preprocess the data with a program that inserts a record
|
||||
separator before each customer (column 2 = $F[1]). Here we first make
|
||||
a 50 character random string, which we then use as the separator:
|
||||
|
||||
sep=`perl -e 'print map { ("a".."z","A".."Z")[rand(52)] } (1..50);'`
|
||||
cat my.csv | perl -ape '$F[1] ne $last and print "'$sep'"; $last = $F[1]' |
|
||||
parallel --recend $sep --rrs --pipe -N1 wc
|
||||
|
||||
If your program can process multiple customers replace B<-N1> with a
|
||||
reasonable B<--blocksize>.
|
||||
|
||||
|
||||
=head1 EXAMPLE: Running more than 250 jobs workaround
|
||||
|
||||
If you need to run a massive amount of jobs in parallel, then you will
|
||||
|
|
|
|||
2
src/sql
2
src/sql
|
|
@ -576,7 +576,7 @@ $Global::Initfile && unlink $Global::Initfile;
|
|||
exit ($err);
|
||||
|
||||
sub parse_options {
|
||||
$Global::version = 20170206;
|
||||
$Global::version = 20170222;
|
||||
$Global::progname = 'sql';
|
||||
|
||||
# This must be done first as this may exec myself
|
||||
|
|
|
|||
|
|
@ -195,7 +195,7 @@ pod2pdf --output-file ./parallel_alternatives.pdf ./parallel_alternatives.pod --
|
|||
Warning: pod2pdf not found. Using old parallel_alternatives.pdf
|
||||
make[0]: Entering directory '/tmp/parallel-00000000/src'
|
||||
/bin/mkdir -p '/usr/local/bin'
|
||||
/usr/bin/install -c parallel sql niceload parcat env_parallel env_parallel.bash env_parallel.zsh env_parallel.fish env_parallel.ksh env_parallel.pdksh env_parallel.csh env_parallel.tcsh '/usr/local/bin'
|
||||
/usr/bin/install -c parallel sql niceload parcat env_parallel env_parallel.ash env_parallel.bash env_parallel.csh env_parallel.dash env_parallel.fish env_parallel.ksh env_parallel.pdksh env_parallel.sh env_parallel.tcsh env_parallel.zsh '/usr/local/bin'
|
||||
make install-exec-hook
|
||||
make[0]: Entering directory '/tmp/parallel-00000000/src'
|
||||
rm /usr/local/bin/sem || true
|
||||
|
|
|
|||
|
|
@ -61,21 +61,21 @@ par_bash_underscore variables in aliases in and arrays in functions work
|
|||
par_bash_underscore variables in aliases in and arrays in functions work
|
||||
par_bash_underscore variables in aliases in and arrays in functions work
|
||||
par_bash_underscore variables in aliases in and arrays in functions work
|
||||
par_bash_underscore /bin/bash: line 57: not_copied_alias: command not found
|
||||
par_bash_underscore /bin/bash: line 57: not_copied_func: command not found
|
||||
par_bash_underscore /bin/bash: line 55: not_copied_alias: command not found
|
||||
par_bash_underscore /bin/bash: line 55: not_copied_func: command not found
|
||||
par_bash_underscore error=OK
|
||||
par_bash_underscore error=OK
|
||||
par_bash_underscore aliases in and arrays in functions work
|
||||
par_bash_underscore aliases in and arrays in functions work
|
||||
par_bash_underscore aliases in functions work
|
||||
par_bash_underscore aliases in functions work
|
||||
par_bash_underscore /bin/bash: line 52: myecho: command not found
|
||||
par_bash_underscore /bin/bash: line 49: myecho: command not found
|
||||
par_bash_underscore OK if no myecho ^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||
par_bash_underscore /bin/bash: line 52: myecho: command not found
|
||||
par_bash_underscore /bin/bash: line 49: myecho: command not found
|
||||
par_bash_underscore OK if no myecho ^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||
par_bash_underscore /bin/bash: line 50: myfunc: command not found
|
||||
par_bash_underscore /bin/bash: line 48: myfunc: command not found
|
||||
par_bash_underscore OK if no myfunc ^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||
par_bash_underscore /bin/bash: line 50: myfunc: command not found
|
||||
par_bash_underscore /bin/bash: line 48: myfunc: command not found
|
||||
par_bash_underscore OK if no myfunc ^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||
par_csh_funky 3 arg alias_works
|
||||
par_csh_funky myvar works
|
||||
|
|
@ -315,21 +315,21 @@ par_ksh_underscore variables in aliases in and arrays in functions work
|
|||
par_ksh_underscore variables in aliases in and arrays in functions work
|
||||
par_ksh_underscore variables in aliases in and arrays in functions work
|
||||
par_ksh_underscore variables in aliases in and arrays in functions work
|
||||
par_ksh_underscore /usr/bin/ksh: line 8: not_copied_alias: not found
|
||||
par_ksh_underscore /usr/bin/ksh: line 8: not_copied_func: not found
|
||||
par_ksh_underscore /usr/bin/ksh: line 5: not_copied_alias: not found
|
||||
par_ksh_underscore /usr/bin/ksh: line 5: not_copied_func: not found
|
||||
par_ksh_underscore error=OK
|
||||
par_ksh_underscore error=OK
|
||||
par_ksh_underscore aliases in and arrays in functions work
|
||||
par_ksh_underscore aliases in and arrays in functions work
|
||||
par_ksh_underscore aliases in functions work
|
||||
par_ksh_underscore aliases in functions work
|
||||
par_ksh_underscore /usr/bin/ksh[4]: myecho: not found [No such file or directory]
|
||||
par_ksh_underscore /usr/bin/ksh: myecho: not found [No such file or directory]
|
||||
par_ksh_underscore OK if no myecho ^^^^^^^^^^^^^^^^^
|
||||
par_ksh_underscore /usr/bin/ksh[4]: myecho: not found [No such file or directory]
|
||||
par_ksh_underscore /usr/bin/ksh: myecho: not found [No such file or directory]
|
||||
par_ksh_underscore OK if no myecho ^^^^^^^^^^^^^^^^^
|
||||
par_ksh_underscore /usr/bin/ksh: line 4: myfunc: not found
|
||||
par_ksh_underscore /usr/bin/ksh: line 2: myfunc: not found
|
||||
par_ksh_underscore OK if no myfunc ^^^^^^^^^^^^^^^^^
|
||||
par_ksh_underscore /usr/bin/ksh: line 4: myfunc: not found
|
||||
par_ksh_underscore /usr/bin/ksh: line 2: myfunc: not found
|
||||
par_ksh_underscore OK if no myfunc ^^^^^^^^^^^^^^^^^
|
||||
par_tcsh_funky
|
||||
par_tcsh_funky
|
||||
|
|
|
|||
|
|
@ -785,6 +785,14 @@ pdksh: Put this in /mnt/4tb/home/tange/.profile: source /usr/local/bin/env_para
|
|||
E.g. by doing: echo '. /usr/local/bin/env_parallel.pdksh' >> /mnt/4tb/home/tange/.profile
|
||||
Supports: aliases, functions, variables, arrays
|
||||
|
||||
ash: Put this in /mnt/4tb/home/tange/.profile: . /usr/local/bin/env_parallel.ash
|
||||
E.g. by doing: echo '. /usr/local/bin/env_parallel.ash' >> /mnt/4tb/home/tange/.profile
|
||||
Supports: aliases, variables
|
||||
|
||||
dash: Put this in /mnt/4tb/home/tange/.profile: . /usr/local/bin/env_parallel.dash
|
||||
E.g. by doing: echo '. /usr/local/bin/env_parallel.dash' >> /mnt/4tb/home/tange/.profile
|
||||
Supports: aliases, variables
|
||||
|
||||
csh: Put this in /mnt/4tb/home/tange/.cshrc: source /usr/local/bin/env_parallel.csh
|
||||
E.g. by doing: echo 'source /usr/local/bin/env_parallel.csh' >> /mnt/4tb/home/tange/.cshrc
|
||||
Supports: aliases, variables, arrays with no special chars
|
||||
|
|
|
|||
Loading…
Reference in a new issue