2010-06-05 23:03:39 +00:00
|
|
|
= Notes on how to release new version =
|
|
|
|
|
|
|
|
== Update version ==
|
|
|
|
|
|
|
|
=== configure.ac ===
|
|
|
|
configure.ac: AC_INIT([parallel], [20100422], [bug-parallel@gnu.org])
|
|
|
|
|
|
|
|
YYYYMMDD=`yyyymmdd`
|
|
|
|
perl -i -pe "s/20\d\d\d\d\d\d/$YYYYMMDD/" configure.ac
|
|
|
|
|
|
|
|
=== src/parallel ===
|
|
|
|
|
|
|
|
src/parallel: $Global::version = 20100422;
|
|
|
|
|
|
|
|
YYYYMMDD=`yyyymmdd`
|
|
|
|
perl -i -pe "/version/ and s/20\d\d\d\d\d\d/$YYYYMMDD/" src/parallel
|
2010-09-06 22:15:53 +00:00
|
|
|
perl -i -pe "/version/ and s/20\d\d\d\d\d\d/$YYYYMMDD/" src/sql
|
2010-12-21 20:10:44 +00:00
|
|
|
perl -i -pe "/version/ and s/20\d\d\d\d\d\d/$YYYYMMDD/" src/niceload
|
2010-06-05 23:03:39 +00:00
|
|
|
|
|
|
|
=== Autoconf/automake ===
|
|
|
|
|
|
|
|
rm -fr autom4te.cache aclocal.m4 config.h config.h.in config.log Makefile.in missing install-sh
|
|
|
|
rm -rf src/Makefile.in
|
|
|
|
autoreconf --install -W gnu
|
|
|
|
./configure
|
2010-12-21 17:08:16 +00:00
|
|
|
make -j && sudo make install
|
2010-06-05 23:03:39 +00:00
|
|
|
|
2010-11-13 13:57:39 +00:00
|
|
|
== Testsuite ==
|
2010-06-05 23:03:39 +00:00
|
|
|
|
2010-11-13 13:57:39 +00:00
|
|
|
cd testsuite; make
|
2010-06-05 23:03:39 +00:00
|
|
|
|
2010-07-18 02:17:49 +00:00
|
|
|
== Update NEWS ==
|
|
|
|
|
|
|
|
With the same things that goes in the announce mail
|
|
|
|
|
2010-06-05 23:03:39 +00:00
|
|
|
== Package ==
|
|
|
|
|
|
|
|
./configure
|
|
|
|
make dist
|
|
|
|
make dist-bzip2
|
|
|
|
|
2010-08-22 09:00:52 +00:00
|
|
|
== Test the package ==
|
|
|
|
|
2010-12-02 20:58:10 +00:00
|
|
|
YYYYMMDD=`yyyymmdd`
|
2010-08-22 09:00:52 +00:00
|
|
|
cp parallel-$YYYYMMDD.tar.bz2 /tmp
|
2011-01-19 15:25:25 +00:00
|
|
|
pushd /tmp
|
2010-08-22 09:00:52 +00:00
|
|
|
tar xjvf parallel-$YYYYMMDD.tar.bz2
|
|
|
|
cd parallel-$YYYYMMDD
|
2010-09-21 23:17:05 +00:00
|
|
|
./configure && make -j && sudo make -j install
|
2011-01-24 19:06:30 +00:00
|
|
|
pushd
|
2010-08-22 09:00:52 +00:00
|
|
|
|
2010-06-05 23:03:39 +00:00
|
|
|
== Upload ==
|
|
|
|
|
|
|
|
YYYYMMDD=`yyyymmdd`
|
|
|
|
cp doc/parallel.directive parallel-$YYYYMMDD.tar.bz2.directive
|
2010-06-16 03:03:52 +00:00
|
|
|
perl -i -pe "s/20\d\d\d\d\d\d/$YYYYMMDD/" parallel-*.tar.*directive
|
2010-06-05 23:03:39 +00:00
|
|
|
gpg --clearsign parallel-$YYYYMMDD.tar.bz2.directive
|
|
|
|
|
|
|
|
YYYYMMDD=`yyyymmdd`
|
|
|
|
gpg -b parallel-$YYYYMMDD.tar.bz2
|
|
|
|
|
|
|
|
YYYYMMDD=`yyyymmdd`
|
|
|
|
echo put parallel-$YYYYMMDD.tar.bz2{,.sig,*asc} | ncftp ftp://ftp-upload.gnu.org/incoming/ftp/
|
2011-01-02 00:01:21 +00:00
|
|
|
#echo put parallel-$YYYYMMDD.tar.bz2{,.sig,*asc} | ncftp ftp://ftp-upload.gnu.org/incoming/alpha/
|
2010-06-05 23:03:39 +00:00
|
|
|
|
2010-09-01 13:26:45 +00:00
|
|
|
== Download and test ==
|
|
|
|
|
2011-03-22 00:44:50 +00:00
|
|
|
YYYYMMDD=`yyyymmdd`
|
2011-01-19 15:25:25 +00:00
|
|
|
pushd /tmp
|
2011-02-02 15:36:29 +00:00
|
|
|
rm parallel-$YYYYMMDD.tar.bz2
|
2010-09-01 13:26:45 +00:00
|
|
|
wget http://ftp.gnu.org/gnu/parallel/parallel-$YYYYMMDD.tar.bz2
|
2011-01-19 15:25:25 +00:00
|
|
|
#wget http://alpha.gnu.org/gnu/parallel/parallel-$YYYYMMDD.tar.bz2
|
2010-09-01 13:26:45 +00:00
|
|
|
tar xjvf parallel-$YYYYMMDD.tar.bz2
|
|
|
|
cd parallel-$YYYYMMDD
|
2010-11-15 19:14:27 +00:00
|
|
|
./configure
|
2010-09-01 13:26:45 +00:00
|
|
|
make -j && sudo make -j install
|
2011-02-02 15:36:29 +00:00
|
|
|
pushd
|
2010-09-01 13:26:45 +00:00
|
|
|
|
|
|
|
== Update OpenSUSE build system ==
|
|
|
|
|
|
|
|
https://build.opensuse.org/package/show?package=parallel&project=home%3Atange
|
2011-03-22 00:44:50 +00:00
|
|
|
cd ~/privat/parallel/packager/obs
|
|
|
|
em home:tange/parallel/parallel.spec
|
|
|
|
find home:tange/parallel/* -type f | grep -v parallel.spec | parallel osc rm {}';' rm {}
|
|
|
|
make
|
|
|
|
Ret versionsnummeret fra 20100906-2 til YYYYMMDD-1
|
2010-09-01 13:26:45 +00:00
|
|
|
|
2010-06-05 23:03:39 +00:00
|
|
|
== Update Savannah ==
|
|
|
|
|
2010-09-05 22:48:28 +00:00
|
|
|
Content from release mail:
|
|
|
|
|
2011-03-22 00:44:50 +00:00
|
|
|
cat doc/release_new_version | klipper-stdin
|
2010-06-12 23:24:25 +00:00
|
|
|
https://savannah.gnu.org/news/submit.php?group=parallel
|
2010-07-22 22:39:51 +00:00
|
|
|
https://savannah.gnu.org/news/approve.php?group=parallel
|
2010-06-12 23:24:25 +00:00
|
|
|
|
2010-12-02 23:04:12 +00:00
|
|
|
# No longer updated. Too long and too buggy
|
|
|
|
# doc/pod2savannah_publicinfo src/parallel | klipper-stdin
|
|
|
|
# https://savannah.gnu.org/project/admin/editgroupinfo.php?group=parallel
|
2010-06-05 23:03:39 +00:00
|
|
|
|
2010-06-08 14:13:20 +00:00
|
|
|
== Update website ==
|
|
|
|
|
|
|
|
http://www.gnu.org/software/parallel/
|
|
|
|
http://www.gnu.org/software/parallel/man.html
|
2010-12-21 17:08:16 +00:00
|
|
|
http://www.gnu.org/software/parallel/sql.html
|
|
|
|
http://www.gnu.org/software/parallel/sem.html
|
|
|
|
http://www.gnu.org/software/parallel/niceload.html
|
2010-06-08 14:13:20 +00:00
|
|
|
|
2010-12-21 17:08:16 +00:00
|
|
|
pod2html src/parallel.pod > ../parallel-web/parallel/man.html
|
2010-09-22 21:54:42 +00:00
|
|
|
pod2html src/sql > ../parallel-web/parallel/sql.html
|
2010-12-21 17:08:16 +00:00
|
|
|
pod2html src/niceload > ../parallel-web/parallel/niceload.html
|
|
|
|
pod2html src/sem.pod > ../parallel-web/parallel/sem.html
|
2010-07-22 22:39:51 +00:00
|
|
|
cd ../parallel-web/parallel
|
2010-09-05 22:48:28 +00:00
|
|
|
cvs up
|
2010-06-08 14:13:20 +00:00
|
|
|
cvs ci
|
|
|
|
|
2011-03-22 00:44:50 +00:00
|
|
|
== Commit released version ==
|
|
|
|
|
|
|
|
git diff
|
|
|
|
git commit -a
|
|
|
|
|
2010-06-05 23:03:39 +00:00
|
|
|
== Update Freshmeat ==
|
|
|
|
|
|
|
|
http://freshmeat.net/projects/parallel/releases/new
|
|
|
|
|
2010-11-13 16:04:58 +00:00
|
|
|
== Update Twitter ==
|
|
|
|
|
2010-12-02 23:04:12 +00:00
|
|
|
New version of #GNU Parallel released. See what is new in this release
|
2010-11-13 16:04:58 +00:00
|
|
|
http://nd.gd/2j Watch the intro video http://nd.gd/0s
|
|
|
|
|
|
|
|
https://savannah.gnu.org/news/?group=parallel
|
|
|
|
|
2011-03-22 20:02:22 +00:00
|
|
|
# Only 350 requests per hour: 1 tweet = 3 requests
|
|
|
|
# 119 tweets/hour = sleep 30 per tweet (40 to be safe)
|
2011-04-23 12:01:22 +00:00
|
|
|
cat twitters | grep -iv removed |
|
|
|
|
parallel -j1 sleep 40\; echo @{} You have earlier shown interest in GNU Parallel. \
|
2010-11-15 19:14:27 +00:00
|
|
|
A new version is out: http://nd.gd/2j '|' ttytter
|
|
|
|
|
2010-06-05 23:03:39 +00:00
|
|
|
== Send announce ==
|
|
|
|
|
2010-06-25 23:56:14 +00:00
|
|
|
http://groups.google.com/group/comp.unix.shell/post
|
2010-06-14 22:05:47 +00:00
|
|
|
Newsgroups: comp.unix.shell,comp.unix.admin
|
|
|
|
|
2011-04-23 12:01:22 +00:00
|
|
|
https://lists.gnu.org/mailman/admindb/bug-parallel
|
|
|
|
https://lists.gnu.org/mailman/admindb/parallel
|
|
|
|
|
2010-06-05 23:03:39 +00:00
|
|
|
<<<<<
|
2010-09-01 13:26:45 +00:00
|
|
|
from:tange@gnu.org
|
2010-06-05 23:03:39 +00:00
|
|
|
to:parallel@gnu.org, bug-parallel@gnu.org, info-gnu@gnu.org, bug-directory@gnu.org
|
2010-08-14 18:39:33 +00:00
|
|
|
cc:Peter Simons <simons@cryp.to>, Sandro Cazzaniga <kharec@mandriva.org>,
|
2010-08-17 06:53:46 +00:00
|
|
|
Tim Cuthbertson <tim3d.junk@gmail.com>, Ludovic Courtès <ludo@gnu.org>,
|
|
|
|
Markus Ammer <mkmm@gmx-topmail.de>, Pavel Nuzhdin <pnzhdin@gmail.com>,
|
2010-09-01 13:26:45 +00:00
|
|
|
Phil Sung <psung@alum.mit.edu>, Michael Shigorin <mike@altlinux.org>,
|
2010-10-05 20:22:52 +00:00
|
|
|
Andrew McFague <amcfague@wgen.net>, Steven M. Christensen <sunfreeware@gmail.com>,
|
2010-10-26 23:50:58 +00:00
|
|
|
Chris Howey <howeyc@gmail.com>, Fethican Coşkuner <fethicanc@gmail.com>,
|
2011-03-29 14:22:56 +00:00
|
|
|
Rogério Brito <rbrito@ime.usp.br>,
|
2010-12-21 17:08:16 +00:00
|
|
|
Koen Vervloesem <koen@vervloesem.eu>, R. Tyler Croy <tyler@monkeypox.org>,
|
|
|
|
ryoichiro.suzuki@gmail.com,kerick@shiftedbit.net,
|
2011-03-07 23:47:39 +00:00
|
|
|
Christian Faulhammer <fauli@gentoo.org>, Ryoichiro Suzuki <ryoichiro.suzuki@gmail.com>,
|
|
|
|
Jesse Alama <jesse.alama@gmail.com>
|
2010-06-05 23:03:39 +00:00
|
|
|
|
2011-05-03 22:30:56 +00:00
|
|
|
Subject: GNU Parallel 2011XX22 ('Pakistan') released
|
2010-06-05 23:03:39 +00:00
|
|
|
|
2011-05-03 22:30:56 +00:00
|
|
|
GNU Parallel 2011XX22 ('Pakistan') has been released. It is
|
2011-03-22 00:44:50 +00:00
|
|
|
available for download at: http://ftp.gnu.org/gnu/parallel/
|
2011-02-02 15:36:29 +00:00
|
|
|
|
2011-05-05 21:36:12 +00:00
|
|
|
This is a major release. So far GNU Parallel has been focused on
|
|
|
|
replacing a single for-loop. The Pakistan release introduces ways to
|
|
|
|
replace nested loops.
|
|
|
|
|
2011-05-13 12:02:03 +00:00
|
|
|
If you are using the {1} {2} syntax for multiple input sources, then you
|
|
|
|
need to read about --xapply as the function has changed.
|
|
|
|
|
2011-01-24 19:06:30 +00:00
|
|
|
New in this release:
|
2011-01-18 17:15:42 +00:00
|
|
|
|
2011-05-05 21:36:12 +00:00
|
|
|
* Multiple ::: can be put on the command line and will be treated
|
|
|
|
similar to contents from multiple -a's.
|
|
|
|
|
|
|
|
* ::: and :::: can now be mixed on the command line. Use {1} .. {n} to
|
2011-05-13 12:02:03 +00:00
|
|
|
refer to inputs from the different input sources.
|
2011-05-05 21:36:12 +00:00
|
|
|
|
|
|
|
* --xapply is now needed to get xapply's behaviour of reading one line
|
2011-05-13 12:02:03 +00:00
|
|
|
from each of the input sources.
|
2011-05-05 21:36:12 +00:00
|
|
|
|
2011-05-13 12:02:03 +00:00
|
|
|
* Multiple input sources will cause all combinations of arguments from
|
|
|
|
the sources to be generated. E.g. 'parallel echo {1}+{2} ::: 1 2 :::
|
|
|
|
a b c' will print 1+a 1+b 1+c 2+a 2+b 2+c. This can often replace
|
|
|
|
nested loops.
|
2011-05-05 21:36:12 +00:00
|
|
|
|
2011-04-28 10:38:38 +00:00
|
|
|
* Implemented {//} for the input line with the basename removed (dirname).
|
|
|
|
|
2011-05-20 23:07:45 +00:00
|
|
|
* GNU Parallel now has a logo.
|
|
|
|
http://www.gnu.org/software/parallel/logo.png
|
|
|
|
|
2011-05-13 12:02:03 +00:00
|
|
|
* Article about GNU SQL in USENIX Magazine ;login: (print)
|
|
|
|
http://www.usenix.org/publications/login/2011-04/
|
|
|
|
|
2011-04-27 15:12:35 +00:00
|
|
|
* Using GNU Parallel with EC2. Thanks to Kevin Wu.
|
|
|
|
http://blog.kevinformatics.com/post/4970574713/interested-in-your-experience-using-gnu-parallel-in
|
2011-04-23 12:01:22 +00:00
|
|
|
|
2011-04-27 15:12:35 +00:00
|
|
|
* Review with idea for {..} and {...} in Japanese. Thanks to ichii386.
|
|
|
|
http://d.hatena.ne.jp/ichii386/20110426
|
2011-04-23 12:01:22 +00:00
|
|
|
|
2011-05-03 22:30:56 +00:00
|
|
|
* Upgrade GNU Parallel using Macports. Thanks to Phil Hollenback.
|
|
|
|
http://www.hollenback.net/index.php/MacportsParallel
|
|
|
|
|
|
|
|
* Robert from Echo One discusses using processes instead of threads:
|
|
|
|
http://rrees.wordpress.com/2011/04/25/many-cores-many-threads/
|
|
|
|
|
2011-05-04 18:55:01 +00:00
|
|
|
* How to run GNU Parallel on a SLURM cluster. Thanks to Kevin Stock.
|
|
|
|
http://www.kevinstock.org/2011/04/using-the-ri-cluster/
|
|
|
|
|
|
|
|
* Short article about using GNU Parallel with lame:
|
|
|
|
http://loopkid.net/articles/2011/04/30/accelerate-lame-mp3-conversion
|
|
|
|
|
2011-05-20 23:07:45 +00:00
|
|
|
* Using GNU Parallel to run tail -f in Japanese. Thanks to Clouder.
|
|
|
|
http://blog.clouder.jp/archives/001140.html
|
|
|
|
|
2011-05-13 12:02:03 +00:00
|
|
|
* BBC Research & Development uses GNU Parallel:
|
|
|
|
http://www.bbc.co.uk/blogs/researchanddevelopment/2010/11/prototyping-weeknotes-41-26112.shtml
|
|
|
|
|
|
|
|
* Short article about using GNU Parallel on RHEL. Thanks to Rishi Deshpande.
|
|
|
|
http://nuclear-imaging.info/site_content/2011/05/11/gnu-parallel/
|
|
|
|
|
|
|
|
* Using GNU Parallel for FLAC->MP3 conversion. Thanks to Derek Marcotte.
|
|
|
|
http://derek.chezmarcotte.ca/?p=286
|
|
|
|
|
2011-01-02 00:01:21 +00:00
|
|
|
* Bug fixes and man page updates.
|
2010-12-21 17:08:16 +00:00
|
|
|
|
2011-03-01 22:04:15 +00:00
|
|
|
|
2010-06-05 23:03:39 +00:00
|
|
|
= About GNU Parallel =
|
|
|
|
|
|
|
|
GNU Parallel is a shell tool for executing jobs in parallel using one
|
2011-01-27 21:56:59 +00:00
|
|
|
or more computers. A job is can be a single command or a small script
|
|
|
|
that has to be run for each of the lines in the input. The typical
|
|
|
|
input is a list of files, a list of hosts, a list of users, a list of
|
|
|
|
URLs, or a list of tables. A job can also be a command that reads from
|
|
|
|
a pipe. GNU Parallel can then split the input and pipe it into
|
|
|
|
commands in parallel.
|
|
|
|
|
|
|
|
If you use xargs and tee today you will find GNU Parallel very easy to
|
|
|
|
use as GNU Parallel is written to have the same options as xargs. If
|
|
|
|
you write loops in shell, you will find GNU Parallel may be able to
|
2010-06-05 23:03:39 +00:00
|
|
|
replace most of the loops and make them run faster by running several
|
2011-05-13 12:02:03 +00:00
|
|
|
jobs in parallel. GNU Parallel can even replace nested loops.
|
2010-06-05 23:03:39 +00:00
|
|
|
|
|
|
|
GNU Parallel makes sure output from the commands is the same output as
|
|
|
|
you would get had you run the commands sequentially. This makes it
|
|
|
|
possible to use output from GNU Parallel as input for other programs.
|
|
|
|
|
|
|
|
You can find more about GNU Parallel at:
|
|
|
|
http://www.gnu.org/software/parallel/
|
2010-06-14 22:05:47 +00:00
|
|
|
|
2010-07-22 22:39:51 +00:00
|
|
|
Watch the intro video on http://www.youtube.com/watch?v=OpaiGYxkSuQ or
|
|
|
|
at http://tinyogg.com/watch/TORaR/ and http://tinyogg.com/watch/hfxKj/
|
2010-06-14 22:05:47 +00:00
|
|
|
|
2011-03-14 16:37:30 +00:00
|
|
|
When using GNU Parallel for a publication please cite:
|
|
|
|
|
|
|
|
O. Tange (2011): GNU Parallel - The Command-Line Power Tool, ;login:
|
|
|
|
The USENIX Magazine, February 2011:42-47.
|
2011-05-13 12:02:03 +00:00
|
|
|
|
|
|
|
|
|
|
|
= About GNU SQL =
|
|
|
|
|
|
|
|
GNU sql aims to give a simple, unified interface for accessing
|
|
|
|
databases through all the different databases' command line
|
|
|
|
clients. So far the focus has been on giving a common way to specify
|
|
|
|
login information (protocol, username, password, hostname, and port
|
|
|
|
number), size (database and table size), and running queries.
|
|
|
|
|
|
|
|
The database is addressed using a DBURL. If commands are left out you
|
|
|
|
will get that database's interactive shell.
|
|
|
|
|
|
|
|
When using GNU SQL for a publication please cite:
|
|
|
|
|
|
|
|
O. Tange (2011): GNU SQL - A Command Line Tool for Accessing Different
|
2011-05-20 23:07:45 +00:00
|
|
|
Databases Using DBURLs, ;login: The USENIX Magazine, April 2011:29-32.
|
2010-06-05 23:03:39 +00:00
|
|
|
>>>>>
|