2010-06-05 23:03:39 +00:00
|
|
|
= Notes on how to release new version =
|
|
|
|
|
2011-07-18 16:29:37 +00:00
|
|
|
== alpha/beta/production ==
|
|
|
|
|
|
|
|
Update documentation:
|
|
|
|
|
|
|
|
Modified => alpha
|
|
|
|
Unmodified alpha since last version => beta
|
|
|
|
Unmodified beta since last version => production
|
|
|
|
|
2010-06-05 23:03:39 +00:00
|
|
|
== Update version ==
|
|
|
|
|
|
|
|
=== configure.ac ===
|
|
|
|
configure.ac: AC_INIT([parallel], [20100422], [bug-parallel@gnu.org])
|
|
|
|
|
|
|
|
YYYYMMDD=`yyyymmdd`
|
|
|
|
perl -i -pe "s/20\d\d\d\d\d\d/$YYYYMMDD/" configure.ac
|
|
|
|
|
|
|
|
=== src/parallel ===
|
|
|
|
|
|
|
|
src/parallel: $Global::version = 20100422;
|
|
|
|
|
|
|
|
YYYYMMDD=`yyyymmdd`
|
|
|
|
perl -i -pe "/version/ and s/20\d\d\d\d\d\d/$YYYYMMDD/" src/parallel
|
2010-09-06 22:15:53 +00:00
|
|
|
perl -i -pe "/version/ and s/20\d\d\d\d\d\d/$YYYYMMDD/" src/sql
|
2010-12-21 20:10:44 +00:00
|
|
|
perl -i -pe "/version/ and s/20\d\d\d\d\d\d/$YYYYMMDD/" src/niceload
|
2010-06-05 23:03:39 +00:00
|
|
|
|
|
|
|
=== Autoconf/automake ===
|
|
|
|
|
|
|
|
rm -fr autom4te.cache aclocal.m4 config.h config.h.in config.log Makefile.in missing install-sh
|
|
|
|
rm -rf src/Makefile.in
|
|
|
|
autoreconf --install -W gnu
|
|
|
|
./configure
|
2010-12-21 17:08:16 +00:00
|
|
|
make -j && sudo make install
|
2010-06-05 23:03:39 +00:00
|
|
|
|
2010-11-13 13:57:39 +00:00
|
|
|
== Testsuite ==
|
2010-06-05 23:03:39 +00:00
|
|
|
|
2010-11-13 13:57:39 +00:00
|
|
|
cd testsuite; make
|
2010-06-05 23:03:39 +00:00
|
|
|
|
2010-07-18 02:17:49 +00:00
|
|
|
== Update NEWS ==
|
|
|
|
|
|
|
|
With the same things that goes in the announce mail
|
|
|
|
|
2010-06-05 23:03:39 +00:00
|
|
|
== Package ==
|
|
|
|
|
|
|
|
./configure
|
|
|
|
make dist
|
|
|
|
make dist-bzip2
|
|
|
|
|
2010-08-22 09:00:52 +00:00
|
|
|
== Test the package ==
|
|
|
|
|
2010-12-02 20:58:10 +00:00
|
|
|
YYYYMMDD=`yyyymmdd`
|
2010-08-22 09:00:52 +00:00
|
|
|
cp parallel-$YYYYMMDD.tar.bz2 /tmp
|
2011-01-19 15:25:25 +00:00
|
|
|
pushd /tmp
|
2010-08-22 09:00:52 +00:00
|
|
|
tar xjvf parallel-$YYYYMMDD.tar.bz2
|
|
|
|
cd parallel-$YYYYMMDD
|
2010-09-21 23:17:05 +00:00
|
|
|
./configure && make -j && sudo make -j install
|
2011-01-24 19:06:30 +00:00
|
|
|
pushd
|
2010-08-22 09:00:52 +00:00
|
|
|
|
2010-06-05 23:03:39 +00:00
|
|
|
== Upload ==
|
|
|
|
|
|
|
|
YYYYMMDD=`yyyymmdd`
|
|
|
|
cp doc/parallel.directive parallel-$YYYYMMDD.tar.bz2.directive
|
2010-06-16 03:03:52 +00:00
|
|
|
perl -i -pe "s/20\d\d\d\d\d\d/$YYYYMMDD/" parallel-*.tar.*directive
|
2010-06-05 23:03:39 +00:00
|
|
|
gpg --clearsign parallel-$YYYYMMDD.tar.bz2.directive
|
|
|
|
|
|
|
|
YYYYMMDD=`yyyymmdd`
|
|
|
|
gpg -b parallel-$YYYYMMDD.tar.bz2
|
|
|
|
|
|
|
|
YYYYMMDD=`yyyymmdd`
|
|
|
|
echo put parallel-$YYYYMMDD.tar.bz2{,.sig,*asc} | ncftp ftp://ftp-upload.gnu.org/incoming/ftp/
|
2011-01-02 00:01:21 +00:00
|
|
|
#echo put parallel-$YYYYMMDD.tar.bz2{,.sig,*asc} | ncftp ftp://ftp-upload.gnu.org/incoming/alpha/
|
2010-06-05 23:03:39 +00:00
|
|
|
|
2011-07-22 09:08:58 +00:00
|
|
|
== Update OpenSUSE build system ==
|
|
|
|
|
|
|
|
cd ~/privat/parallel/packager/obs
|
|
|
|
# Update version number
|
|
|
|
em home:tange/parallel/parallel.spec
|
|
|
|
find home:tange/parallel/* -type f | grep -v parallel.spec | parallel -Xj1 osc rm {}
|
|
|
|
# This should not create new files
|
|
|
|
osc up home:tange/parallel/
|
|
|
|
make
|
|
|
|
# Update versionsnummeret from 20110422-2 to YYYYMMDD-1
|
|
|
|
# Reload build-status:
|
|
|
|
https://build.opensuse.org/package/show?package=parallel&project=home%3Atange
|
2011-07-25 22:12:46 +00:00
|
|
|
# Check that one .deb (Debian 5.0) and one .rpm (CentOS) end with 'succeeded'
|
2011-07-22 09:08:58 +00:00
|
|
|
|
2010-09-01 13:26:45 +00:00
|
|
|
== Download and test ==
|
|
|
|
|
2011-03-22 00:44:50 +00:00
|
|
|
YYYYMMDD=`yyyymmdd`
|
2011-01-19 15:25:25 +00:00
|
|
|
pushd /tmp
|
2011-02-02 15:36:29 +00:00
|
|
|
rm parallel-$YYYYMMDD.tar.bz2
|
2010-09-01 13:26:45 +00:00
|
|
|
wget http://ftp.gnu.org/gnu/parallel/parallel-$YYYYMMDD.tar.bz2
|
2011-01-19 15:25:25 +00:00
|
|
|
#wget http://alpha.gnu.org/gnu/parallel/parallel-$YYYYMMDD.tar.bz2
|
2010-09-01 13:26:45 +00:00
|
|
|
tar xjvf parallel-$YYYYMMDD.tar.bz2
|
|
|
|
cd parallel-$YYYYMMDD
|
2010-11-15 19:14:27 +00:00
|
|
|
./configure
|
2010-09-01 13:26:45 +00:00
|
|
|
make -j && sudo make -j install
|
2011-02-02 15:36:29 +00:00
|
|
|
pushd
|
2010-09-01 13:26:45 +00:00
|
|
|
|
2010-06-08 14:13:20 +00:00
|
|
|
== Update website ==
|
|
|
|
|
|
|
|
http://www.gnu.org/software/parallel/
|
|
|
|
http://www.gnu.org/software/parallel/man.html
|
2010-12-21 17:08:16 +00:00
|
|
|
http://www.gnu.org/software/parallel/sql.html
|
|
|
|
http://www.gnu.org/software/parallel/sem.html
|
|
|
|
http://www.gnu.org/software/parallel/niceload.html
|
2010-06-08 14:13:20 +00:00
|
|
|
|
2010-12-21 17:08:16 +00:00
|
|
|
pod2html src/parallel.pod > ../parallel-web/parallel/man.html
|
2010-09-22 21:54:42 +00:00
|
|
|
pod2html src/sql > ../parallel-web/parallel/sql.html
|
2011-07-22 09:08:58 +00:00
|
|
|
pod2html src/niceload.pod > ../parallel-web/parallel/niceload.html
|
2010-12-21 17:08:16 +00:00
|
|
|
pod2html src/sem.pod > ../parallel-web/parallel/sem.html
|
2011-07-22 09:08:58 +00:00
|
|
|
pushd ../parallel-web/parallel
|
2010-09-05 22:48:28 +00:00
|
|
|
cvs up
|
2010-06-08 14:13:20 +00:00
|
|
|
cvs ci
|
2011-07-22 09:08:58 +00:00
|
|
|
pushd
|
2010-06-08 14:13:20 +00:00
|
|
|
|
2011-03-22 00:44:50 +00:00
|
|
|
== Commit released version ==
|
|
|
|
|
|
|
|
git diff
|
|
|
|
git commit -a
|
|
|
|
|
2011-07-25 22:12:46 +00:00
|
|
|
== Update Savannah ==
|
|
|
|
|
|
|
|
Content from release mail:
|
|
|
|
|
|
|
|
cat doc/release_new_version | klipper-stdin
|
|
|
|
https://savannah.gnu.org/news/submit.php?group=parallel
|
|
|
|
https://savannah.gnu.org/news/approve.php?group=parallel
|
|
|
|
|
|
|
|
# No longer updated. Too long and too buggy
|
|
|
|
# doc/pod2savannah_publicinfo src/parallel | klipper-stdin
|
|
|
|
# https://savannah.gnu.org/project/admin/editgroupinfo.php?group=parallel
|
|
|
|
|
2010-06-05 23:03:39 +00:00
|
|
|
== Update Freshmeat ==
|
|
|
|
|
|
|
|
http://freshmeat.net/projects/parallel/releases/new
|
|
|
|
|
2010-11-13 16:04:58 +00:00
|
|
|
== Update Twitter ==
|
|
|
|
|
2010-12-02 23:04:12 +00:00
|
|
|
New version of #GNU Parallel released. See what is new in this release
|
2010-11-13 16:04:58 +00:00
|
|
|
http://nd.gd/2j Watch the intro video http://nd.gd/0s
|
|
|
|
|
|
|
|
https://savannah.gnu.org/news/?group=parallel
|
|
|
|
|
2011-05-26 11:14:03 +00:00
|
|
|
|
2011-03-22 20:02:22 +00:00
|
|
|
# Only 350 requests per hour: 1 tweet = 3 requests
|
|
|
|
# 119 tweets/hour = sleep 30 per tweet (40 to be safe)
|
2011-05-26 11:14:03 +00:00
|
|
|
# The above is not enough.
|
|
|
|
# Went over the limit at number 132 (sleep 40)
|
|
|
|
# https://support.twitter.com/entries/15364-about-twitter-limits-update-api-dm-and-following
|
|
|
|
# says 250 direct msg per day = 86400/250 = sleep 345
|
2011-05-31 22:02:29 +00:00
|
|
|
cat twitters | grep -iv removed |
|
2011-05-26 11:14:03 +00:00
|
|
|
parallel -j1 sleep 354\; echo @{} You have earlier shown interest in GNU Parallel. \
|
2010-11-15 19:14:27 +00:00
|
|
|
A new version is out: http://nd.gd/2j '|' ttytter
|
|
|
|
|
2010-06-05 23:03:39 +00:00
|
|
|
== Send announce ==
|
|
|
|
|
2010-06-25 23:56:14 +00:00
|
|
|
http://groups.google.com/group/comp.unix.shell/post
|
2010-06-14 22:05:47 +00:00
|
|
|
Newsgroups: comp.unix.shell,comp.unix.admin
|
|
|
|
|
2011-04-23 12:01:22 +00:00
|
|
|
https://lists.gnu.org/mailman/admindb/bug-parallel
|
|
|
|
https://lists.gnu.org/mailman/admindb/parallel
|
|
|
|
|
2010-06-05 23:03:39 +00:00
|
|
|
<<<<<
|
2010-09-01 13:26:45 +00:00
|
|
|
from:tange@gnu.org
|
2010-06-05 23:03:39 +00:00
|
|
|
to:parallel@gnu.org, bug-parallel@gnu.org, info-gnu@gnu.org, bug-directory@gnu.org
|
2010-08-14 18:39:33 +00:00
|
|
|
cc:Peter Simons <simons@cryp.to>, Sandro Cazzaniga <kharec@mandriva.org>,
|
2010-08-17 06:53:46 +00:00
|
|
|
Tim Cuthbertson <tim3d.junk@gmail.com>, Ludovic Courtès <ludo@gnu.org>,
|
|
|
|
Markus Ammer <mkmm@gmx-topmail.de>, Pavel Nuzhdin <pnzhdin@gmail.com>,
|
2010-09-01 13:26:45 +00:00
|
|
|
Phil Sung <psung@alum.mit.edu>, Michael Shigorin <mike@altlinux.org>,
|
2010-10-05 20:22:52 +00:00
|
|
|
Andrew McFague <amcfague@wgen.net>, Steven M. Christensen <sunfreeware@gmail.com>,
|
2010-10-26 23:50:58 +00:00
|
|
|
Chris Howey <howeyc@gmail.com>, Fethican Coşkuner <fethicanc@gmail.com>,
|
2011-03-29 14:22:56 +00:00
|
|
|
Rogério Brito <rbrito@ime.usp.br>,
|
2010-12-21 17:08:16 +00:00
|
|
|
Koen Vervloesem <koen@vervloesem.eu>, R. Tyler Croy <tyler@monkeypox.org>,
|
|
|
|
ryoichiro.suzuki@gmail.com,kerick@shiftedbit.net,
|
2011-03-07 23:47:39 +00:00
|
|
|
Christian Faulhammer <fauli@gentoo.org>, Ryoichiro Suzuki <ryoichiro.suzuki@gmail.com>,
|
|
|
|
Jesse Alama <jesse.alama@gmail.com>
|
2010-06-05 23:03:39 +00:00
|
|
|
|
2011-07-18 16:29:37 +00:00
|
|
|
Subject: GNU Parallel 20110722 ('Murdoch') released
|
2010-06-05 23:03:39 +00:00
|
|
|
|
2011-07-18 16:29:37 +00:00
|
|
|
GNU Parallel 20110722 ('Murdoch') has been released. It is
|
2011-03-22 00:44:50 +00:00
|
|
|
available for download at: http://ftp.gnu.org/gnu/parallel/
|
2011-02-02 15:36:29 +00:00
|
|
|
|
2011-01-24 19:06:30 +00:00
|
|
|
New in this release:
|
2011-01-18 17:15:42 +00:00
|
|
|
|
2011-06-22 22:12:16 +00:00
|
|
|
* niceload: --hard will suspend a program if a limit is reached - as
|
|
|
|
opposed to just slowing the program down.
|
2011-05-31 22:02:29 +00:00
|
|
|
|
2011-07-20 23:58:23 +00:00
|
|
|
* niceload: --soft will slow the program down - as opposed to
|
2011-06-22 22:12:16 +00:00
|
|
|
suspending the program completely.
|
2011-05-13 12:02:03 +00:00
|
|
|
|
2011-07-19 14:44:14 +00:00
|
|
|
* niceload: --run-io will slow down a program if disk io goes above a
|
2011-06-22 22:12:16 +00:00
|
|
|
certain limit.
|
2011-05-13 12:02:03 +00:00
|
|
|
|
2011-07-19 14:44:14 +00:00
|
|
|
* niceload: --run-load will slow down a program if loadaverage goes
|
|
|
|
above a certain limit.
|
|
|
|
|
|
|
|
* niceload: --run-mem will slow down a program if free memory goes
|
|
|
|
below a certain limit.
|
|
|
|
|
|
|
|
* niceload: --run-noswap will slow down a program if the computer is
|
|
|
|
swapping.
|
|
|
|
|
|
|
|
* niceload: --start-io, --start-load, --start-mem, --start-noswap will
|
2011-06-22 22:12:16 +00:00
|
|
|
defer starting a program until the system is below the limit.
|
2011-06-21 23:14:59 +00:00
|
|
|
|
2011-07-19 14:44:14 +00:00
|
|
|
* --io, --load, --mem, and --noswap sets both --run-* and --start-*.
|
|
|
|
|
2011-06-22 22:12:16 +00:00
|
|
|
* niceload got a major rewrite and is now object oriented.
|
2011-06-03 12:53:14 +00:00
|
|
|
|
2011-06-22 22:12:16 +00:00
|
|
|
* GNU Parallel was presented at Nordic Perl Workshop 2011.
|
|
|
|
http://conferences.yapceurope.org/npw2011/talk/3416
|
2011-05-31 22:02:29 +00:00
|
|
|
|
2011-07-10 14:33:33 +00:00
|
|
|
* Blog post about zcat and GNU Parallel. Thanks to Dr. John.
|
|
|
|
http://drjohnstechtalk.com/blog/2011/06/gnu-parallel-really-helps-with-zcat/
|
|
|
|
|
|
|
|
* 2 blog posts in Japanese. Thanks to Negima.
|
|
|
|
http://d.hatena.ne.jp/negima1976/20110607/1307412660
|
|
|
|
http://d.hatena.ne.jp/negima1976/20110628/1309252494
|
|
|
|
|
2011-07-19 14:44:14 +00:00
|
|
|
* Blog post for bioinformatics. Thanks to Chris Miller.
|
|
|
|
http://chrisamiller.com/science/2010/05/26/use-parallel-for-easy-multi-processor-execution/
|
|
|
|
|
2011-01-02 00:01:21 +00:00
|
|
|
* Bug fixes and man page updates.
|
2010-12-21 17:08:16 +00:00
|
|
|
|
2011-03-01 22:04:15 +00:00
|
|
|
|
2010-06-05 23:03:39 +00:00
|
|
|
= About GNU Parallel =
|
|
|
|
|
|
|
|
GNU Parallel is a shell tool for executing jobs in parallel using one
|
2011-01-27 21:56:59 +00:00
|
|
|
or more computers. A job is can be a single command or a small script
|
|
|
|
that has to be run for each of the lines in the input. The typical
|
|
|
|
input is a list of files, a list of hosts, a list of users, a list of
|
|
|
|
URLs, or a list of tables. A job can also be a command that reads from
|
|
|
|
a pipe. GNU Parallel can then split the input and pipe it into
|
|
|
|
commands in parallel.
|
|
|
|
|
|
|
|
If you use xargs and tee today you will find GNU Parallel very easy to
|
|
|
|
use as GNU Parallel is written to have the same options as xargs. If
|
|
|
|
you write loops in shell, you will find GNU Parallel may be able to
|
2010-06-05 23:03:39 +00:00
|
|
|
replace most of the loops and make them run faster by running several
|
2011-05-13 12:02:03 +00:00
|
|
|
jobs in parallel. GNU Parallel can even replace nested loops.
|
2010-06-05 23:03:39 +00:00
|
|
|
|
|
|
|
GNU Parallel makes sure output from the commands is the same output as
|
|
|
|
you would get had you run the commands sequentially. This makes it
|
|
|
|
possible to use output from GNU Parallel as input for other programs.
|
|
|
|
|
|
|
|
You can find more about GNU Parallel at:
|
|
|
|
http://www.gnu.org/software/parallel/
|
2010-06-14 22:05:47 +00:00
|
|
|
|
2010-07-22 22:39:51 +00:00
|
|
|
Watch the intro video on http://www.youtube.com/watch?v=OpaiGYxkSuQ or
|
|
|
|
at http://tinyogg.com/watch/TORaR/ and http://tinyogg.com/watch/hfxKj/
|
2010-06-14 22:05:47 +00:00
|
|
|
|
2011-03-14 16:37:30 +00:00
|
|
|
When using GNU Parallel for a publication please cite:
|
|
|
|
|
|
|
|
O. Tange (2011): GNU Parallel - The Command-Line Power Tool, ;login:
|
|
|
|
The USENIX Magazine, February 2011:42-47.
|
2011-05-13 12:02:03 +00:00
|
|
|
|
|
|
|
|
|
|
|
= About GNU SQL =
|
|
|
|
|
|
|
|
GNU sql aims to give a simple, unified interface for accessing
|
|
|
|
databases through all the different databases' command line
|
|
|
|
clients. So far the focus has been on giving a common way to specify
|
|
|
|
login information (protocol, username, password, hostname, and port
|
|
|
|
number), size (database and table size), and running queries.
|
|
|
|
|
|
|
|
The database is addressed using a DBURL. If commands are left out you
|
|
|
|
will get that database's interactive shell.
|
|
|
|
|
|
|
|
When using GNU SQL for a publication please cite:
|
|
|
|
|
|
|
|
O. Tange (2011): GNU SQL - A Command Line Tool for Accessing Different
|
2011-05-20 23:07:45 +00:00
|
|
|
Databases Using DBURLs, ;login: The USENIX Magazine, April 2011:29-32.
|
2011-07-25 22:12:46 +00:00
|
|
|
|
|
|
|
|
|
|
|
= About GNU Niceload =
|
|
|
|
|
|
|
|
GNU niceload slows down a program when the computer load average (or
|
|
|
|
other system activity) is above a certain limit. When the limit is
|
|
|
|
reached the program will be suspended for some time. If the limit is a
|
|
|
|
soft limit the program will be allowed to run for short amounts of
|
|
|
|
time before being suspended again. If the limit is a hard limit the
|
|
|
|
program will only be allowed to run when the system is below the
|
|
|
|
limit.
|
|
|
|
|
2010-06-05 23:03:39 +00:00
|
|
|
>>>>>
|