Commit graph

258 commits

Author SHA1 Message Date
Ole Tange 97d1e025dc parallel: Small fix for ETA. 2011-04-10 18:01:58 +02:00
Ole Tange 1478df33f7 parallel: eta time smoothing depending on pct complete 2011-04-09 00:09:00 +02:00
Ole Tange 7b4f747877 parallel: Implemented {#}. Passes testsuite. 2011-04-08 21:57:19 +02:00
Ole Tange e1b8521487 man page update. 2011-03-29 16:22:56 +02:00
Ole Tange 105c92676f parallel: Fixed timing issue for --pipe on 8 core cpu. 2011-03-22 21:02:22 +01:00
Ole Tange 43bc68ae3a Released as 20110322. 2011-03-22 01:44:50 +01:00
Ole Tange c5d11674b0 Fixed: bug #32834: If input is generated slowly - do not complain.
-i with no args defaults to -i {}.
Use ::die_bug instead of die.
2011-03-20 22:40:12 +01:00
Ole Tange b4a51e40ee parallel: Allow -E 0 and -i 0
Documentation changes
2011-03-14 17:37:30 +01:00
Ole Tange 66c0168f4d sql: man-page uses consistent examples 2011-03-08 00:47:39 +01:00
Ole Tange 11b21d638c -l 0 no longer works (and never will) because of --tollef.
exponential backoff in --semaphore mode.
--regexp test.
testsuite passes.
2011-03-01 23:04:15 +01:00
Ole Tange ff48e14301 parallel: -l 0 -L 0 -n 0, and -N 0 implemented. Passes some tests. Man page missing. 2011-02-23 16:01:18 +01:00
Ole Tange c535c25450 parallel: implemented /etc/parallel/config. Passes testsuite. 2011-02-21 02:31:30 +01:00
Ole Tange 9cc892faf2 Released as 2011-02-05 FOSDEM 2011-02-17 17:23:38 +01:00
Ole Tange ad61df30f0 parallel: implemented --regexp. Prepended 'parallel:' to warnings 2011-02-02 16:36:29 +01:00
Ole Tange cb468fb6d3 Passes testsuite. 2011-01-27 22:56:59 +01:00
Ole Tange b0afcf9fa4 parallel --pipe: Do not pipe 0-length input to children 2011-01-27 18:53:57 +01:00
Ole Tange c9d95b0627 Small optimization for large --blocksize for --pipe.
Fixed bug in FreeBSD cpu/core detection.
2011-01-27 00:29:28 +01:00
Ole Tange 9a4522675c parallel: added --rrs with test. Passes testsuite. 2011-01-26 00:45:00 +01:00
Ole Tange 5a098fa66b parallel: Bugfix for Mac OS X: $SIG{TERM} is undef 2011-01-25 15:32:41 +01:00
Ole Tange 76d9e4f41b -N for --pipe. Fixed race condition in --pipe.
Tests for --pipe. Passes testsuite.
2011-01-24 20:06:30 +01:00
Ole Tange d5c7399d5b Released as 20110122 2011-01-22 23:40:15 +01:00
Ole Tange 0247e4beee --spreadstdin now forks a new child for each block. 2011-01-19 16:25:25 +01:00
Ole Tange 48454a36ea parallel: --joblog implemented. Testsuite missing.
--spreadstdin prototype. Testsuite missing.
2011-01-18 18:15:42 +01:00
Ole Tange 42a5f4e0cc testsuite passes.
max_jobs_running could be resat if -j is a changed file.
dummy children was not killed if cmd line was too long.
default number of jobs for --semaphore set to 1.
test25 had race condition.
test22 -j10 added.
test13 -j9 added.
test47 remote cleanup added before test.
test17 remote cleanup added before test.
2011-01-17 13:38:58 +01:00
Ole Tange 3ee7f79325 0install wants compiled man pages to be distributed. *.1 are now distributed.
More tests from test suite passes - though not all.
2011-01-11 13:42:14 +01:00
Ole Tange 1cc9c990a4 parallel: fixed: seq 9 | parallel -N 10 echo 2011-01-05 18:10:58 +01:00
Ole Tange 57cf4df2bc parallel: alpharelease. Distribute args between jobslots for -X. -j+0 now default. 2011-01-02 01:01:21 +01:00
Ole Tange 39526ff1fe sem: Problem if ~/.parallel does not exist. Fixed. 2010-12-22 10:21:58 +01:00
Ole Tange ef812dd02a Released as 20101222 2010-12-21 21:10:44 +01:00
Ole Tange a16d120711 Implemented --tty as the old default of assigning a tty to the first
job causes problems.
Cleanup if --workdir <> . did not work. Fixed.
2010-12-21 18:08:16 +01:00
Ole Tange 27822174c2 parallel: Fixed --retries bug. Passes testsuite. 2010-12-19 01:38:36 +01:00
Ole Tange 5a87ded0d1 parallel: Man page for --dry-run. Small bug fixes. 2010-12-16 00:12:02 +01:00
Ole Tange bff9531219 parallel: --dryrun implemented. --return of multiple files with
-X. --return of files containing space. Passes testsuite.
2010-12-14 09:40:42 +01:00
Ole Tange 3b3c344097 parallel: pod-file now separated (it became too big).
niceload: rewritten to GetOpt and first testsuite.
2010-12-07 00:30:08 +01:00
Ole Tange f3b7af993a parallel: passes unittest 2010-12-04 15:47:01 +01:00
Ole Tange 77f83e6270 basenamereplace and basenameextensionreplace activated.
Testsuite of {/} {/.} {#/.} {#/}.
2010-12-03 00:04:12 +01:00
Ole Tange 69e7da5bff Released as 20101202.
Debian packaging rolled back.
2010-12-02 21:58:10 +01:00
Ole Tange 4d22781652 --command, -c, --file, and -f now obsoleted. --eta works again.
Bugfix in testsuite for --retries.
Lots of dead code removed.
2010-11-29 23:59:16 +01:00
Ole Tange 8865cbb10f parallel: Argument handling re-written to OO.
The code is quite messy, the implementation is fairly slow, but the
structure seems sound and it passes the testsuite.
basename {/} and {/.} implemented.
Flushing of STDERR and STDOUT after each job completes.
2010-11-22 10:35:53 +01:00
Ole Tange 4ed346760b parallel: GetOptionsFromArray is not supported everywhere 2010-11-15 20:14:27 +01:00
Ole Tange d7c87979f9 Merge branch 'master' of ssh://newton.binf.ku.dk:24222/home/tange/privat/parallel 2010-11-13 17:33:02 +01:00
Ole Tange 2b2bbe889a Released as version 20101113 2010-11-13 17:04:58 +01:00
Ole Tange 90c333085d Release candidate 20101113 2010-11-13 14:57:39 +01:00
Ole Tange 0f9e570d7a parallel: Added man page for (unimplemented) basename 2010-11-09 18:09:33 +01:00
Ole Tange ea0dfc913e parallel: Implemented --profile. Untested. 2010-11-02 17:11:32 +01:00
Ole Tange f085a37a40 parallel: Implemented $PARALLEL_SEQ and $PARALLEL_PID.
-v now only show the command to be run. Use -vv to see the surrounding ssh wrapping.
--workdir implemented. Spelling mistakes.
2010-10-27 01:50:58 +02:00
Ole Tange cce81b5735 parallel: implemented -j file. Passes testsuite. 2010-10-06 22:18:32 +02:00
Ole Tange 44bdda5387 parallel: Give warning if stdin is tty 2010-10-06 20:29:16 +02:00
Ole Tange 692bb88453 parallel: EXAMPLE: Start editor with filenames from stdin (standard input).
parallel: EXAMPLE: GNU Parallel as queue system/batch manager.
2010-10-05 22:22:52 +02:00
Ole Tange 6f03760b56 sql: \n and \x0a in arguments is replaced with newline. Passes unittest. Added more examples. 2010-09-22 23:54:42 +02:00
Ole Tange e06f6d52ce parallel: Added difference between paexec 2010-09-22 01:17:05 +02:00
Ole Tange 59cb631264 Bugfix: --keeporder with -j100% mixed up order of first job
parallel: Unittest for --retries. Passes unittest.
2010-09-21 22:00:30 +02:00
Ole Tange 2e572c00c9 parallel: --retries implemented. Passes unittest. 2010-09-21 09:34:53 +02:00
Ole Tange 28f9796b4e sql: Each arg on command line will add a \n. Useful for Oracle 2010-09-14 23:25:53 +02:00
Ole Tange 22934a4bcd sql: Deal with :aliases containing ?query parts in batch mode.
:aliases?query is still a problem in interactive mode.
Passes sql-part of unittest.
2010-09-14 18:37:26 +02:00
Ole Tange c9b2a3f727 sql: Test of %-quoting.
sql: Test of cyclic aliases.
2010-09-10 00:18:43 +02:00
Ole Tange 0db41520c3 sql: basic dburl?sqlstatement works. No unittest 2010-09-09 23:21:11 +02:00
Ole Tange ffd548e168 sql: sqlite implemented. sql unittest passes. 2010-09-09 09:39:57 +02:00
Ole Tange 20eab02de2 parallel: --hashbang alias for --shebang.
sql: .dburl.aliases -> .sql/aliases.
unittest passes.
2010-09-08 01:43:11 +02:00
Ole Tange 0a5434c071 sql: renamed .dburl.aliases to .sql/aliases and /etc/sql/aliases.
Fixed bug if DBURL is NULL.
2010-09-07 13:15:29 +02:00
Ole Tange 6383459ddb Makefile for Debian package 2010-09-07 00:15:53 +02:00
Ole Tange 9b4f83dd59 Released as 20100906 2010-09-06 00:48:28 +02:00
Ole Tange 847841aa11 BSD xargs -o (open /dev/tty) is now default for the job running in foreground.
Useful for: ls | parallel -Xuj1 vi.
Unittest for tty commands using the command 'script'.
2010-09-05 12:22:08 +02:00
Ole Tange 32a3f8340b sql: Added unittest, --shebang, --version, --help.
parallel: bugfix in unittest.
Passes unittest
2010-09-01 15:26:45 +02:00
Ole Tange 16939a0fa6 --shebang implemented. Unittest passes. 2010-08-28 02:46:44 +02:00
Ole Tange 6ad5f9f693 Added: sql - a small script to access sql bases from the command line 2010-08-27 21:16:06 +02:00
Ole Tange b26dbadcc0 Bugfix: --eta/--progress with 0 jobs gave division by zero.
Bugfix in Makefile by Piotr Jaroszyński <p dot jaroszynski at gmail dot com>
2010-08-26 20:03:59 +02:00
Ole Tange 97ed1a37e5 Released as 20100822. 2010-08-22 11:00:52 +02:00
Ole Tange 8dcde6b058 A (crappy) example of sem usage. 2010-08-22 02:51:51 +02:00
Ole Tange 0fbd1b2653 --eta was broken. Now fixed.
Race condition in sem fixed with setsid().
Passes unittest.
2010-08-22 01:29:26 +02:00
Ole Tange adff24a1a0 Work around for race condition. Comparison table. 2010-08-17 16:25:40 +02:00
Ole Tange 47cf0f0128 Code cleanup. POD file for mini man page for sem 2010-08-17 08:53:46 +02:00
Ole Tange ac16e65b8a Unittest for sem 2010-08-16 16:16:56 +02:00
Ole Tange 422578c103 Added sem - semaphore for executing shell command lines in parallel 2010-08-15 23:33:49 +02:00
Ole Tange 48c89d6929 Added --sshloginfile .. or -S .. means use ~/.parallel/sshloginfile.
Changed .parallelrc to .parallel/config to avoid having two files in ~/
2010-08-14 22:51:09 +02:00
Ole Tange a038ade0de More examples 2010-08-14 20:39:33 +02:00
Ole Tange fcbfd19220 Example for manual. Bug fix. More unittests. 2010-08-01 20:09:31 +02:00
Ole Tange ab4133d44d Better reading of columns fixed a few bugs. Passes unittest. 2010-07-31 23:19:48 +02:00
Ole Tange 7dd8543a71 Added dummy: packager/0install/parallel.xml 2010-07-31 11:50:46 +02:00
Ole Tange 0d1c249a1a --trim implemented. Unittest passes 2010-07-29 11:39:02 +02:00
Ole Tange 5fea6dfd98 --colsep implemented. Unittest for --colsep missing, but old unittest passes. 2010-07-23 00:39:51 +02:00
Ole Tange e8a30d9fac Code refactor: move :::: and ::: processing. 2010-07-21 13:47:59 +02:00
Ole Tange ad25eb3f5a Bugfix in unittest. Unittest from xargs works a little better. 2010-07-18 18:04:07 +02:00
Ole Tange cc825a2cd3 Unittest for multi file input: cat {2} {1} :::: file1 file2 2010-07-18 15:47:59 +02:00
Ole Tange 611e7db260 Added basic xargs-test. Passes unittest 2010-07-18 04:17:49 +02:00
Ole Tange 248fa1c940 Unittest for multiple -a. Code refactor. 2010-07-14 21:54:33 +02:00
Ole Tange 3adfc665f1 Multiple -a implemented. No unittests. 2010-07-14 12:20:32 +02:00
Ole Tange 914df8e1e7 Implemented ::::.
FIXED BUG: Dependent quoting of arguments after :::.
2010-07-14 12:00:10 +02:00
Ole Tange e33b8e0d01 FIXED BUG: Negaive time: time parallel -j+0 --eta -Sserver1,server2,server3,: \
+--transfer --return {.}.bz2 --cleanup 'zcat {} | bzip2 -9 > {.}.bz2' ::: *gz.
FIXED BUG: echo "foo,bar,baz" | parallel -d, -L 1 echo.
2010-07-13 21:24:03 +02:00
Ole Tange 555436f746 Unittest: -0 on filenames ending in \n 2010-07-09 15:24:24 +02:00
Ole Tange 3b8e04b91b More intelligent determining the max line length. 2010-07-09 14:53:56 +02:00
Ole Tange 39d1c6bfa6 De-camelcased sub names 2010-06-27 03:09:28 +02:00
Ole Tange c8c60db5bf Added comments for return statements 2010-06-26 22:30:14 +02:00
Ole Tange 9fd660be71 Bugfix: The length for -X is not close to max (131072) 2010-06-26 01:56:14 +02:00
Ole Tange a0f4c5e4d9 Unittest for --interactive. Added --eta. Updated to version 20100620. 2010-06-22 15:24:55 +02:00
Ole Tange c81a15677d Some systems does not receive the SIGCHLD (maybe when running under
/bin/dash?).
Unittest failed if /bin/sh was dash.
2010-06-16 05:03:52 +02:00
Ole Tange 167332902b --progress implemented.
Fixed bug if transfered file contains :.
2010-06-15 00:05:47 +02:00
Ole Tange 847e972912 -L, -l, --max-lines, and -x pass unittest. 2010-06-13 01:24:25 +02:00
Ole Tange c01590571d --basefile initial version 2010-06-10 00:39:35 +02:00
Ole Tange 27f2829f05 Implemented --halt-on-error.
Make exit status more consistent.
2010-06-09 22:26:59 +02:00
Ole Tange 87b68365dd Update of man page and documentation 2010-06-08 16:13:20 +02:00
Ole Tange 091383c4ab Cleanup for 20100601 release 2010-06-06 01:03:39 +02:00
Ole Tange e99bdb0b82 Implemented --controlmaster. It fails under stress, so experimental and no unittest 2010-06-01 03:31:46 +02:00
Ole Tange d7be89d786 parallel.html: Added build target 2010-04-28 13:37:34 +02:00
Ole Tange 2b48b700c9 More thorough documentation of releasing a new version 2010-04-27 00:52:13 +02:00
Ole Tange 00d9382abd First GNU release done 2010-04-26 13:24:56 +02:00
Ole Tange 1a0103da04 Minor cleanup 2010-04-19 09:07:12 +02:00
Ole Tange 3fa2a4a8d4 Implemented automake
Prepared for name change to 'par'
2010-04-18 16:18:31 +02:00