tange/parallel
1
0
Fork 0
mirror of https://git.savannah.gnu.org/git/parallel.git synced 2024-11-30 01:47:56 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
367 commits 1 branch 311 tags 27 MiB
Commit graph

266 commits

Author SHA1 Message Date
Ole Tange 11b21d638c -l 0 no longer works (and never will) because of --tollef. 
exponential backoff in --semaphore mode.
--regexp test.
testsuite passes.
 2011-03-01 23:04:15 +01:00
Ole Tange 69201240dc parallel: manpage update for -l 0 -L 0 -n 0, and -N 0. 2011-02-23 16:22:08 +01:00
Ole Tange ff48e14301 parallel: -l 0 -L 0 -n 0, and -N 0 implemented. Passes some tests. Man page missing. 2011-02-23 16:01:18 +01:00
Ole Tange bad6dd4787 Fixes bug #32563: includes testsuite. 2011-02-21 22:29:55 +01:00
Ole Tange c535c25450 parallel: implemented /etc/parallel/config. Passes testsuite. 2011-02-21 02:31:30 +01:00
Ole Tange b7d707b346 parallel: Implemented --gnu and --tollef. Passes at least some tests. 2011-02-18 15:23:00 +01:00
Ole Tange 9cc892faf2 Released as 2011-02-05 FOSDEM 2011-02-17 17:23:38 +01:00
Ole Tange ad61df30f0 parallel: implemented --regexp. Prepended 'parallel:' to warnings 2011-02-02 16:36:29 +01:00
Ole Tange cb468fb6d3 Passes testsuite. 2011-01-27 22:56:59 +01:00
Ole Tange f63347b070 --recend and --recstart are now fixed strings instead of regexp for performance reasons 2011-01-27 22:05:34 +01:00
Ole Tange b0afcf9fa4 parallel --pipe: Do not pipe 0-length input to children 2011-01-27 18:53:57 +01:00
Ole Tange c9d95b0627 Small optimization for large --blocksize for --pipe. 
Fixed bug in FreeBSD cpu/core detection.
 2011-01-27 00:29:28 +01:00
Ole Tange 6f78fafc20 Chris Howey <howeyc@gmail.com> says: Finding the number of cores does 
not seem to be correct on FreeBSD (at least for me).
 2011-01-26 00:49:04 +01:00
Ole Tange 9a4522675c parallel: added --rrs with test. Passes testsuite. 2011-01-26 00:45:00 +01:00
Ole Tange 5a098fa66b parallel: Bugfix for Mac OS X: $SIG{TERM} is undef 2011-01-25 15:32:41 +01:00
Ole Tange 76d9e4f41b -N for --pipe. Fixed race condition in --pipe. 
Tests for --pipe. Passes testsuite.
 2011-01-24 20:06:30 +01:00
Ole Tange d5c7399d5b Released as 20110122 2011-01-22 23:40:15 +01:00
Ole Tange 686c549e05 Update copyright notice 2011-01-21 19:07:03 +01:00
Ole Tange 495d832a73 Conflict resolved 2011-01-21 19:03:12 +01:00
Ole Tange 0be50427fb Fix https://savannah.gnu.org/bugs/index.php?32191 2011-01-21 18:50:23 +01:00
Ole Tange 0247e4beee --spreadstdin now forks a new child for each block. 2011-01-19 16:25:25 +01:00
Ole Tange 1d45092522 parallel: simple test for --spreadstdin. 
--recstart and --recend implemented.
Time::Hires no longer needed.
 2011-01-18 23:56:28 +01:00
Ole Tange 48454a36ea parallel: --joblog implemented. Testsuite missing. 
--spreadstdin prototype. Testsuite missing.
 2011-01-18 18:15:42 +01:00
Ole Tange 42a5f4e0cc testsuite passes. 
max_jobs_running could be resat if -j is a changed file.
dummy children was not killed if cmd line was too long.
default number of jobs for --semaphore set to 1.
test25 had race condition.
test22 -j10 added.
test13 -j9 added.
test47 remote cleanup added before test.
test17 remote cleanup added before test.
 2011-01-17 13:38:58 +01:00
Ole Tange 3ee7f79325 0install wants compiled man pages to be distributed. *.1 are now distributed. 
More tests from test suite passes - though not all.
 2011-01-11 13:42:14 +01:00
Ole Tange 1cc9c990a4 parallel: fixed: seq 9 | parallel -N 10 echo 2011-01-05 18:10:58 +01:00
Ole Tange e51bc579c8 parallel: implemented basic --joblog Bug#31858 2011-01-05 14:46:45 +01:00
Ole Tange 57cf4df2bc parallel: alpharelease. Distribute args between jobslots for -X. -j+0 now default. 2011-01-02 01:01:21 +01:00
Ole Tange 39526ff1fe sem: Problem if ~/.parallel does not exist. Fixed. 2010-12-22 10:21:58 +01:00
Ole Tange ef812dd02a Released as 20101222 2010-12-21 21:10:44 +01:00
Ole Tange a16d120711 Implemented --tty as the old default of assigning a tty to the first 
job causes problems.
Cleanup if --workdir <> . did not work. Fixed.
 2010-12-21 18:08:16 +01:00
Ole Tange ec51739620 parallel: Removed some global variables. Code cleanup. 2010-12-19 12:58:36 +01:00
Ole Tange 27822174c2 parallel: Fixed --retries bug. Passes testsuite. 2010-12-19 01:38:36 +01:00
Ole Tange 604ac1c422 parallel.pod: Elaboration on QUOTING 2010-12-16 00:25:41 +01:00
Ole Tange 5a87ded0d1 parallel: Man page for --dry-run. Small bug fixes. 2010-12-16 00:12:02 +01:00
Ole Tange bff9531219 parallel: --dryrun implemented. --return of multiple files with 
-X. --return of files containing space. Passes testsuite.
 2010-12-14 09:40:42 +01:00
Ole Tange 3b3c344097 parallel: pod-file now separated (it became too big). 
niceload: rewritten to GetOpt and first testsuite.
 2010-12-07 00:30:08 +01:00
Ole Tange ed6181773e parallel: warnings are now sent directly to stderr and not cached. 
Test of --tmpdir works.
Testsuite passes.
 2010-12-05 23:58:22 +01:00
Ole Tange f3b7af993a parallel: passes unittest 2010-12-04 15:47:01 +01:00
Ole Tange 01f3a08b55 parallel: --load implemented and documented. How do to testsuite? 2010-12-04 14:14:28 +01:00
Ole Tange e907f723e7 parallel: Code cleanup 2010-12-04 04:06:27 +01:00
Ole Tange 0b31661e8e parallel: --load implemented but not tested. Testsuite passes. 2010-12-03 16:48:49 +01:00
Ole Tange baba462a0d parallel: implemented --nice 2010-12-03 15:22:01 +01:00
Ole Tange f64af319bd niceload: Initial GNU version. 2010-12-03 14:42:22 +01:00
Ole Tange bb2a3ae5bc parallel: added --tmpdir. 2010-12-03 14:08:40 +01:00
Ole Tange 310ddc31ee Fixed #31664: Implement {/} as basename 2010-12-03 00:10:05 +01:00
Ole Tange 77f83e6270 basenamereplace and basenameextensionreplace activated. 
Testsuite of {/} {/.} {#/.} {#/}.
 2010-12-03 00:04:12 +01:00
Ole Tange 69e7da5bff Released as 20101202. 
Debian packaging rolled back.
 2010-12-02 21:58:10 +01:00
Ole Tange 4d22781652 --command, -c, --file, and -f now obsoleted. --eta works again. 
Bugfix in testsuite for --retries.
Lots of dead code removed.
 2010-11-29 23:59:16 +01:00
Ole Tange 46cc1980fa parallel: --progress to STDERR. Test of -M. 2010-11-28 04:11:45 +01:00
Ole Tange 16bf961945 parallel: Now passes test32. test34 has an insignificant warning. 2010-11-28 02:09:53 +01:00
Ole Tange ae08cc3b1c parallel: SSHLogin rewritten to OO. Minor failures in test32 and test34. 2010-11-26 01:45:04 +01:00
Ole Tange 364c394df2 parallel: Speedup of arg processing. 
Removing dead code.
 2010-11-23 01:40:50 +01:00
Ole Tange 8865cbb10f parallel: Argument handling re-written to OO. 
The code is quite messy, the implementation is fairly slow, but the
structure seems sound and it passes the testsuite.
basename {/} and {/.} implemented.
Flushing of STDERR and STDOUT after each job completes.
 2010-11-22 10:35:53 +01:00
Ole Tange f7355734a5 Released as 20101113. Test to be compatible with old perllibs 2010-11-15 22:46:36 +01:00
Ole Tange 4ed346760b parallel: GetOptionsFromArray is not supported everywhere 2010-11-15 20:14:27 +01:00
Ole Tange d7c87979f9 Merge branch 'master' of ssh://newton.binf.ku.dk:24222/home/tange/privat/parallel 2010-11-13 17:33:02 +01:00
Ole Tange f5cb948f95 Fixed version 2010-11-13 17:28:35 +01:00
Ole Tange 90c333085d Release candidate 20101113 2010-11-13 14:57:39 +01:00
Ole Tange 0f9e570d7a parallel: Added man page for (unimplemented) basename 2010-11-09 18:09:33 +01:00
Ole Tange 7c1fb94ddb Merge branch 'master' of ssh://newton.binf.ku.dk:24222/home/tange/privat/parallel 2010-11-02 23:39:25 +01:00
Ole Tange 12596830ce parallel: Better example in man page: Use multiple inputs in one command 2010-11-02 23:36:12 +01:00
Ole Tange ea0dfc913e parallel: Implemented --profile. Untested. 2010-11-02 17:11:32 +01:00
Ole Tange 0f094ba5b2 Bugfix: sprintf used %d with no matching argument 2010-10-31 03:11:18 +01:00
Ole Tange f085a37a40 parallel: Implemented $PARALLEL_SEQ and $PARALLEL_PID. 
-v now only show the command to be run. Use -vv to see the surrounding ssh wrapping.
--workdir implemented. Spelling mistakes.
 2010-10-27 01:50:58 +02:00
Ole Tange 87747a44b4 parallel: Too slow spawning only gives a warning, not an error. 
.parallelrc is now read along with .parallel/config.
Passes testsuite.
 2010-10-14 23:13:48 +02:00
Ole Tange 428faf33b7 parallel: Bugfix: empty line and --colsep 2010-10-09 21:55:01 +02:00
Ole Tange cce81b5735 parallel: implemented -j file. Passes testsuite. 2010-10-06 22:18:32 +02:00
Ole Tange 44bdda5387 parallel: Give warning if stdin is tty 2010-10-06 20:29:16 +02:00
Ole Tange 692bb88453 parallel: EXAMPLE: Start editor with filenames from stdin (standard input). 
parallel: EXAMPLE: GNU Parallel as queue system/batch manager.
 2010-10-05 22:22:52 +02:00
Ole Tange 6f03760b56 sql: \n and \x0a in arguments is replaced with newline. Passes unittest. Added more examples. 2010-09-22 23:54:42 +02:00
Ole Tange e06f6d52ce parallel: Added difference between paexec 2010-09-22 01:17:05 +02:00
Ole Tange 59cb631264 Bugfix: --keeporder with -j100% mixed up order of first job 
parallel: Unittest for --retries. Passes unittest.
 2010-09-21 22:00:30 +02:00
Ole Tange 2e572c00c9 parallel: --retries implemented. Passes unittest. 2010-09-21 09:34:53 +02:00
Ole Tange 8703e6b5c5 sql: --list-tables implemented. %-encode all elements of DBURL. 
Passes sql-part of unittest.
 2010-09-15 00:24:08 +02:00
Ole Tange 28f9796b4e sql: Each arg on command line will add a \n. Useful for Oracle 2010-09-14 23:25:53 +02:00
Ole Tange 22934a4bcd sql: Deal with :aliases containing ?query parts in batch mode. 
:aliases?query is still a problem in interactive mode.
Passes sql-part of unittest.
 2010-09-14 18:37:26 +02:00
Ole Tange e63e97916c sql: RFC3986 calls the statement part a query. Let's do that, too. 
sql: test sql02 and results.
 2010-09-10 00:58:34 +02:00
Ole Tange 944a4fdd4f sql: alias can now contain statement 2010-09-10 00:37:32 +02:00
Ole Tange c9b2a3f727 sql: Test of %-quoting. 
sql: Test of cyclic aliases.
 2010-09-10 00:18:43 +02:00
Ole Tange 9711803e61 sql: allow dburl prefix 'sql:' 2010-09-09 23:30:56 +02:00
Ole Tange 0db41520c3 sql: basic dburl?sqlstatement works. No unittest 2010-09-09 23:21:11 +02:00
Ole Tange ffd548e168 sql: sqlite implemented. sql unittest passes. 2010-09-09 09:39:57 +02:00
Ole Tange 20eab02de2 parallel: --hashbang alias for --shebang. 
sql: .dburl.aliases -> .sql/aliases.
unittest passes.
 2010-09-08 01:43:11 +02:00
Ole Tange 0a5434c071 sql: renamed .dburl.aliases to .sql/aliases and /etc/sql/aliases. 
Fixed bug if DBURL is NULL.
 2010-09-07 13:15:29 +02:00
Ole Tange 6383459ddb Makefile for Debian package 2010-09-07 00:15:53 +02:00
Ole Tange 9b4f83dd59 Released as 20100906 2010-09-06 00:48:28 +02:00
Ole Tange 847841aa11 BSD xargs -o (open /dev/tty) is now default for the job running in foreground. 
Useful for: ls | parallel -Xuj1 vi.
Unittest for tty commands using the command 'script'.
 2010-09-05 12:22:08 +02:00
Ole Tange 32a3f8340b sql: Added unittest, --shebang, --version, --help. 
parallel: bugfix in unittest.
Passes unittest
 2010-09-01 15:26:45 +02:00
Ole Tange 16939a0fa6 --shebang implemented. Unittest passes. 2010-08-28 02:46:44 +02:00
Ole Tange 6ad5f9f693 Added: sql - a small script to access sql bases from the command line 2010-08-27 21:16:06 +02:00
Ole Tange b26dbadcc0 Bugfix: --eta/--progress with 0 jobs gave division by zero. 
Bugfix in Makefile by Piotr Jaroszyński <p dot jaroszynski at gmail dot com>
 2010-08-26 20:03:59 +02:00
Ole Tange 0541bdf9ce Makefile bugfix by: Piotr Jaroszyński p dot jaroszynski at gmail dot com 2010-08-25 16:44:55 +02:00
Ole Tange 8f9038909a Bugfix: make -j2 fails because 'rm pod2htm*' fails. 2010-08-23 13:33:55 +02:00
Ole Tange 97ed1a37e5 Released as 20100822. 2010-08-22 11:00:52 +02:00
Ole Tange 8dcde6b058 A (crappy) example of sem usage. 2010-08-22 02:51:51 +02:00
Ole Tange 0fbd1b2653 --eta was broken. Now fixed. 
Race condition in sem fixed with setsid().
Passes unittest.
 2010-08-22 01:29:26 +02:00
Ole Tange adff24a1a0 Work around for race condition. Comparison table. 2010-08-17 16:25:40 +02:00
Ole Tange 47cf0f0128 Code cleanup. POD file for mini man page for sem 2010-08-17 08:53:46 +02:00
Ole Tange c7eeac015b --semaphore implemented. Unittest passes. 2010-08-17 00:25:11 +02:00
Ole Tange 94b1c3ec57 Semaphore supporting code. Passes unittest 2010-08-16 18:46:30 +02:00
Ole Tange ac16e65b8a Unittest for sem 2010-08-16 16:16:56 +02:00
Ole Tange 422578c103 Added sem - semaphore for executing shell command lines in parallel 2010-08-15 23:33:49 +02:00
Ole Tange 48c89d6929 Added --sshloginfile .. or -S .. means use ~/.parallel/sshloginfile. 
Changed .parallelrc to .parallel/config to avoid having two files in ~/
 2010-08-14 22:51:09 +02:00
Ole Tange a038ade0de More examples 2010-08-14 20:39:33 +02:00
Ole Tange fcbfd19220 Example for manual. Bug fix. More unittests. 2010-08-01 20:09:31 +02:00
Ole Tange ab4133d44d Better reading of columns fixed a few bugs. Passes unittest. 2010-07-31 23:19:48 +02:00
Ole Tange 0d1711afbf Code reformatting to make it more outline-mode friendly 2010-07-31 15:05:50 +02:00
Ole Tange 7dd8543a71 Added dummy: packager/0install/parallel.xml 2010-07-31 11:50:46 +02:00
Ole Tange 0d1c249a1a --trim implemented. Unittest passes 2010-07-29 11:39:02 +02:00
Ole Tange 5fea6dfd98 --colsep implemented. Unittest for --colsep missing, but old unittest passes. 2010-07-23 00:39:51 +02:00
Ole Tange e8a30d9fac Code refactor: move :::: and ::: processing. 2010-07-21 13:47:59 +02:00
Ole Tange cc825a2cd3 Unittest for multi file input: cat {2} {1} :::: file1 file2 2010-07-18 15:47:59 +02:00
Ole Tange 611e7db260 Added basic xargs-test. Passes unittest 2010-07-18 04:17:49 +02:00
Ole Tange 757dddaf6c Bugfix: Race condition giving segfault rarely 2010-07-18 00:06:07 +02:00
Ole Tange cf05dae1b1 Implemented {#.} and unittest. 2010-07-14 23:33:38 +02:00
Ole Tange 248fa1c940 Unittest for multiple -a. Code refactor. 2010-07-14 21:54:33 +02:00
Ole Tange 3adfc665f1 Multiple -a implemented. No unittests. 2010-07-14 12:20:32 +02:00
Ole Tange 914df8e1e7 Implemented ::::. 
FIXED BUG: Dependent quoting of arguments after :::.
 2010-07-14 12:00:10 +02:00
Ole Tange e33b8e0d01 FIXED BUG: Negaive time: time parallel -j+0 --eta -Sserver1,server2,server3,: \ 
+--transfer --return {.}.bz2 --cleanup 'zcat {} | bzip2 -9 > {.}.bz2' ::: *gz.
FIXED BUG: echo "foo,bar,baz" | parallel -d, -L 1 echo.
 2010-07-13 21:24:03 +02:00
Ole Tange ff229d0bd4 Easier calc of max_command_length. 
Convert Global:: to Private::.
Bugfix: ETA for args given on command line.
 2010-07-09 22:37:45 +02:00
Ole Tange c4678b726d Unittest passes. 2010-07-09 16:25:33 +02:00
Ole Tange 555436f746 Unittest: -0 on filenames ending in \n 2010-07-09 15:24:24 +02:00
Ole Tange 3b8e04b91b More intelligent determining the max line length. 2010-07-09 14:53:56 +02:00
Ole Tange ccd17d35c5 --arg-sep and ::: implemented. 2010-07-09 14:10:22 +02:00
Ole Tange 39d1c6bfa6 De-camelcased sub names 2010-06-27 03:09:28 +02:00
Ole Tange c8c60db5bf Added comments for return statements 2010-06-26 22:30:14 +02:00
Ole Tange 9fd660be71 Bugfix: The length for -X is not close to max (131072) 2010-06-26 01:56:14 +02:00
Ole Tange b9156bb000 --max-line, -l, -L, --max-args, -n, --max-chars, -s now implies -X unless -m is set 2010-06-25 23:14:15 +02:00
Ole Tange d32787376a Fixes: bash -c 'parallel -a <(seq 1 3) echo' 2010-06-25 23:12:28 +02:00
Ole Tange a0f4c5e4d9 Unittest for --interactive. Added --eta. Updated to version 20100620. 2010-06-22 15:24:55 +02:00
Ole Tange c81a15677d Some systems does not receive the SIGCHLD (maybe when running under 
/bin/dash?).
Unittest failed if /bin/sh was dash.
 2010-06-16 05:03:52 +02:00
Ole Tange 167332902b --progress implemented. 
Fixed bug if transfered file contains :.
 2010-06-15 00:05:47 +02:00
Ole Tange 847e972912 -L, -l, --max-lines, and -x pass unittest. 2010-06-13 01:24:25 +02:00
Ole Tange 47153f2bae --basefile fixed bug for sshlogin ':' 2010-06-10 03:24:53 +02:00
Ole Tange db1f767749 --basefile no longer breaks old tests 2010-06-10 01:56:51 +02:00
Ole Tange c01590571d --basefile initial version 2010-06-10 00:39:35 +02:00
Ole Tange 27f2829f05 Implemented --halt-on-error. 
Make exit status more consistent.
 2010-06-09 22:26:59 +02:00
Ole Tange 87b68365dd Update of man page and documentation 2010-06-08 16:13:20 +02:00
Ole Tange 091383c4ab Cleanup for 20100601 release 2010-06-06 01:03:39 +02:00
Ole Tange fee1dae246 Look for options in ~/.parallelrc and $PARALLEL 2010-06-04 02:16:50 +02:00
Ole Tange e99bdb0b82 Implemented --controlmaster. It fails under stress, so experimental and no unittest 2010-06-01 03:31:46 +02:00
Ole Tange b52c1e43df PPSS examples with equivalent GNU parallel syntax 2010-06-01 01:11:28 +02:00
Ole Tange bbb1662979 Man page updated 2010-05-31 01:35:52 +02:00
Ole Tange fd44e4c793 --use-cpus-instead-of-cores implemented with unittests. 
More unittests for remote usage (--trc, myssh, and newline files)
 2010-05-31 00:30:01 +02:00
Ole Tange ca4e58fbaf Added warning if --trc/--transfer/--return without -S. 
Added warning if --transfer and file unreadable.
Unittest of transfering of filename with \n passes.
 2010-05-28 00:34:00 +02:00
Ole Tange 55fa0189fb Bug and stress fixes for --sshlogin. Better unittests. 2010-05-27 08:09:28 +02:00
Ole Tange 26868cdc4f src/parallel: --trc works for minimal examples. 2010-05-24 02:48:40 +02:00
Ole Tange fc7fba878b src/parallel: Number of remote CPUs now detected. 
Potential bug: If max_command_length is different on the machines.
 2010-05-17 08:41:28 +02:00
Ole Tange d26f62a363 src/parallel: sshlogin now passes unittest. 
Number of jobs to run on remote hosts is calculated wrongly.
 2010-05-16 15:46:32 +02:00