tange/parallel
1
0
Fork 0
mirror of https://git.savannah.gnu.org/git/parallel.git synced 2024-11-22 14:07:55 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
808 commits 1 branch 309 tags 26 MiB
Commit graph

601 commits

Author SHA1 Message Date
Ole Tange 2c587e4055 parallel: Indention. 2013-08-21 17:11:25 +02:00
Ole Tange 81a8a116b7 parallel: --pipe can now only read from STDIN. 2013-08-21 17:04:33 +02:00
Ole Tange 73c7f844d7 testsuite: --shebang-wrap for Octave, Python. Perl, GnuPlot, R, Ruby, Bash. 
10seconds_install: Try curl.
Makefile: parallel.html dependency.
parallel: Printing joblog => print_joblog.
parallel.pod: Removed TinyOgg.
testsuite: Minor fixups.
 2013-08-19 11:15:39 +02:00
Ole Tange af33d66225 Makefile bug. 2013-08-17 18:48:50 +02:00
Ole Tange f0e72377ea parallel_tutorial.pod forgotten. 2013-08-17 18:46:12 +02:00
Ole Tange bcd08d5a2c parallel_tutorial added to git. 2013-08-17 18:43:30 +02:00
Ole Tange 6961852117 Fixed --header bug for multiline headers. +testsuite. 
Allow for --timeout 200.5% (float).
--workdir . --transfer fixed.
 2013-08-17 18:24:51 +02:00
Ole Tange be6fe3846f parallel: Bugfix for -k --timeout used in --filter-host. 
--sshloginfile is now searched for in . too.
--timeout more efficient.
Passes testsuite.
 2013-08-16 13:11:35 +02:00
Ole Tange 96ba577d85 src/parallel: Fixed bug #39787: --xargs broken; incl test. --delay fixed; incl test. 2013-08-15 19:38:39 +02:00
Ole Tange ee529c2d2a parallel: --record_env and --env _ implemented. Passes test suite. 2013-08-14 20:11:00 +02:00
Ole Tange 88540d06a7 testsuite bug #39572: --tty and --joblog do not work. 
Passes local testsuite.
 2013-07-30 21:21:08 +02:00
Ole Tange 5b16a482e4 src/parallel: Inplemented --linebuffer. 2013-07-30 17:13:31 +02:00
Ole Tange c52acfb001 parallel.pod: Fixed bug #39406: F19 - pod2man only accepts text not numbers after =item. 2013-07-26 14:58:42 +02:00
Ole Tange 3f0c1c9b34 parallel: Fixed bug #39572: --tty and --joblog do not work 2013-07-26 14:55:51 +02:00
Ole Tange 92773c7899 Merge branch 'master' of git.sv.gnu.org:/srv/git/parallel 2013-07-24 15:26:41 +02:00
Ole Tange a73f2e3c4d parallel: 225MB/s with: parallel -j4 --block 100M --pipe --round wc -l 2013-07-24 15:25:40 +02:00
Ole Tange 7b9928c32a Released as 20130722 ('Engelbart'). 2013-07-22 12:54:02 +02:00
Ole Tange 2deef988c7 Released as 20130720 alpha. 2013-07-20 17:33:26 +02:00
Ole Tange dd1a637822 parallel: Use file descriptors instead of STDOUT/STDERR. 
Fixed up Polarhome tests.
Passes testsuite.
 2013-07-19 19:13:00 +02:00
Ole Tange 9e3777be3c Merge branch 'master' of ssh://git.sv.gnu.org/srv/git/parallel 2013-07-18 22:10:38 +02:00
Ole Tange 7166c90f98 parallel: initial --round-robin (blocking and inefficient). 2013-07-18 12:57:52 +02:00
Ole Tange fe3affd3cb Merge branch 'master' of ssh://git.sv.gnu.org/srv/git/parallel 2013-07-17 23:26:17 +02:00
Ole Tange 895d84af65 parallel: export of bash functions to remote servers working. 2013-07-17 15:05:39 +02:00
Ole Tange 81b767d324 parallel: Fixed bug #39507: --env does not support newlines in variables. 2013-07-17 11:33:19 +02:00
Ole Tange d3a9292b2a parallel: Treat STDOUT and STDERR as fd{1} and fd{2}. Find all shell opened file descriptors. 2013-07-14 13:22:56 +02:00
Ole Tange 56e5118535 src/parallel: Deal with unset $HOME. 2013-07-12 21:19:53 +02:00
Ole Tange 111fa14f57 testsuite: ### bug #39360: --joblog does not work with --pipe. 2013-07-04 17:31:36 +02:00
Ole Tange f1770d7a0f Merge branch 'master' of git.sv.gnu.org:/srv/git/parallel 2013-07-04 11:22:33 +02:00
Ole Tange 0a466e072d src/parallel: --joblog now with --pipe. 2013-07-04 11:22:00 +02:00
Ole Tange c1f6354375 parallel: Re-fixed bug #37042: -J foo is taken from the whole command line - not just the part before the command 2013-07-04 00:50:08 +02:00
Ole Tange ea151d0837 Fixed bug #37042: -J foo is taken from the whole command line - not just the part before the command. 
Adjusted --load to only look every 10 seconds.
 2013-07-02 21:45:18 +02:00
Ole Tange 194db8b7da Released as 20130630 alpha. 2013-06-30 20:38:44 +02:00
Ole Tange b6e210af96 src/parallel: If --filter-hosts (and thus time_to_login) do not try to find the ssh spawning limit. 2013-06-30 20:09:02 +02:00
Ole Tange 822f0d4d73 src/parallel: --filter-host is now much faster. 2013-06-30 18:11:36 +02:00
Ole Tange 14b15f3d43 src/parallel: Fixed --filter-hosts. Bug due to --joblog - not working. 2013-06-26 16:07:14 +02:00
Ole Tange 85ab036518 Released as 20130622 ('Snowden'). 2013-06-22 14:50:48 +02:00
Ole Tange 301709bde9 parallel: --xapply now recycles arguments if an input source has more arguments than others. 2013-06-06 00:37:38 +02:00
Ole Tange 85ab16e26a parallel: Exponential backoff and backon sleep between jobs. 2013-05-26 08:26:18 +02:00
Ole Tange e377032c5d parallel: Work around for "tcgetattr: Invalid argument" in old OpenSSHs. 2013-05-22 00:29:41 +02:00
Ole Tange e5853b7fbb niceload: darwin version of --io --mem --swap. 
Thanks to Anders F Björklund afb.users.sourceforge.net
 2013-05-20 17:04:23 +02:00
Ole Tange 0608b23da3 Passes testsuite. 2013-05-16 22:49:17 +02:00
Ole Tange 5b0be9941c parallel: Code cleanup. Passes local testsuite. 2013-05-11 12:53:17 +02:00
Ole Tange ff813d52ce parallel: Fixed bug when distributing round robin. 2013-05-11 10:45:27 +02:00
Ole Tange 2b48812915 parallel: test distribute jobs round robin between --sshlogins. 2013-05-07 01:37:05 +02:00
Ole Tange ee30290b9a parallel: Median time implemented using remedian. 2013-04-30 01:36:07 +02:00
Ole Tange eac8d05e3a parallel: --timeout 200% implemented. Test missing. 2013-04-29 00:43:43 +02:00
Ole Tange 780f50c654 parallel: If not using --pipe, --ctrlc is now default. 2013-04-27 11:09:46 +02:00
Ole Tange 18fbd383c7 Merge branch 'master' of ssh://git.sv.gnu.org/srv/git/parallel 
Conflicts:
	README
 2013-04-26 20:17:06 +02:00
Ole Tange 865f83c4fb Released as 20130422 ('Boston'). 2013-04-21 23:33:02 +02:00
Ole Tange 6e8247d6d1 parallel: bug with --dryrun and virgin jobs. 2013-04-11 21:54:57 +02:00
Ole Tange 0706a95802 testsuite: Polarhome added. 2013-04-08 21:17:59 +02:00
Ole Tange 23636ee688 parallel: Implemented --ctrlc which will send SIGINT to remote tasks. 2013-04-08 20:35:57 +02:00
Ole Tange d995f43347 parallel: CPU detection on SCO OpenServer 2013-04-07 15:03:31 +02:00
Ole Tange 56a5429cce parallel: CPU detection for HURD, IRIX, (old) HPUX. 2013-04-07 14:00:48 +02:00
Ole Tange 828843fa15 testsuite: --env test now much faster. 
parallel: Small code cleanup.
 2013-03-24 19:36:56 +01:00
Ole Tange 02d6dcece5 Merge branch 'master' of ssh://git.sv.gnu.org/srv/git/parallel 2013-03-24 17:25:34 +01:00
Ole Tange 851ede9f92 parallel: quoting works with old rsyncs. --retries works with --onall. 2013-03-24 16:35:42 +01:00
Ole Tange 7a8bd820ac src/parallel: If --load is a file: Recheck it every time max_loadavg is called. 2013-03-23 21:36:17 +01:00
Ole Tange 3d26864477 src/parallel: family_pids were incompatible with FreeBSD 7 and CentOS 3. 2013-03-23 14:33:12 +01:00
Ole Tange e14d8f9586 src/parallel: transfer of relative files on systems without /./ capable rsync. 2013-03-23 11:46:47 +01:00
Ole Tange 3615f0b473 parallel: --remove-source-files is not supported on old rsync. 2013-03-23 10:18:35 +01:00
Ole Tange 12897fe3c2 src/parallel: --load on remote machines fixed. --nice uses \nice for tcsh and remote machines with differerent path to nice. 2013-03-23 09:49:08 +01:00
Ole Tange 204da584b6 Documentation update. 2013-03-12 10:17:55 +01:00
Ole Tange 9ca429b5ce parallel: HPUX CPU/core detection. Thanks to Javier Tarradas. 2013-03-08 09:49:01 +01:00
Ole Tange 635e5081d6 parallel: Experimental bug #37620: alternative instant --load calculation using ps 2013-03-07 01:54:38 +01:00
Ole Tange 3b752a668c Fixed bug #38441: CPU usage goes to 100% if load is higher than --load at first job. 2013-03-07 00:16:53 +01:00
Ole Tange 7bfb4a5e57 Merge branch 'master' of ssh://git.sv.gnu.org/srv/git/parallel 2013-03-04 21:51:23 +01:00
Ole Tange 93dd376c69 Fixed bug #38439: "open files" with --files --pipe blocks after a while. 2013-03-04 21:50:51 +01:00
Ole Tange d5fa05b425 Fixed bug #38354: -J profile_name should read from pwd/profile_name before ~/.parallel/profile_name 2013-03-03 13:45:31 +01:00
Ole Tange e80881ab49 parallel.pod: Example of --wd. 2013-02-22 15:01:46 +01:00
Ole Tange fc883b4be6 Released as 20130222 ('Chelyabinsk'). 2013-02-21 23:55:07 +01:00
Ole Tange 5c89af948e Code cleanup + man page updates. 2013-02-21 23:36:14 +01:00
Ole Tange 07c5b5c704 parallel: Obsoleted --tollef. To be retired 20140222. 2013-02-18 00:59:59 +01:00
Ole Tange 21c62a2545 Small adjustments. Passes testsuite. 2013-02-14 23:08:17 +01:00
Ole Tange cf38b9078c parallel: --keep-order --resume-failed works. 2013-02-13 01:15:37 +01:00
Ole Tange f948768a1f parallel: Negative positional arguments (no context. No -X). 2013-02-12 21:52:01 +01:00
Ole Tange c0b620c832 parallel: Added support for negative positional replacement strings {-1}. 2013-02-12 21:22:24 +01:00
Ole Tange 1de3edfb57 parallel: --resume-failed works with --pipe. 2013-02-11 23:47:11 +01:00
Ole Tange 42751ae6a9 parallel: Implemented --resume-failed. 2013-02-10 23:22:53 +01:00
Ole Tange 55ad133f46 parallel: Stop looping in --pipe if this reads 0 bytes. 2013-02-10 13:32:50 +01:00
Ole Tange 0be46ce826 Merge branch 'master' of ssh://git.sv.gnu.org/srv/git/parallel 2013-02-10 11:09:12 +01:00
Ole Tange 7cf332ecc0 parallel: NetBSD CPU detection. 2013-02-07 11:10:20 +01:00
Ole Tange 819c82de3c parallel: Increase --blocksize exponentially if it is < 1 record. 2013-02-05 22:17:36 +01:00
Ole Tange 9e0541c95a testsuite: Passes testsuite. 'timeout' removed as it did not work. 2013-02-04 22:39:32 +01:00
Ole Tange 193935f0e5 parallel: More efficient --pile -L. Passes testsuite-local. 2013-02-02 22:20:36 +01:00
Ole Tange 1156a6ee75 $opt::n => $opt::max_args, $opt::N => $opt::max_replace_args. 2013-02-01 20:24:55 +01:00
Ole Tange ba060304f6 Released as 20130122 ('Jyoti Singh Pandey'). 2013-01-21 23:59:44 +01:00
Ole Tange 7dc6927898 parallel.pod: Added doc for --sshdelay. 2013-01-21 23:09:47 +01:00
Ole Tange 05e1cf9ef4 parallel: Unlink should not happen with --files. 2013-01-21 23:09:00 +01:00
Ole Tange 592a6482a8 niceload: uniq bug when pressing Ctrl-C. 2013-01-21 23:08:30 +01:00
Ole Tange cd9efa9ab8 parallel.pod: Batch jobqueue processor. 2013-01-15 00:20:59 +01:00
Ole Tange d847c932f5 Version update. Small --tty test. 2013-01-09 23:06:01 +01:00
Ole Tange e3e1345aac parallel: added --sshdelay to slow down ssh logins. 2013-01-09 23:00:07 +01:00
Ole Tange 05330bf8ea parallel: auto-unlink tmp-files so if we forget to unlink it is OK. 2013-01-08 20:41:53 +01:00
Ole Tange 40c2fcc61a niceload: undef_as_zero was in same package. 2012-12-28 21:29:09 +01:00
Ole Tange 382cea7c09 parallel: EOF wrapper for --pipe gives correct exit value. 2012-12-28 21:27:43 +01:00
Ole Tange a70b9dffaf niceload: under heavy load iostat somehow does not work. 2012-12-28 12:57:43 +01:00
Ole Tange d0ae4330ea parallel: --results with more data columns than headers caused undefined error. Fixed. 2012-12-28 11:45:31 +01:00
Ole Tange bbc9a53ea5 Fixed bug #34241: --pipe should not spawn unneeded processes. 2012-12-27 23:06:17 +01:00
Ole Tange 1cea71c611 Released as 20121222 ('End of The World'). 2012-12-22 17:23:10 +01:00
Drew Frank 42537dafee optional: update man-page description of --results to describe subdir behavior. 2012-12-21 22:02:06 -08:00
Drew Frank 701445aac6 optional: Python loader works with new --results format. 2012-12-21 20:01:23 -08:00
Ole Tange 05a08c55b6 parallel.pod: Also include error message when reporting bugs. 2012-12-20 15:01:49 +01:00
Ole Tange b6056bb876 Fixed: bug #37956: --colsep does not default to '\t' as specified in the man page. 2012-12-19 15:37:36 +01:00
Ole Tange 86808fed5d optional: --results change to '/' breaks the reading results. 2012-12-19 11:42:19 +01:00
Ole Tange 8eceb1f5b9 parallel: OpenBSD CPU detection. Thanks to Michał Markowski. 2012-12-17 01:07:20 +01:00
Ole Tange fd6044b0dc niceload: --prg implemented. 2012-12-10 23:16:25 +01:00
Ole Tange 80d83aa489 niceload: multiple -p 2012-12-10 21:57:00 +01:00
Ole Tange c6b955eb7d niceload: ::opt_ -> opt:: 2012-12-10 19:12:35 +01:00
Ole Tange 22a9ac5390 parallel: bug #37849: --results should create subdirs. With test. 2012-12-03 23:28:10 +01:00
Ole Tange 59a1d67b59 niceload: test + bugfix for --sensor 2012-12-03 00:02:51 +01:00
Ole Tange 111c7384f7 niceload --sensor ... -l with negative number means: Run if values less than number. 2012-12-02 21:11:27 +01:00
Ole Tange bc0f7701ec Implemented --delay. 2012-11-26 22:57:07 +01:00
Ole Tange d47e1306ec Fixed bug #37779: Make result file names insensitive to order of input sources when using --header 2012-11-26 21:40:26 +01:00
Ole Tange 4688ba04c9 parallel: Fixed bug #37680: --wd ... not working 2012-11-26 21:19:14 +01:00
Ole Tange 6921d28f9a parallel: Fixed bug #37325: Inefficiency of --pipe -L 2012-11-26 00:19:58 +01:00
Ole Tange cf8f1d924b parallel.pod: man page for --shebang-wrap. 2012-11-25 21:24:27 +01:00
Ole Tange a8a451c60c Fixed bug #37694: Empty string argument skipped when using --quote 2012-11-24 17:33:15 +01:00
Ole Tange d720e7959c parallel: $::opt => $opt::. Passes unittest. 2012-11-23 00:57:35 +01:00
Ole Tange eb3b6fb00e parallel --shebang-warp --pipe works. With test. 2012-11-22 23:43:49 +01:00
Ole Tange 54e3e264a3 testsuite for --shebang-wrap. :::: is suboptimal. 2012-11-22 23:19:00 +01:00
Ole Tange 007ae78c28 parallel: --shebang-wrap --pipe works in pipe and with :::: 2012-11-22 22:06:49 +01:00
Ole Tange 0b1896c368 parallel --shebang-warp for ::: works. 2012-11-22 12:10:45 +01:00
Ole Tange 45763bc601 Released as 20121122 ('Barack'). 2012-11-22 00:24:04 +01:00
Ole Tange 49675bf13a Merge branch 'master' of ssh://git.sv.gnu.org/srv/git/parallel 
Conflicts:
	src/niceload
 2012-11-21 22:55:09 +01:00
Ole Tange 7648a3c0b2 niceload: --sensor implemented. 2012-11-21 22:30:29 +01:00
Ole Tange 6748cf82c8 Unittest adapted. 2012-11-21 22:28:52 +01:00
Ole Tange 14c0f88523 src/parallel: Compatible with FreeBSD7 perl 5, version 16, subversion 2 (v5.16.2) 2012-11-20 00:31:33 +01:00
Ole Tange ce02b6f794 niceload: minimal --sensor support. 2012-11-09 16:51:38 +01:00
Ole Tange 00a2b4d119 Load avg on BSD: 
Michał Markowski says:
"uptime" output on OpenBSD and FreeBSD (so probably NetBSD and DragonflyBSD too) look similar to this:
 2:22PM  up 30 days, 13:44, 1 user, load averages: 0.06, 0.09, 0.13
 2012-10-31 21:09:47 +01:00
Ole Tange f42a5c32ba src/parallel: vmstat for 17 columns. 
Rhys Ulerich's vmstat version has 17 columns.

procs -----------memory---------- ---swap-- -----io---- --system-- -----cpu-----
 r  b swpd   free   buff    cache   si   so    bi    bo in   cs us sy id wa st
 0  0    0 587736 320220 62341788    0    0    20    36  1    1  4  0 95  0  0
 2012-10-25 01:03:59 +02:00
Ole Tange c49e7b4842 Released as 20121022 ('Hanne Vilmann'). 2012-10-23 00:05:26 +02:00
Ole Tange f6a6a35309 testsuite: niceload impoved. Fewer --env tests. 2012-10-22 23:08:54 +02:00
Ole Tange 75f54b795f testsuite: virtualbox added. Other tests made more portable. 2012-10-22 08:32:39 +02:00
Ole Tange c8e032b279 Fixed bug #37589: Red Hat 9 (Shrike) perl v5.8.0 built for i386-linux-thread-multi error 2012-10-17 20:33:49 +02:00
Ole Tange d9675d0bd0 Merge branch 'master' of ssh://git.sv.gnu.org/srv/git/parallel 
Conflicts:
	src/parallel
	testsuite/tests-to-run/parallel-local2.sh
 2012-10-17 02:16:01 +02:00
Ole Tange fcaf41b325 parallel: Fixed to pass local testsuite and some Perl::Critic issues. 2012-10-17 02:09:03 +02:00
Drew Frank d2678e53b0 python: add expected output to README example. 2012-10-15 17:12:43 -07:00
Drew Frank f76b04b181 python: add small example to README. 2012-10-15 16:34:53 -07:00
Ole Tange 42d4c35270 parallel.pod: --results example. 2012-10-16 01:24:35 +02:00
Ole Tange 4623995286 Merge branch 'master' of git.sv.gnu.org:/srv/git/parallel 2012-10-15 15:48:16 +02:00
Ole Tange dd5093f8b4 parallel: --env includes test + man and works for t?csh, too. 2012-10-15 15:47:10 +02:00
Drew Frank ed669630c6 python: process result files after metadata type inference. 2012-10-11 15:07:24 -07:00
Drew Frank b2f8450bf3 add gnuparallel python package. 2012-10-09 14:09:17 -07:00
Drew Frank 141eb4d5ea parallel: --results uses stdout\t rather than stdout_ in file names. 2012-10-05 16:33:31 -07:00
Ole Tange c60cc12b24 parallel: Fixed Perl::Critic: Loop iterator is not lexical. 2012-10-02 00:55:06 +02:00
Ole Tange a50adb5080 parallel: map rewritten as per http://perlmonks.org/index.pl?node_id=743445 2012-10-02 00:47:00 +02:00
Ole Tange 456529e046 parallel: Perl::Critic: Fewer Bareword file handles. 2012-10-02 00:13:52 +02:00
Ole Tange 09eb14e124 parallel: PerlCritic: open 2 args -> open 2 args. 2012-10-01 22:52:58 +02:00
Ole Tange b170f88593 bug #34369: GNU Parallel Bug Reports Incorrect number of jobs-completed with --progress. 2012-10-01 22:33:17 +02:00