Commit graph

621 commits

Author SHA1 Message Date
Ole Tange 1e15645faa parallel: --pipe --csv: Pass only full CSV-records. 2018-04-22 16:28:01 +02:00
Ole Tange bbcef1032c parallel: --csv initial version. 2018-04-21 21:50:42 +02:00
Ole Tange 8b050b68d4 env_parallel.*sh: Parsing 'type' depends on $LANG. Set LANG=C.
--tee: No longer spawns cat, but uses redirection instead.
2018-04-20 23:29:44 +02:00
Ole Tange 130e299af6 parallel: --timeout now gives warning.
niceload: --pid PID,PID,PID implemented.
2018-03-21 22:57:28 +01:00
Ole Tange e2792e2101 parallel --embed uses same code for all shells.
parallel --embed compatible with env_parallel, parset, env_parset.
env_parallel.* update to be more like env_parallel.sh.
2018-03-06 01:35:26 +01:00
Ole Tange eb1a79b04b Released as 20180222 ('Henrik') 2018-02-22 22:53:38 +01:00
Ole Tange e6339f4512 parset: Now a copy of env_parallel. 2018-02-22 20:43:33 +01:00
Ole Tange 6657e056f2 parallel: --nice has not been working locally since 20161022. 2018-02-05 21:39:59 +01:00
Ole Tange 78fade1e62 parallel: --embed initial version. Incompatible with env_*.
env_parallel.*: Minor bugfixes.
parallel: More commenting.
2018-01-25 03:48:16 +01:00
Ole Tange b597f4166f Released as 20180122 ('Mayon') 2018-01-22 17:23:23 +01:00
Ole Tange a048f547eb Fixed bug #52207: Exit status 0 when child job is killed, even with "now,fail=1" 2018-01-06 19:58:01 +01:00
Ole Tange bf24d5e4db Fixed bug #52769: --lb puts stdout on stderr sometimes.
Fixed bug #52507: parset arr1 -v echo ::: fails.
--dryrun should not append to joblog.
Cleaned up print_tag().
Some testsuite reorg.
2018-01-03 09:03:16 +01:00
Ole Tange d1aa26c1c9 Fixed bug #52740: Bash redirection with process substitution blocks. 2017-12-26 15:46:00 +01:00
Ole Tange da545d53ff parallel: Check if PARALLEL_SHELL is in path.
env_parallel compatible with more unices.
2017-12-23 00:01:20 +01:00
Ole Tange b843ec7398 parallel: Auto add hostgroup if given on arg. 2017-12-21 18:53:07 +01:00
Ole Tange 414667b8b4 parallel: -j1 --halt soon,fail=1 bug. 2017-12-21 18:40:03 +01:00
Ole Tange 400611158b env_parallel: which is now _which(). Bugfix for (t)csh when tempfile does not exist. 2017-12-04 22:44:34 +01:00
Ole Tange 77599baa96 env_parallel: bugfix of ash/dash/sh + increased testing. 2017-12-03 01:40:01 +01:00
Ole Tange 8f63e3f5e7 env_parallel: Aliases with newlines either supported (ash/dash/zsh) or warning (bash).
testsuite: functionized freebsd tests.
2017-12-01 20:53:56 +01:00
Ole Tange 9e5433e3e5 parset/env_parset: Support for ash, dash, ksh, sh, zsh. 2017-11-26 16:18:55 +01:00
Ole Tange c73a27254a Released as 20171122 ('Mugabe') 2017-11-22 23:29:03 +01:00
Ole Tange 746b4304a6 Passes testsuite (except polarhome). 2017-10-16 15:41:54 +02:00
Ole Tange c63881c4cc parallel: $XDG_* 2017-10-10 00:33:43 +02:00
Ole Tange f09e0384ff parallel: {choose_k} added to --plus. 2017-09-22 00:50:39 +02:00
Ole Tange 897d9f5db9 parallel: PARALLEL_RSYNC_OPTS and --rsync-opts introduced.
parallel: --bar -m bugfix.
2017-08-24 00:43:37 +02:00
Ole Tange 3eef90da33 parallel: --line-buffer speedup.
parallel: Max command line length relaxed due to bzip2'ing before transfer.
2017-08-21 23:58:53 +02:00
Ole Tange 67c4377715 parcat: --rm, reading args from stdin. 2017-08-12 18:37:52 +02:00
Ole Tange 9179a80bd3 parallel: SIGPIPE must be handled differently if printing to --pipe.
parallel: --keep-dirlinks is not supported on Centos3/Redhat9.
2017-07-21 21:43:34 +02:00
Ole Tange 8e22009706 Fixed newlines and positional replacement strings
https://lists.gnu.org/archive/html/parallel/2017-07/msg00001.html
2017-07-06 14:36:06 +02:00
Ole Tange e0baea9a4a Fixed bug #51337: --lb does not kill jobs at sigpipe. 2017-06-29 12:13:57 +02:00
Ole Tange 144164d516 Fixed bug #51299: --retry-failed with command with newline. 2017-06-23 23:00:05 +02:00
Ole Tange 215aa6039f parallel: Fixed bug #51290: Macron with -q. 2017-06-23 07:44:14 +02:00
Ole Tange f3d117e7bb parallel: Fixed bug #51293: parallel does not preserve symlinked directory structure on remote. 2017-06-22 23:14:32 +02:00
Ole Tange dce32425eb testsuite: Made the tests more portable. 2017-06-22 13:35:58 +02:00
Ole Tange 0b8e949cbb parallel: Allow for empty loadavg file. This can happen on NFS.
Passes testsuite.
2017-06-18 21:15:36 +02:00
Ole Tange fc6ad919d3 parallel: Allow \257 (Macron) in the command line. 2017-06-05 13:41:15 +02:00
Ole Tange 896f789214 Released as 20170522 ('Macron') 2017-05-21 21:04:37 +02:00
Ole Tange dd25255ca8 parallel: Fixed bug #51039: --dry-run --timeout 3600 -u breaks. 2017-05-16 21:32:13 +02:00
Ole Tange 54200832e4 parallel: --timeout can now use s=second,m=minute,h=hour,d=day.
parallel: --dr is now alias for --dry-run.
2017-05-16 01:27:11 +02:00
Ole Tange 61525c90e1 Fixed bug #51006: Slow total_jobs() eats job 2017-05-11 22:57:46 +02:00
Ole Tange a7a9e522dd Fixed bug #50901: --sqlworker should use hostname in the joblog instead of :. 2017-04-30 19:00:37 +02:00
Ole Tange 77da672741 parallel: --tmux needs LC_CTYPE set.
parallel: '--halt done'.
2017-04-22 22:42:11 +02:00
Ole Tange 426ea9b372 env_parallel.{ash,bash,dash,ksh,sh}: Fixed bug #50815: env_parallel should warn if the environment is too big.
parallel --tmux --fg: Connect to tmux socket more aggressively.
parallel --joblog: Fixed bug #50781: joblog format with multiline commands.
Irix's Perl does not have decode_base64 and is no longer supported.
2017-04-17 16:25:58 +02:00
Ole Tange 253c94786f env_parallel.bash: Initial release of parset.
parallel: Bugfix in some --plus dynamic replacement strings.
parallel: Deal better with commands containing newlines in --joblog.
parallel: Bugfix for --load in csh.
parallel_alternatives.pod: More comparison to rush-parallel.
2017-04-15 00:00:21 +02:00
Ole Tange 685018f532 Fixed bug #50719: Adjust estimate time upwards less frequently.
parallel: Introduced $PARALLEL_HOME instead of ~/.parallel.
Makefile: Added monitorman.
2017-04-04 23:17:29 +02:00
Ole Tange 70e29c7b5b Fixed bug #50685: single ::::+ does not work. 2017-04-01 04:04:47 +02:00
Ole Tange 1de0d2be9b parallel: Fixed bug #50590: Support systems where setpgrp fails. 2017-04-01 02:59:07 +02:00
Ole Tange e135fb6fd3 Fixed bug #50655: Positional dynamic replacement strings do not work. 2017-03-28 21:30:06 +02:00
Ole Tange 05afa7ec65 Fixed bug #50229: --tee -S fails.
Minor adjustments to dynamic --rpl's in --plus.
Documentation prettification for man.pdf.
2017-03-21 22:20:38 +01:00
Ole Tange d08c8ac417 parallel: --plus enables most bashisms for replacement strings. 2017-03-11 21:19:10 +01:00
Ole Tange 06e2dd958d Fixed bug #50435: Remote fifo broke in 20150522.
Fixed bug #50441: env_parallel --pipe in csh does not work.
Fixed test bug #50386: --fifo does not export function, --cat does.
2017-03-04 16:03:14 +01:00
Ole Tange 180ed0dd32 Fixed bug #50386: --fifo does not export function, --cat does.
Test broken.
2017-03-02 22:40:46 +01:00
Ole Tange 68610ea9dd Released as 20170222 ('13769') 2017-02-22 00:30:36 +01:00
Ole Tange a2358aebe4 Faster version bug #45479: --pipe/--pipepart --tee. 2017-02-05 23:53:28 +01:00
Ole Tange 70006774e8 Fixed bug #50228: --pipe --tagstring broken. 2017-02-05 03:24:23 +01:00
Ole Tange c028fa0ad7 Fixed bug #45479: --pipe/--pipepart --tee. 2017-02-05 02:46:29 +01:00
Ole Tange 1229288418 Fixed bug #50081: --keep-order --round-robin should give predictable results. 2017-02-05 00:27:10 +01:00
Ole Tange 09cc44e209 Fixed (for --retries) bug #50139: Replacement strings in other options. 2017-02-04 16:01:42 +01:00
Ole Tange dae4f4b7ca parallel: If --results {replstr} ends in /: save in dir. Otherwise save as file. 2017-01-27 23:15:25 +01:00
Ole Tange 968e2ab2bb Testsuite for bug #50107: --tmux --fg should also write how to access it. 2017-01-21 19:55:14 +01:00
Ole Tange 924a0f1aab sql: Store credentials in tmpfile instead of giving it on the command line.
parallel: Allow --block > 2GB with --pipepart.
parallel: Fixed bug #50107: --tmux --fg should also write how to access it.
2017-01-21 18:09:01 +01:00
Ole Tange 7032e5dec2 sql: Use credentials file for MySQL to avoid warning. 2017-01-17 00:16:03 +01:00
Ole Tange f3bf41f807 Fixed bug #50018: --dburl without table dies. 2017-01-14 23:36:59 +01:00
Ole Tange 61be3ff4a2 sql: Read input from STDIN, even if there is a ?query in the url. 2017-01-14 22:57:23 +01:00
Ole Tange 84f4a855a5 parallel: --sqlworker now reads everything from the database. Command+args are ignored. 2017-01-12 23:36:15 +01:00
Ole Tange dacefe9c3e Merge branch 'master' of ssh://git.sv.gnu.org/srv/git/parallel 2017-01-06 23:03:31 +01:00
Ole Tange c3dace18a2 testsuite: Added 2 tests files. 2017-01-06 22:53:21 +01:00
Ole Tange da705d03b6 parallel: If --results includes a replacement string, no tree structure with args will be generated. 2017-01-06 19:10:20 +01:00
Ole Tange 1407c1c947 New Year copyright update. 2017-01-01 17:51:14 +01:00
Ole Tange 1cd9efc69c parallel: --tmux(pane) --fg implemented.
parallel_alternatives.pod: Split from parallel.pod.
2017-01-01 12:42:52 +01:00
Ole Tange 9b4fd8b33b parallel: Implemented --results foo.csv/-.tsv. Incl. testsuite. 2016-12-18 11:14:06 +01:00
Ole Tange 987cc8c30b Fixed bug #49664: --round-robin does not complete. 2016-12-14 15:04:57 +01:00
Ole Tange 5bbf0bbd80 teststuite: Major rewrite of several tests. 2016-12-14 08:48:27 +01:00
Ole Tange 0c41e2d2df Testsuite adjusted for other development platform. 2016-12-08 12:04:22 +01:00
Ole Tange 5ed19b901c env_parallel.fish: Compatible with fish 2.0.0. 2016-12-08 12:03:04 +01:00
Ole Tange 0388fb5b1e Fixed bug #49800: --pipepart --block -1 should be --round-robin like. 2016-12-08 02:28:01 +01:00
Ole Tange b1d17c6dd2 Fixed bug #49787: --sql* +DBURL should not erase the table.
Fixed bug #49786: --sqlmaster with --wait.
2016-12-07 14:33:50 +01:00
Ole Tange ca9b3ac100 Released as 20161122 ('Trump') 2016-11-21 22:35:25 +01:00
Ole Tange f905690898 env_parallel.{bash,fish,ksh,zsh} fixes + testsuite. 2016-11-06 23:01:42 +01:00
Ole Tange 3e440983e7 env_parallel.{bash,ksh,pdksh,zsh}: Minimal --record-env. 2016-11-06 12:29:48 +01:00
Ole Tange e458f35453 Fixed bug #49538: --header : and {= =}. 2016-11-05 18:58:46 +01:00
Ole Tange 55eaf48197 parallel: tmux uses $TMUX, so rename it to: $PARALLEL_TMUX. 2016-10-30 17:07:59 +01:00
Ole Tange b44e91df26 testsuite: Changes due to changed environment and code. 2016-10-22 13:51:42 +02:00
Ole Tange e3d00f03f6 Fixed bug #49413: env_parallel does not respect exit code from functions. 2016-10-22 13:46:01 +02:00
Ole Tange 089fc5b287 Fixed env_parallel does not respect exit code from functions.
http://lists.gnu.org/archive/html/bug-parallel/2016-10/msg00001.html
2016-10-18 00:02:48 +02:00
Ole Tange 74e35933f4 parcat: Small fixup.
testsuite: Fixups for --line-buffer/--files.
2016-09-23 00:57:30 +02:00
Ole Tange e0ac24f213 Fixed bug #48658: --linebuffer --files. 2016-08-27 23:24:30 +02:00
Ole Tange 9689682674 parallel: code cleanup. 2016-08-23 00:08:10 +02:00
Ole Tange ec9e90e529 Released as 20160822 ('OgNomekop') 2016-08-21 22:14:31 +02:00
Ole Tange 8bec8de5df --tmuxpane initial version.
Passes testsuite.
2016-08-21 15:37:59 +02:00
Ole Tange fd6abf1f9a parallel: Removed memleak. 2016-08-14 16:54:27 +02:00
Ole Tange a7b50a054e parallel: --xapply => --link. 2016-08-13 19:11:15 +02:00
Ole Tange ed76fe2979 testsuite: Many small changes due to production OS upgrade. No radical changes. 2016-08-03 23:45:13 +02:00
Ole Tange 1082b5ca02 testsuite fixups. 2016-07-22 23:57:23 +02:00
Ole Tange 4fb086c285 Merge branch 'master' of ssh://git.sv.gnu.org/srv/git/parallel
Conflicts:
	doc/release_new_version
2016-07-22 20:41:39 +02:00
Ole Tange f38d7fe29f testsuite: env_parallel expanded. 2016-07-22 20:39:12 +02:00
Ole Tange 2ae423ad88 Merge branch 'master' of ssh://git.sv.gnu.org/srv/git/parallel 2016-07-22 18:10:37 +02:00
Ole Tange 71ba3f1a8f Passes testsuite. 2016-07-22 18:10:28 +02:00
Ole Tange 68a48146ea env_parallel: --env _ supported in (t)csh and pdksh. 2016-07-14 20:08:26 +02:00
Ole Tange 3ba7a4646d testsuite: --env for csh. 2016-07-11 03:50:52 +02:00
Ole Tange 9feeaefc56 env_parallel.csh: Testing of --env _ for csh works. 2016-07-11 03:45:38 +02:00
Ole Tange bec3d7924b env_parallel.tcsh: Testing of --env _ for tcsh works. 2016-07-11 03:30:18 +02:00
Ole Tange 29a7113d7f testsuite: Faster test of whether --linebuffer matters. 2016-07-10 23:00:20 +02:00
Ole Tange 1cb786c62e env_parallel.tcsh: --env _ works. 2016-07-10 22:57:33 +02:00
Ole Tange 402d3960d4 parallel: Fixed bug #48449: memory leak. 2016-07-10 16:02:26 +02:00
Ole Tange 8a5729cebd Fixed bug #48414: --sqlandworker --linebuffer does not save output in sql. 2016-07-06 19:04:52 +02:00
Ole Tange 11a8800751 parallel: Fixed locking bug in --sql for SQLite.
testsuite: Reworked parallel-local-sql.
2016-07-06 15:58:47 +02:00
Ole Tange eacc07bcb0 env_parallel.bash: --env _ supported.
env_parallel.ksh: --env _ supported.
env_parallel.zsh: --env _ supported.
testsuite/.../parallel-local-ssh7: Focuses on env_parallel.
2016-07-05 13:28:22 +02:00
Ole Tange a3947338da env_parallel.ksh: Fixed for ksh #47483: env_parallel export --env only. 2016-07-04 14:54:38 +02:00
Ole Tange 805d924c16 Fixed bug #48290: round-robin does not distribute data based on business. 2016-07-04 12:55:16 +02:00
Ole Tange dd5ade4fbe env_parallel.zsh now supports aliases. 2016-07-02 18:00:51 +02:00
Ole Tange 85dfb3e96a Fixed bug #48327: env_parallel.bash fails if function has (). 2016-06-28 18:13:35 +02:00
Ole Tange 9d1e2df9b9 Test requirements added.
Updates to *-local-* tests so they can run on different computers.
2016-06-27 21:00:19 +02:00
Ole Tange bf0571e4a7 parallel: Fixed bug #48074: --pipe --block 90k blocks on windows.
Fixed bug with open3(x,x,x,"-") detection.
Cleaned up some tests.
2016-06-04 15:49:01 +02:00
Ole Tange 7542609ef1 parallel: Removed $Global::envvar. More --env $PATH changes. 2016-05-29 23:06:15 +02:00
Ole Tange ff27e601bf Fixed bug #47695: How to set $PATH on remote? 2016-05-29 17:18:53 +02:00
Ole Tange 51f212e548 parallel: If --block is left out, --pipepart will use a block size that will result in 10 jobs per jobslot. 2016-05-26 00:13:48 +02:00
Ole Tange 4e90972584 parallel: Use open3(x,x,x,"-") for setpgrp if available. 2016-05-22 14:08:47 +02:00
Ole Tange 58fc7e7c7c testsuite: reorg. Passes testsuite. 2016-05-17 02:11:38 +02:00
Ole Tange f8d1474943 parallel: Transfer functions through csh if PARALLEL_SHELL is set to bash. 2016-05-04 19:28:40 +02:00
Ole Tange d0b5edf41f Fixed bug #47750: -k --line-buffer should give current job up to now. 2016-04-21 23:31:40 +02:00
Ole Tange 45dd9f29d9 Passes testsuite.
parallel: base64 encoding compatible with rc.
2016-04-20 23:35:06 +02:00
Ole Tange 16e3e54dcf env_parallel.tcsh added.
env_parallel.csh now supports variables, aliases, and arrays with no special chars.
2016-04-14 08:33:58 +02:00
Ole Tange 61dca99762 parallel: Fixed bug #47558: rc: line 1: syntax error near '='.
parallel: qqx() runs sh -c 2>/dev/null.
testsuite: Test for bug #47644: Wrong slot number replacement when resuming.
2016-04-11 22:19:28 +02:00
Ole Tange dd793cee9d testsuite: Polarhome improved. 2016-04-06 00:57:07 +02:00
Ole Tange 4a1abba854 Fixed bug #47608: parallel --nonall -S lo 'echo ::: ' blocks. 2016-04-06 00:33:34 +02:00
Ole Tange 38445ee49e testsuite: :::+ (--xapply) with non-wrapping values. 2016-04-04 23:37:54 +02:00
Ole Tange e663fe2636 Added env_parallel.csh env_parallel.pdksh.
env_parallel.fish now supports arrays.
Documentation updates.
2016-03-26 10:35:13 +01:00
Ole Tange 72df609f3d Released as 20160322 ('Bruxelles') 2016-03-22 21:14:10 +01:00
Ole Tange bf91e06e00 Fixed bug #47462: --transfer with file containing /./ is not done relative.
Added env_parallel to Makefile.
--sql => --sqlmaster.
ssh -tt code removed.
Send/return column in --joblog set to 0 instead of null.
parallel_tutorial.pod: Added CSV DBURL example.
2016-03-20 23:57:25 +01:00
Ole Tange 6d8ce313f1 parallel: better support for --sql csv://...
env_parallel.* added.
2016-03-17 00:50:45 +01:00
Ole Tange f1cbb08d78 Released as 20160222 ('N977GA') 2016-02-21 23:07:44 +01:00
Ole Tange b1447b6bad Fixed bug #47086: [PATCH] Initialize total_completed from joblog. 2016-02-19 22:15:08 +01:00
Ole Tange 6628b8980c Fixed bug #47002: --tagstring with -d '\n\n'. 2016-01-28 23:45:11 +01:00
Ole Tange a4ead8224d testsuite: Passes testsuite (sql fails periodically). 2016-01-23 09:54:05 +01:00
Ole Tange 37fd9adb7b Fixed bug #46819: --wd is ignored for --nonall. 2016-01-06 16:22:30 +01:00
Ole Tange a0716ab5fb Fixed bug #46787: --wd {= =} does not work. 2016-01-04 00:33:09 +01:00
Ole Tange fb03c5f05f Released as 20151222 ('ParisAgreement') 2015-12-22 18:42:33 +01:00
Ole Tange 4ec701807e Fixed bug #46519: --onall ignores --transfer.
Passes testsuite.
2015-12-20 18:20:30 +01:00
Ole Tange c871cdd0a3 Fixed bug #46708: controlmaster uses tempdir in $HOME.
Passes testsuite.
2015-12-19 02:46:32 +01:00
Ole Tange c1d01e800e Fixed bug #46630: --tf/--transferfile like --basefile but for each job.
Passes testsuite.
2015-12-13 12:20:50 +01:00
Ole Tange 84e1c33182 Test for bug #46520: --basefile cleans up without --cleanup. 2015-12-13 03:01:11 +01:00
Ole Tange 09dcafc120 Fixed bug #45025: --pipe --retries does not reschedule on other host 2015-12-13 01:54:08 +01:00
Ole Tange b14ca07563 Fixed bug #46520: --basefile cleans up without --cleanup.
qqx() is qx{} with stderr ignored.
{= $_ = total_jobs() =} can now be used.
2015-11-30 00:47:21 +01:00
Ole Tange fc8e346bee parallel: stdin_buffer changed to block. 2015-11-22 11:12:47 +01:00
Ole Tange b244ddf7ca Re-fixed bug #45841: Replacement string for total no of jobs. --bar works, too. 2015-10-18 15:18:30 +02:00
Ole Tange 03a35016a9 Fixed bug #45841: Replacement string for total no of jobs. 2015-10-18 11:44:02 +02:00
Ole Tange 9636f9f249 Fixed bug #46231: {%} with --pipepart broken. 2015-10-17 17:10:04 +02:00
Ole Tange da9043fc65 Fixed bug #46232: {%} with --bar/--eta/--shuf or --halt xx% broken. 2015-10-17 16:54:15 +02:00
Ole Tange 210ca9614c Fixed bug #46214: Using --pipepart doesn't spawn multiple jobs in version 20150922. 2015-10-17 01:57:30 +02:00