Commit graph

1054 commits

Author SHA1 Message Date
Ole Tange 01088177aa parallel: --sqlmaster +DBURL works with different commands. 2017-01-13 16:05:34 +01:00
Ole Tange 84f4a855a5 parallel: --sqlworker now reads everything from the database. Command+args are ignored. 2017-01-12 23:36:15 +01:00
Ole Tange da705d03b6 parallel: If --results includes a replacement string, no tree structure with args will be generated. 2017-01-06 19:10:20 +01:00
Ole Tange 9f7eaa5f93 parallel: Fixed bug #49970: Python child process dies if --env is used 2017-01-01 17:53:18 +01:00
Ole Tange 1407c1c947 New Year copyright update. 2017-01-01 17:51:14 +01:00
Ole Tange 1cd9efc69c parallel: --tmux(pane) --fg implemented.
parallel_alternatives.pod: Split from parallel.pod.
2017-01-01 12:42:52 +01:00
Ole Tange a92ca3bf92 Released as 20161222 ('Castro') 2016-12-22 14:27:00 +01:00
Ole Tange 9b4fd8b33b parallel: Implemented --results foo.csv/-.tsv. Incl. testsuite. 2016-12-18 11:14:06 +01:00
Ole Tange 987cc8c30b Fixed bug #49664: --round-robin does not complete. 2016-12-14 15:04:57 +01:00
Ole Tange 2dcc9db3ca Fixed bug #49805: sql pg:////?'select 3' does not work. 2016-12-14 09:20:33 +01:00
Ole Tange e305356898 parallel: Saving to SQL is now done using sql->output(). 2016-12-14 03:53:33 +01:00
Ole Tange 0c41e2d2df Testsuite adjusted for other development platform. 2016-12-08 12:04:22 +01:00
Ole Tange 5ed19b901c env_parallel.fish: Compatible with fish 2.0.0. 2016-12-08 12:03:04 +01:00
Ole Tange 2ba37a6d64 Fixed bug #49802: --compress-program freezes often under load. 2016-12-08 12:00:54 +01:00
Ole Tange 0388fb5b1e Fixed bug #49800: --pipepart --block -1 should be --round-robin like. 2016-12-08 02:28:01 +01:00
Ole Tange b1d17c6dd2 Fixed bug #49787: --sql* +DBURL should not erase the table.
Fixed bug #49786: --sqlmaster with --wait.
2016-12-07 14:33:50 +01:00
Ole Tange 6837861a29 Fixed bug #49785: total_jobs() with --sql*.
Test fails due to bug #49792: --sql* {#} is wrong.
2016-12-07 13:12:23 +01:00
Ole Tange d395c25cd6 Post-release. 2016-11-21 22:46:22 +01:00
Ole Tange ca9b3ac100 Released as 20161122 ('Trump') 2016-11-21 22:35:25 +01:00
Ole Tange f905690898 env_parallel.{bash,fish,ksh,zsh} fixes + testsuite. 2016-11-06 23:01:42 +01:00
Ole Tange 3e440983e7 env_parallel.{bash,ksh,pdksh,zsh}: Minimal --record-env. 2016-11-06 12:29:48 +01:00
Ole Tange e458f35453 Fixed bug #49538: --header : and {= =}. 2016-11-05 18:58:46 +01:00
Ole Tange 55eaf48197 parallel: tmux uses $TMUX, so rename it to: $PARALLEL_TMUX. 2016-10-30 17:07:59 +01:00
Ole Tange f9f52c083e Released as 20161022 ('Matthew') 2016-10-22 14:37:48 +02:00
Ole Tange b44e91df26 testsuite: Changes due to changed environment and code. 2016-10-22 13:51:42 +02:00
Ole Tange e3d00f03f6 Fixed bug #49413: env_parallel does not respect exit code from functions. 2016-10-22 13:46:01 +02:00
Ole Tange a36729cdf3 Fixed bug #49229: parallel hangs on last ffmpeg command.
First command no longer gets stdin as it causes unpredictable issues.
2016-10-22 13:39:31 +02:00
Ole Tange d5761dcaae Fixed bug #49404: “Max jobs to run” does not equal the number of jobs specified when using GNU Parallel on remote server?
Fixed bug #49335: parallel: Warning: You may raise this by changing /etc/ssh/sshd_config:MaxStartups and MaxSessions.
2016-10-22 13:35:26 +02:00
Ole Tange 1863566363 parallel: Redirect STDERR temporarily, so errors on MacOS X are ignored. 2016-10-22 13:32:59 +02:00
Ole Tange a315bd26e6 parallel: shellwords is defined in newer versions of Perl causing
redefine error.
2016-10-22 13:31:11 +02:00
Ole Tange 67da57ccc7 GNU Coding Standards says: The standard --help option should output
brief documentation for how to invoke the program, on standard output,
then exit successfully.
https://www.gnu.org/prep/standards/standards.html#g_t_002d_002dhelp
2016-10-22 13:29:17 +02:00
Ole Tange ec3767fd5e Maybe fixed bug #49412: Signal SIGCHLD received, but no signal handler.
Testing missing.
2016-10-22 13:26:16 +02:00
Ole Tange 089fc5b287 Fixed env_parallel does not respect exit code from functions.
http://lists.gnu.org/archive/html/bug-parallel/2016-10/msg00001.html
2016-10-18 00:02:48 +02:00
Ole Tange 0f8d12839f Released as 20160922 ('Christiania') 2016-09-23 01:15:11 +02:00
Ole Tange 74e35933f4 parcat: Small fixup.
testsuite: Fixups for --line-buffer/--files.
2016-09-23 00:57:30 +02:00
Ole Tange a4ddcbf8bc parallel: --files/--results --line-buffer fix. 2016-09-22 23:54:38 +02:00
Ole Tange 5829f512c1 parallel: tmpfile now returns only a filehandle if in scalar context. 2016-09-22 23:53:32 +02:00
Ole Tange bd38a6ac54 parallel: Search for pzstd for faster compression. 2016-09-22 23:52:24 +02:00
Ole Tange 196afa553b parcat: Initial version. 2016-09-04 10:42:04 +02:00
Ole Tange 063b64e0c9 Fixed --memfree script on Darwin/Macosx. 2016-08-27 23:50:01 +02:00
Ole Tange e0ac24f213 Fixed bug #48658: --linebuffer --files. 2016-08-27 23:24:30 +02:00
Ole Tange 49690b97e5 env_parallel.*: Converted to #!/usr/bin/env to avoid depening on all shells. 2016-08-25 22:03:06 +02:00
Ole Tange 9689682674 parallel: code cleanup. 2016-08-23 00:08:10 +02:00
Ole Tange ec9e90e529 Released as 20160822 ('OgNomekop') 2016-08-21 22:14:31 +02:00
Ole Tange 8bec8de5df --tmuxpane initial version.
Passes testsuite.
2016-08-21 15:37:59 +02:00
Ole Tange fd6abf1f9a parallel: Removed memleak. 2016-08-14 16:54:27 +02:00
Ole Tange e94774df14 parallel: Less memory leak (now around 40 bytes/job). 2016-08-13 19:17:44 +02:00
Ole Tange a7b50a054e parallel: --xapply => --link. 2016-08-13 19:11:15 +02:00
Ole Tange 393cfd177a parallel: base64_zip_eval written shorter so it might fit in csh's 1000 byte limit. 2016-08-04 00:04:06 +02:00
Ole Tange 223cdb4754 parallel: Prepare for better error handling of parallel running of --basefile and --cleanup. 2016-08-04 00:01:41 +02:00
Ole Tange a04e3e6740 parallel: --tty re-fixed. 2016-08-04 00:00:19 +02:00
Ole Tange f8467c9a6b parallel: Bash aliases only visible if exec'ed as a single command - not a string. 2016-08-03 23:58:52 +02:00
Ole Tange b9470f8964 parallel: Use && to make sure dest dir is created before trying to rsync to it. 2016-08-03 23:55:54 +02:00
Ole Tange 201eab34ab parallel: Do not track median of failed jobs: They might fail very fast and skew the median. 2016-08-03 23:53:20 +02:00
Ole Tange 0724162ad4 parallel: --linebuffer treat \r as a full line, too. 2016-08-03 23:51:14 +02:00
Ole Tange 769d2706f2 niceload: Wrong regexp for loadaverage on MacOS X. Force LANG=C. 2016-08-03 23:42:15 +02:00
Ole Tange a1757c141a sql: sqlplus is sqlplus64 on AMD64. 2016-08-02 01:30:46 +02:00
Ole Tange cd9b2a4c24 env_parallel.bash: Ignore output from shopt.
env_parallel.zsh: Reverted change.
2016-08-02 01:25:14 +02:00
Ole Tange dc247b78cb env_parallel: --install less noisy. 2016-08-02 01:22:39 +02:00
Ole Tange 28dcb4a4db env_parallel.zsh: ignore typeset for zsh parameters like dis_patchars and patchars. 2016-08-01 21:07:42 +02:00
Ole Tange 0ef41e79aa Released as 20160722 ('Brexit') 2016-07-23 01:41:54 +02:00
Ole Tange 1082b5ca02 testsuite fixups. 2016-07-22 23:57:23 +02:00
Ole Tange 4fb086c285 Merge branch 'master' of ssh://git.sv.gnu.org/srv/git/parallel
Conflicts:
	doc/release_new_version
2016-07-22 20:41:39 +02:00
Ole Tange f38d7fe29f testsuite: env_parallel expanded. 2016-07-22 20:39:12 +02:00
Ole Tange 2ae423ad88 Merge branch 'master' of ssh://git.sv.gnu.org/srv/git/parallel 2016-07-22 18:10:37 +02:00
Ole Tange 71ba3f1a8f Passes testsuite. 2016-07-22 18:10:28 +02:00
Ole Tange 68a48146ea env_parallel: --env _ supported in (t)csh and pdksh. 2016-07-14 20:08:26 +02:00
Ole Tange 3ba7a4646d testsuite: --env for csh. 2016-07-11 03:50:52 +02:00
Ole Tange bec3d7924b env_parallel.tcsh: Testing of --env _ for tcsh works. 2016-07-11 03:30:18 +02:00
Ole Tange 1117140adb parallel: Fixed SQL racing error.
If two workers both work on the last job, the master will drop the
table when the first returns. The second should ignore the dropped
table.
2016-07-10 23:01:53 +02:00
Ole Tange 1cb786c62e env_parallel.tcsh: --env _ works. 2016-07-10 22:57:33 +02:00
Ole Tange 402d3960d4 parallel: Fixed bug #48449: memory leak. 2016-07-10 16:02:26 +02:00
Ole Tange 8a5729cebd Fixed bug #48414: --sqlandworker --linebuffer does not save output in sql. 2016-07-06 19:04:52 +02:00
Ole Tange 11a8800751 parallel: Fixed locking bug in --sql for SQLite.
testsuite: Reworked parallel-local-sql.
2016-07-06 15:58:47 +02:00
Ole Tange eacc07bcb0 env_parallel.bash: --env _ supported.
env_parallel.ksh: --env _ supported.
env_parallel.zsh: --env _ supported.
testsuite/.../parallel-local-ssh7: Focuses on env_parallel.
2016-07-05 13:28:22 +02:00
Ole Tange a3947338da env_parallel.ksh: Fixed for ksh #47483: env_parallel export --env only. 2016-07-04 14:54:38 +02:00
Ole Tange 805d924c16 Fixed bug #48290: round-robin does not distribute data based on business. 2016-07-04 12:55:16 +02:00
Ole Tange a62b528382 Fixed bug #48385: --pipepart does not work on block-devices. 2016-07-04 04:26:57 +02:00
Ole Tange dd5ade4fbe env_parallel.zsh now supports aliases. 2016-07-02 18:00:51 +02:00
Ole Tange 8637d30bca env_parallel.bash: Fixed for bash #47483: env_parallel export --env only. 2016-06-29 03:24:14 +02:00
Ole Tange 85dfb3e96a Fixed bug #48327: env_parallel.bash fails if function has (). 2016-06-28 18:13:35 +02:00
Ole Tange 9d1e2df9b9 Test requirements added.
Updates to *-local-* tests so they can run on different computers.
2016-06-27 21:00:19 +02:00
Ole Tange d0dc1f9bd7 Fixed bug #48295: --results should be dynamic like --wd.
No test.
2016-06-22 21:43:05 +02:00
Ole Tange da82bea501 parallel: Warning if --pipe with --block >64k on CygWin. 2016-06-20 12:33:05 +02:00
Ole Tange 9d3c6997cd The cookie from 2016-01-04 was won by Morgan Rodgers after 5 months. 2016-06-07 21:53:32 +02:00
Ole Tange bf0571e4a7 parallel: Fixed bug #48074: --pipe --block 90k blocks on windows.
Fixed bug with open3(x,x,x,"-") detection.
Cleaned up some tests.
2016-06-04 15:49:01 +02:00
Ole Tange 7542609ef1 parallel: Removed $Global::envvar. More --env $PATH changes. 2016-05-29 23:06:15 +02:00
Ole Tange ff27e601bf Fixed bug #47695: How to set $PATH on remote? 2016-05-29 17:18:53 +02:00
Ole Tange 51f212e548 parallel: If --block is left out, --pipepart will use a block size that will result in 10 jobs per jobslot. 2016-05-26 00:13:48 +02:00
Ole Tange d570ec2d20 parallel: Allow for command with empty name in process table. 2016-05-22 22:53:53 +02:00
Ole Tange 618220910a parallel: limit buffering to 1..2 (stdout..stderr).
testsuite: Compatibility fix with perl-5.14.
2016-05-22 22:43:53 +02:00
Ole Tange 8b96f84864 Released as 20160522 ('TTIPleaks') 2016-05-22 14:21:46 +02:00
Ole Tange 4e90972584 parallel: Use open3(x,x,x,"-") for setpgrp if available. 2016-05-22 14:08:47 +02:00
Ole Tange 58fc7e7c7c testsuite: reorg. Passes testsuite. 2016-05-17 02:11:38 +02:00
Ole Tange 17a50e3354 parallel: fixed --interactive.
parallel: fixed --basefile with --workdir.
2016-05-09 00:03:11 +02:00
Ole Tange 9d9016b88f niceload: Fixed --battery.
niceload: Implemented --net/--nethops.
2016-05-08 14:18:10 +02:00
Ole Tange f8d1474943 parallel: Transfer functions through csh if PARALLEL_SHELL is set to bash. 2016-05-04 19:28:40 +02:00
Ole Tange e4738dfb97 Released as 20160422 ('PanamaPapers') 2016-04-22 00:36:46 +02:00
Ole Tange d0b5edf41f Fixed bug #47750: -k --line-buffer should give current job up to now. 2016-04-21 23:31:40 +02:00
Ole Tange 45dd9f29d9 Passes testsuite.
parallel: base64 encoding compatible with rc.
2016-04-20 23:35:06 +02:00
Ole Tange 3738136bc4 parallel: Use File::Path::mkpath instead of home made version. 2016-04-14 23:30:03 +02:00
Ole Tange 16e3e54dcf env_parallel.tcsh added.
env_parallel.csh now supports variables, aliases, and arrays with no special chars.
2016-04-14 08:33:58 +02:00
Ole Tange 61dca99762 parallel: Fixed bug #47558: rc: line 1: syntax error near '='.
parallel: qqx() runs sh -c 2>/dev/null.
testsuite: Test for bug #47644: Wrong slot number replacement when resuming.
2016-04-11 22:19:28 +02:00
Ole Tange 2aea2879c9 parallel: Fixed bug #47644: Wrong slot number replacement when resuming. 2016-04-10 00:35:32 +02:00
Ole Tange 39fb9d179e parallel: Deal with 'parallel --citation < /dev/null'. 2016-04-09 23:57:50 +02:00
Ole Tange 3d919c6cd4 Fixed: bug #46679: Problems exporting bash functions to /bin/sh. 2016-04-06 00:38:24 +02:00
Ole Tange b17f41d17f parallel: Better CPU detection on OpenIndiana. 2016-04-06 00:35:45 +02:00
Ole Tange 4a1abba854 Fixed bug #47608: parallel --nonall -S lo 'echo ::: ' blocks. 2016-04-06 00:33:34 +02:00
Ole Tange 9892e7deac env_parallel.bash tested: Works better as variable than as tempfile. 2016-04-04 23:33:30 +02:00
Ole Tange e663fe2636 Added env_parallel.csh env_parallel.pdksh.
env_parallel.fish now supports arrays.
Documentation updates.
2016-03-26 10:35:13 +01:00
Ole Tange 1cad1cf939 parallel: Implemented buggy :::+ and ::::+ 2016-03-23 00:20:42 +01:00
Ole Tange 72df609f3d Released as 20160322 ('Bruxelles') 2016-03-22 21:14:10 +01:00
Ole Tange f406518899 env_parallel: Documentation added. 2016-03-22 20:09:18 +01:00
Ole Tange feb914f4ef parallel: Give warning if \0 is contained in arguments. 2016-03-22 20:08:38 +01:00
Ole Tange 2467d0b5be niceload: --prg searches for substrings if no the string matches nothing. 2016-03-22 20:06:08 +01:00
Ole Tange bf91e06e00 Fixed bug #47462: --transfer with file containing /./ is not done relative.
Added env_parallel to Makefile.
--sql => --sqlmaster.
ssh -tt code removed.
Send/return column in --joblog set to 0 instead of null.
parallel_tutorial.pod: Added CSV DBURL example.
2016-03-20 23:57:25 +01:00
Ole Tange 6d8ce313f1 parallel: better support for --sql csv://...
env_parallel.* added.
2016-03-17 00:50:45 +01:00
Ole Tange f1cbb08d78 Released as 20160222 ('N977GA') 2016-02-21 23:07:44 +01:00
Ole Tange b1447b6bad Fixed bug #47086: [PATCH] Initialize total_completed from joblog. 2016-02-19 22:15:08 +01:00
Ole Tange 794315c676 parallel: --load: Use 'ps axH -o state,command' to include threads. 2016-02-14 20:13:31 +01:00
Ole Tange 6628b8980c Fixed bug #47002: --tagstring with -d '\n\n'. 2016-01-28 23:45:11 +01:00
Ole Tange 7fd33c205a Released as 20160122 ('Bowie') 2016-01-23 10:46:58 +01:00
Ole Tange 37fd9adb7b Fixed bug #46819: --wd is ignored for --nonall. 2016-01-06 16:22:30 +01:00
Ole Tange 582164930a Changed SQL datatypes as per bug #46803: Improvements to --sql. 2016-01-05 12:00:43 +01:00
Ole Tange a0716ab5fb Fixed bug #46787: --wd {= =} does not work. 2016-01-04 00:33:09 +01:00
Ole Tange f4c20c13b0 Released as 20160101 ('20160101alpha') 2016-01-01 15:12:43 +01:00
Ole Tange fb03c5f05f Released as 20151222 ('ParisAgreement') 2015-12-22 18:42:33 +01:00
Ole Tange 4ec701807e Fixed bug #46519: --onall ignores --transfer.
Passes testsuite.
2015-12-20 18:20:30 +01:00
Ole Tange c871cdd0a3 Fixed bug #46708: controlmaster uses tempdir in $HOME.
Passes testsuite.
2015-12-19 02:46:32 +01:00
Ole Tange 2fcb6f8df6 Code cleanup. 2015-12-14 01:23:34 +01:00
Ole Tange c1d01e800e Fixed bug #46630: --tf/--transferfile like --basefile but for each job.
Passes testsuite.
2015-12-13 12:20:50 +01:00
Ole Tange 09dcafc120 Fixed bug #45025: --pipe --retries does not reschedule on other host 2015-12-13 01:54:08 +01:00
Ole Tange b14ca07563 Fixed bug #46520: --basefile cleans up without --cleanup.
qqx() is qx{} with stderr ignored.
{= $_ = total_jobs() =} can now be used.
2015-11-30 00:47:21 +01:00
Ole Tange 1625b42946 Released as 20151122 ('Bataclan') 2015-11-22 19:57:42 +01:00
Ole Tange 68ee1c3f70 parallel: memfree script sometimes fail: Run it twice. 2015-11-22 11:15:45 +01:00
Ole Tange 72ff28f801 parallel: check_invalid_option_combinations(). 2015-11-22 11:14:54 +01:00
Ole Tange fc8e346bee parallel: stdin_buffer changed to block. 2015-11-22 11:12:47 +01:00
Ole Tange 5be0293a96 Released as 20151022 ('LiquidWater') 2015-10-21 23:55:31 +02:00
Ole Tange b244ddf7ca Re-fixed bug #45841: Replacement string for total no of jobs. --bar works, too. 2015-10-18 15:18:30 +02:00
Ole Tange 03a35016a9 Fixed bug #45841: Replacement string for total no of jobs. 2015-10-18 11:44:02 +02:00
Ole Tange 554b723687 Disabled bug #45997: parallel --bar --pipe wc. 2015-10-17 17:14:41 +02:00
Ole Tange 9636f9f249 Fixed bug #46231: {%} with --pipepart broken. 2015-10-17 17:10:04 +02:00
Ole Tange da9043fc65 Fixed bug #46232: {%} with --bar/--eta/--shuf or --halt xx% broken. 2015-10-17 16:54:15 +02:00
Ole Tange 210ca9614c Fixed bug #46214: Using --pipepart doesn't spawn multiple jobs in version 20150922. 2015-10-17 01:57:30 +02:00
Ole Tange 6ad2e2bac3 Re-fixed bug #46120: Suspend should suspend (at least local) children. 2015-10-12 02:15:06 +02:00
Ole Tange 6775eb3082 Fixed bug #46120: Suspend should suspend (at least local) children'. 2015-10-04 23:46:12 +02:00
Ole Tange b8339bc707 Fixed bug #46058: --shellquote broken in fish. 2015-10-04 22:25:37 +02:00
Ole Tange 6b90d81add Fixed bug #46050: --ssh lsh supported and partly --ssh autossh. 2015-09-28 23:27:45 +02:00
Ole Tange 51f5363211 Fixed bug #45993: --wd ... should also work when run locally. 2015-09-25 01:29:34 +02:00
Ole Tange d3b5e26c1a Fixed bug #46016: --joblog should not log when --dryrun. 2015-09-22 01:35:52 +02:00