tange/parallel
1
0
Fork 0
mirror of https://git.savannah.gnu.org/git/parallel.git synced 2024-12-23 13:17:54 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
1614 commits 1 branch 311 tags 27 MiB
Commit graph

718 commits

Author SHA1 Message Date
Ole Tange 69cca79c3b parallel: --sqlworker combined with -N fixed. 2020-10-14 19:27:31 +02:00
Ole Tange 53d688077c parallel: Faster --group-by. -vv --joblog / --onall --ssh bugfix. 2020-10-13 01:17:14 +02:00
Ole Tange f0b40c126c Released as 20200922 ('Ginsburg') 2020-09-23 17:41:03 +02:00
Ole Tange 3fc2bf228f parallel: GNU/Linux cpu detection by reading CPU topology. 2020-09-19 16:47:01 +02:00
Ole Tange 31031e521d parallel: Fixed bug #59010: Max command line length for MacOS 2020-09-12 23:33:55 +02:00
Ole Tange 555863c0b5 parallel: Fixed bug #58985: sem stall if .parallel/semaphore is chmod 0 2020-08-30 20:03:37 +02:00
Ole Tange e6c9dfe010 Fixed bug #59006: rsync version 3.2.3 is not detected correctly. 2020-08-29 22:12:46 +02:00
Ole Tange 5ea74055dd Released as 20200822 ('Beirut') 2020-08-23 01:31:39 +02:00
Ole Tange 19cd8e015f parallel: Attempt 3 at fixing https://lists.gnu.org/archive/html/parallel/2020-08/msg00003.html 2020-08-20 23:07:56 +02:00
Ole Tange 2ed5279f6a parallel: Attempt 2 at fixing https://lists.gnu.org/archive/html/parallel/2020-08/msg00003.html 2020-08-16 10:12:42 +02:00
Ole Tange 72dd439f20 parallel: Fix https://lists.gnu.org/archive/html/parallel/2020-08/msg00003.html 2020-08-11 22:55:31 +02:00
Ole Tange 79b56269bb parallel: Fixed bug #58802. Now passes testsuite. 2020-08-07 22:20:30 +02:00
Ole Tange ce2f84d151 env_parallel.bash: More read-only variables. 2020-07-22 22:45:09 +02:00
Ole Tange 28620b2c49 parallel: Avoid warning in MySQL, fish and perl. 2020-06-25 13:07:02 +02:00
Ole Tange 62ff9a8722 Released as 20200622 ('Floyd') 2020-06-23 00:34:52 +02:00
Ole Tange 3cd3f75200 parallel: With many --sqlworkers minimize the number of duplicates. 2020-06-11 23:25:18 +02:00
Ole Tange b5b3d5dc3e release procedure updated. 
parallel: --plus --onall now works.
parallel: --blocktimeout must be >= 1.
 2020-05-31 16:42:04 +02:00
Ole Tange 1e7da025c4 Released as 20200522 ('Kraftwerk') 2020-05-23 20:04:09 +02:00
Ole Tange 5bba5c922d parallel: $PARALLEL_JOBSLOT = {%} unless the job is being retried. 
parallel: $PARALLEL_SSHLOGIN = sshlogin with number of cores removed.
parallel: $PARALLEL_SSHHOST = the host part of an sshlogin.
parallel: {slot} {sshlogin} {host} added to --plus.
 2020-05-23 18:44:42 +02:00
Ole Tange 4430ee5f49 testsuite: Test all assigned UTF8 characters. 2020-05-23 18:44:12 +02:00
Ole Tange 6a67fd09d4 parallel: Fixed bug #57055: {sshlogin} shorthand for $PARALLEL_SSHLOGIN. 2020-05-08 03:35:51 +02:00
Ole Tange e5fd1c0767 Released as 20200422 ('10years') 2020-04-22 20:15:59 +02:00
Ole Tange d44cb9f336 parallel: CSV uses special DBI->connect() options for subdirs. 2020-03-21 19:07:16 +01:00
Ole Tange b34b30b566 parallel: --sql* should add Vn columns for --colsep. 2020-03-15 04:28:12 +01:00
Ole Tange f90250f2cc Released as 20200222 ('BrexitDay') 2020-02-23 01:10:44 +01:00
Ole Tange 0fe9be5f00 Released as 20200122 ('Soleimani') 2020-01-22 18:03:29 +01:00
Ole Tange fc97f4f61b testsuite: parallel-local-*s.sh will now timeout if a test takes >10x the median time. 2020-01-12 09:14:21 +01:00
Ole Tange b804568ffd parallel: Fixed bug #56403: --pipe block by time. Passes testsuite. 
Yearly copyright update.
 2020-01-09 14:37:41 +01:00
Ole Tange a785e66b6c Fixed bug #57364: Race condition creating len cache file. 2019-12-22 15:41:03 +01:00
Ole Tange 21fb3b6e60 Released as 20191122 ('QuantumSupremacy') 2019-11-23 22:14:03 +01:00
Ole Tange 1ba05d3bb7 Released as 20191022 ('DrivingIT') 2019-10-21 21:18:32 +02:00
Ole Tange eac8944b1d parallel: Fixed bug #56981: --tee should try and use --output-error=warn-nopipe 2019-10-02 21:35:02 +02:00
Ole Tange 372d3fdf24 Fixed bug #55992: --delay with ms accuracy (around 5 ms). 2019-09-22 07:30:08 +02:00
Ole Tange 2aabbf5e76 parallel: --header : sets named replacement string if input line ends in \r\n'. 2019-07-31 22:38:30 +02:00
Ole Tange 3b7b988c16 Released as 20190722 ('Ryugu') 2019-07-23 09:00:09 +02:00
Ole Tange e91d8597a0 parallel: Fixed $HOME and cached setpgrp. 2019-07-20 20:58:54 +02:00
Ole Tange c36cb46a23 parallel: Fixed bug #56578: --lb --tag misses some lines. 
parallel: Experimental (buggy) --bin.
 2019-07-14 16:48:57 +02:00
Ole Tange 088b43b5b0 parallel: $PARALLEL_SSHLOGIN can be used in command line. 2019-06-27 15:49:49 +02:00
Ole Tange 2e26627e39 parallel: -J ./profile, -J /abs/profile, -J configprofile. 
parallel: Fixed bug #56558: --rrs with --recend that is not regexp.
 2019-06-26 23:11:33 +02:00
Ole Tange a24bef3d03 parallel: Fixed bug in optimized finding (grand)*parent shell. 2019-06-26 13:46:29 +02:00
Ole Tange f8782f43a7 parallel: Cache CPU spec and setpgrp method in file. Startup 15% faster. 2019-06-25 21:18:27 +02:00
Ole Tange ebdc4c641a parallel: Fixed bug #56540: parallel echo $(printf "\257\256") ::: $(printf "\257\256"). 
parallel: added uq() as function for unquoting replacement string.
 2019-06-23 08:31:28 +02:00
Ole Tange f8ce632157 Released as 20190622 ('HongKong') 2019-06-21 16:52:48 +02:00
Ole Tange 5d81c7c053 parallel: Fixed bug #56275: --shard with named column and perl expr. 2019-06-17 01:21:45 +02:00
Ole Tange c25ae9cc87 parallel: --pipepart --groupby implemented. 2019-05-22 21:57:08 +02:00
Ole Tange aa62104eb5 --pipepart --group-by implemented (except column names). 2019-05-20 01:05:14 +02:00
Ole Tange 324a9f3a07 parallel: --group-by bug: Column name with Capitals. 
testsuite: Re-org for faster execution.
 2019-05-06 01:06:48 +02:00
Ole Tange 818439c3ff parallel: --group-by initial version. Documentation missing. 2019-05-04 23:00:25 +02:00
Ole Tange 9fd39b122d Fixed: bug #56096: dbi-csv no such column. 2019-04-28 23:02:10 +02:00
Ole Tange 3319fcad5b Released as 20190422 ('Invitation') 2019-04-21 20:16:33 +02:00
Ole Tange fe4173927f parallel: Fixed: --null conflicts with --resume --joblog. 2019-03-17 23:07:32 +01:00
Ole Tange 5e1e3775fc parallel: --line-buffer memory usage changed from 2x to 1x. 2019-02-24 01:16:40 +01:00
Ole Tange 321419c73a parallel: Unexplainable bug in --interactive fixed. 2019-02-22 19:00:42 +01:00
Ole Tange 79666b4906 parallel: Include parcat code in sharding to avoid depending on parcat. 2019-02-16 17:23:08 +01:00
Ole Tange 904cda6e19 parallel: --demux initial version. 2019-02-14 01:35:32 +01:00
Ole Tange 14581e8483 parallel: Support for Android/Termux. 2019-02-13 21:32:49 +01:00
Ole Tange 0615d0340b parallel: --shellquote can be given multiple times. 2019-01-29 06:58:12 +01:00
Ole Tange 62e34af892 Released as 20190122 ('Shutdown') 2019-01-21 03:16:59 +01:00
Ole Tange 8700e957fc parallel: Calculation of total_jobs() make better. 
parallel: Buffer size for --linebuffer increased for better performance.
parallel: --(n)onall now respects --memfree.
 2019-01-19 02:20:44 +01:00
Ole Tange 4234c24658 env_parallel: --end-session implemented. 2019-01-18 16:15:47 +01:00
Ole Tange e79d1d978b bug #55399: Clean up --wd ... when run locally. 
bug #55398: set $OLDPWD when using --wd.
 2019-01-06 13:45:43 +01:00
Ole Tange 48b1743b84 parallel: Prototypes on most functions added. 
parallel: Control flow for --roundrobin simplyfied.
 2019-01-01 14:34:04 +01:00
Ole Tange 036319dc09 parallel --halt soon,fail=100% </dev/null should not give division by zero. 2018-12-29 23:21:46 +01:00
Ole Tange f9ff5717fe sem --quote should not add empty argument. 2018-12-29 22:33:50 +01:00
Ole Tange 9fc4ad53af testsuite: Make some tests more stable. 2018-12-29 21:04:58 +01:00
Ole Tange a51c54dafe env_parallel.fish: Converted to '-quoting. 2018-12-28 12:47:25 +01:00
Ole Tange 1501d93eea Merge branch 'master' of ssh://git.sv.gnu.org/srv/git/parallel 2018-11-30 07:15:46 +01:00
Ole Tange 8286e771ec parallel: Simpler job scheduling flow. 2018-11-25 19:06:06 +01:00
Ole Tange 83ffe1af13 parallel: Simpler job control flow. 2018-11-23 00:30:23 +01:00
Ole Tange 001d9d0f66 env_parallel.fish: Initial support for --session. 
parallel: 'true | parallel --shuf echo' fixed.
testsuite: Updates due to Ubuntu 18.04.
parallel: Fixed bug #54869: Long lines break.
 2018-10-23 00:46:38 +02:00
Ole Tange 4f0422d9b0 Released as 20180922 ('Danske') 2018-09-22 23:09:30 +02:00
Ole Tange 36a8238a20 parallel: bug #54647: parset ignores empty lines. 
parallel: minix is working again.
parallel: bug #54128: command too long when exporting big env
testsuite: polarhome parallelized.
 2018-09-21 00:15:14 +02:00
Ole Tange b7e789c02f Fixed bug #54352: env_parallel -Slo --nonall myfunc broken in 20180722. 2018-08-27 01:54:11 +02:00
Ole Tange 490474ea8c parset: set exit code. 2018-08-23 00:21:29 +02:00
Ole Tange 2dc37640a6 env_parallel.fish: Recursive env_parallel possible. 
parallel: --rr = --round-robin.
 2018-07-24 19:50:31 +02:00
Ole Tange 75007fcbbf parallel: \-quoting replaced with '-quoting. 2018-07-22 08:58:32 +02:00
Ole Tange 628c0029cc env_parallel: Fixed bug #54212: env_parallel env_parallel echo ::: 1 fails. 2018-07-18 17:29:57 +02:00
Ole Tange fe92398309 parallel: Fixed perl expressions spanning multiple lines. 2018-07-18 14:36:04 +02:00
Ole Tange e1e8693797 parallel: Fixed bug #54328: --pipe --recend '' blocks. 2018-07-18 09:49:24 +02:00
Ole Tange 896048efbc parallel: Calculate #CPU as either #threads, #cores, or #sockets. 2018-07-14 06:11:58 +02:00
Ole Tange 0d5072907d env_parallel.mksh: Initial version. 2018-07-13 07:33:11 +02:00
Ole Tange dd5fb4a08b env_parallel: Code is now more similar for {d,b,}ash,{k,z}sh. 2018-07-11 18:46:05 +02:00
Ole Tange 1a81db5e2b parallel: Test that PARALLEL_ENV as a fifo works. 
testsuite: Check normal installation (incl. building docs).
testsuite: Less sensitive to run on slow machine.
 2018-07-08 20:45:39 +02:00
Ole Tange 4e301386e3 parallel: Deal better with multibyte chars by forcing LC_ALL=C. 2018-06-10 17:07:24 +02:00
Ole Tange 87b9d9fe29 Released as 20180522 ('GreatMarchOfReturn') 2018-05-23 01:07:40 +02:00
Ole Tange 9b2012f021 parallel: Better parent_shell detection. 2018-05-22 21:02:10 +02:00
Ole Tange 94ac9fd72c parallel: --results test.csv bug incl. testing. 2018-05-21 10:04:31 +02:00
Ole Tange a050662275 Fixed bug #53864: env_parallel + parset as part of parallel --embed. 2018-05-08 23:16:48 +02:00
Ole Tange 60e45b20eb env_parallel: --session implemented. 2018-04-27 18:52:00 +02:00
Ole Tange 1422b7b43a parallel: Fixed bug #53748: -k --retries 10 + out of filehandles = blocking. 2018-04-25 22:38:42 +02:00
Ole Tange 9a1d2e9dad parallel: Fixed bug #53718: --pipe --regexp -N blocks. 2018-04-23 23:45:16 +02:00
Ole Tange 3fdd3a6019 Released as 20180422 ('Tiangong-1') 2018-04-22 23:32:22 +02:00
Ole Tange 1e15645faa parallel: --pipe --csv: Pass only full CSV-records. 2018-04-22 16:28:01 +02:00
Ole Tange bbcef1032c parallel: --csv initial version. 2018-04-21 21:50:42 +02:00
Ole Tange 130e299af6 parallel: --timeout now gives warning. 
niceload: --pid PID,PID,PID implemented.
 2018-03-21 22:57:28 +01:00
Ole Tange e2792e2101 parallel --embed uses same code for all shells. 
parallel --embed compatible with env_parallel, parset, env_parset.
env_parallel.* update to be more like env_parallel.sh.
 2018-03-06 01:35:26 +01:00
Ole Tange eb1a79b04b Released as 20180222 ('Henrik') 2018-02-22 22:53:38 +01:00
Ole Tange e6339f4512 parset: Now a copy of env_parallel. 2018-02-22 20:43:33 +01:00
Ole Tange 6657e056f2 parallel: --nice has not been working locally since 20161022. 2018-02-05 21:39:59 +01:00
Ole Tange 78fade1e62 parallel: --embed initial version. Incompatible with env_*. 
env_parallel.*: Minor bugfixes.
parallel: More commenting.
 2018-01-25 03:48:16 +01:00
Ole Tange b597f4166f Released as 20180122 ('Mayon') 2018-01-22 17:23:23 +01:00
Ole Tange a048f547eb Fixed bug #52207: Exit status 0 when child job is killed, even with "now,fail=1" 2018-01-06 19:58:01 +01:00
Ole Tange bf24d5e4db Fixed bug #52769: --lb puts stdout on stderr sometimes. 
Fixed bug #52507: parset arr1 -v echo ::: fails.
--dryrun should not append to joblog.
Cleaned up print_tag().
Some testsuite reorg.
 2018-01-03 09:03:16 +01:00
Ole Tange d1aa26c1c9 Fixed bug #52740: Bash redirection with process substitution blocks. 2017-12-26 15:46:00 +01:00
Ole Tange da545d53ff parallel: Check if PARALLEL_SHELL is in path. 
env_parallel compatible with more unices.
 2017-12-23 00:01:20 +01:00
Ole Tange b843ec7398 parallel: Auto add hostgroup if given on arg. 2017-12-21 18:53:07 +01:00
Ole Tange 414667b8b4 parallel: -j1 --halt soon,fail=1 bug. 2017-12-21 18:40:03 +01:00
Ole Tange 400611158b env_parallel: which is now _which(). Bugfix for (t)csh when tempfile does not exist. 2017-12-04 22:44:34 +01:00
Ole Tange 77599baa96 env_parallel: bugfix of ash/dash/sh + increased testing. 2017-12-03 01:40:01 +01:00
Ole Tange 8f63e3f5e7 env_parallel: Aliases with newlines either supported (ash/dash/zsh) or warning (bash). 
testsuite: functionized freebsd tests.
 2017-12-01 20:53:56 +01:00
Ole Tange 9e5433e3e5 parset/env_parset: Support for ash, dash, ksh, sh, zsh. 2017-11-26 16:18:55 +01:00
Ole Tange c73a27254a Released as 20171122 ('Mugabe') 2017-11-22 23:29:03 +01:00
Ole Tange c63881c4cc parallel: $XDG_* 2017-10-10 00:33:43 +02:00
Ole Tange f09e0384ff parallel: {choose_k} added to --plus. 2017-09-22 00:50:39 +02:00
Ole Tange 897d9f5db9 parallel: PARALLEL_RSYNC_OPTS and --rsync-opts introduced. 
parallel: --bar -m bugfix.
 2017-08-24 00:43:37 +02:00
Ole Tange 3eef90da33 parallel: --line-buffer speedup. 
parallel: Max command line length relaxed due to bzip2'ing before transfer.
 2017-08-21 23:58:53 +02:00
Ole Tange 67c4377715 parcat: --rm, reading args from stdin. 2017-08-12 18:37:52 +02:00
Ole Tange 3a0cc34b8b Released as 20170722 ('Grenfell') 2017-07-21 23:29:19 +02:00
Ole Tange 9179a80bd3 parallel: SIGPIPE must be handled differently if printing to --pipe. 
parallel: --keep-dirlinks is not supported on Centos3/Redhat9.
 2017-07-21 21:43:34 +02:00
Ole Tange 10b4539b1f Fixed env_parallel not working on old versions of Bash. 
https://lists.gnu.org/archive/html/bug-parallel/2017-07/msg00000.html
 2017-07-06 17:22:50 +02:00
Ole Tange 8e22009706 Fixed newlines and positional replacement strings 
https://lists.gnu.org/archive/html/parallel/2017-07/msg00001.html
 2017-07-06 14:36:06 +02:00
Ole Tange e0baea9a4a Fixed bug #51337: --lb does not kill jobs at sigpipe. 2017-06-29 12:13:57 +02:00
Ole Tange 144164d516 Fixed bug #51299: --retry-failed with command with newline. 2017-06-23 23:00:05 +02:00
Ole Tange f3d117e7bb parallel: Fixed bug #51293: parallel does not preserve symlinked directory structure on remote. 2017-06-22 23:14:32 +02:00
Ole Tange dce32425eb testsuite: Made the tests more portable. 2017-06-22 13:35:58 +02:00
Ole Tange 0b8e949cbb parallel: Allow for empty loadavg file. This can happen on NFS. 
Passes testsuite.
 2017-06-18 21:15:36 +02:00
Ole Tange fc6ad919d3 parallel: Allow \257 (Macron) in the command line. 2017-06-05 13:41:15 +02:00
Ole Tange dd25255ca8 parallel: Fixed bug #51039: --dry-run --timeout 3600 -u breaks. 2017-05-16 21:32:13 +02:00
Ole Tange 54200832e4 parallel: --timeout can now use s=second,m=minute,h=hour,d=day. 
parallel: --dr is now alias for --dry-run.
 2017-05-16 01:27:11 +02:00
Ole Tange 61525c90e1 Fixed bug #51006: Slow total_jobs() eats job 2017-05-11 22:57:46 +02:00
Ole Tange a7a9e522dd Fixed bug #50901: --sqlworker should use hostname in the joblog instead of :. 2017-04-30 19:00:37 +02:00
Ole Tange 77da672741 parallel: --tmux needs LC_CTYPE set. 
parallel: '--halt done'.
 2017-04-22 22:42:11 +02:00
Ole Tange 426ea9b372 env_parallel.{ash,bash,dash,ksh,sh}: Fixed bug #50815: env_parallel should warn if the environment is too big. 
parallel --tmux --fg: Connect to tmux socket more aggressively.
parallel --joblog: Fixed bug #50781: joblog format with multiline commands.
Irix's Perl does not have decode_base64 and is no longer supported.
 2017-04-17 16:25:58 +02:00
Ole Tange 253c94786f env_parallel.bash: Initial release of parset. 
parallel: Bugfix in some --plus dynamic replacement strings.
parallel: Deal better with commands containing newlines in --joblog.
parallel: Bugfix for --load in csh.
parallel_alternatives.pod: More comparison to rush-parallel.
 2017-04-15 00:00:21 +02:00
Ole Tange 70e29c7b5b Fixed bug #50685: single ::::+ does not work. 2017-04-01 04:04:47 +02:00
Ole Tange 1de0d2be9b parallel: Fixed bug #50590: Support systems where setpgrp fails. 2017-04-01 02:59:07 +02:00
Ole Tange e135fb6fd3 Fixed bug #50655: Positional dynamic replacement strings do not work. 2017-03-28 21:30:06 +02:00
Ole Tange 05afa7ec65 Fixed bug #50229: --tee -S fails. 
Minor adjustments to dynamic --rpl's in --plus.
Documentation prettification for man.pdf.
 2017-03-21 22:20:38 +01:00
Ole Tange d08c8ac417 parallel: --plus enables most bashisms for replacement strings. 2017-03-11 21:19:10 +01:00
Ole Tange 06e2dd958d Fixed bug #50435: Remote fifo broke in 20150522. 
Fixed bug #50441: env_parallel --pipe in csh does not work.
Fixed test bug #50386: --fifo does not export function, --cat does.
 2017-03-04 16:03:14 +01:00
Ole Tange 180ed0dd32 Fixed bug #50386: --fifo does not export function, --cat does. 
Test broken.
 2017-03-02 22:40:46 +01:00
Ole Tange a2358aebe4 Faster version bug #45479: --pipe/--pipepart --tee. 2017-02-05 23:53:28 +01:00
Ole Tange 70006774e8 Fixed bug #50228: --pipe --tagstring broken. 2017-02-05 03:24:23 +01:00
Ole Tange c028fa0ad7 Fixed bug #45479: --pipe/--pipepart --tee. 2017-02-05 02:46:29 +01:00
Ole Tange 1229288418 Fixed bug #50081: --keep-order --round-robin should give predictable results. 2017-02-05 00:27:10 +01:00
Ole Tange 09cc44e209 Fixed (for --retries) bug #50139: Replacement strings in other options. 2017-02-04 16:01:42 +01:00
Ole Tange dae4f4b7ca parallel: If --results {replstr} ends in /: save in dir. Otherwise save as file. 2017-01-27 23:15:25 +01:00
Ole Tange 968e2ab2bb Testsuite for bug #50107: --tmux --fg should also write how to access it. 2017-01-21 19:55:14 +01:00
Ole Tange 924a0f1aab sql: Store credentials in tmpfile instead of giving it on the command line. 
parallel: Allow --block > 2GB with --pipepart.
parallel: Fixed bug #50107: --tmux --fg should also write how to access it.
 2017-01-21 18:09:01 +01:00
Ole Tange 7032e5dec2 sql: Use credentials file for MySQL to avoid warning. 2017-01-17 00:16:03 +01:00