tange/parallel
1
0
Fork 0
mirror of https://git.savannah.gnu.org/git/parallel.git synced 2024-11-25 15:37:56 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
1614 commits 1 branch 311 tags 27 MiB
Commit graph

807 commits

Author SHA1 Message Date
Ole Tange de8f083ba4 parallel: $PARALLEL_ARGHOSTGROUPS and {agrp} implemented. 2020-12-30 13:42:02 +01:00
Ole Tange ff7f7c918b Released as 20201222 ('Vaccine') 2020-12-21 14:30:23 +01:00
Ole Tange 2a600a97be parallel: {hgrp} = intersection of the hgrp of job and sshlogin. 2020-12-20 23:24:34 +01:00
Ole Tange 48e29256e2 parallel: --pipe engine changed making --pipe alpha quality. 2020-12-20 22:07:47 +01:00
Ole Tange a86a786189 parallel: --results -.json outputs a single JSON line per job. 2020-12-19 04:21:04 +01:00
Ole Tange e58cf1d7f7 parallel: --(ssh)delay auto implemented (bug #58911). 2020-12-12 18:12:04 +01:00
Ole Tange fca3e928d8 parallel: --group-by supports --colsep ' '. 2020-12-08 18:59:10 +01:00
Ole Tange 8df731b9ab Fixed bug #59453: PARALLEL_HOME with plus sign causes error. 2020-12-07 16:24:54 +01:00
Ole Tange e1a62d362d Released as 20201122 ('Biden') 2020-11-22 16:22:54 +01:00
Ole Tange e30d812c99 parallel: Round --block if given as non-integer. 2020-11-21 23:18:13 +01:00
Ole Tange bb2c22b0d4 parallel: --(n)onall and --sshdelay fixed. 2020-10-22 21:47:01 +02:00
Ole Tange 7c33cfa456 parallel-centos3.sh: Fixed bug #58971: Shellshock test in vagrant. 2020-10-14 23:00:32 +02:00
Ole Tange 95eb81b901 Fixed bug #59146: Support --termseq for remote jobs. 2020-10-14 22:49:58 +02:00
Ole Tange 69cca79c3b parallel: --sqlworker combined with -N fixed. 2020-10-14 19:27:31 +02:00
Ole Tange 53d688077c parallel: Faster --group-by. -vv --joblog / --onall --ssh bugfix. 2020-10-13 01:17:14 +02:00
Ole Tange f0b40c126c Released as 20200922 ('Ginsburg') 2020-09-23 17:41:03 +02:00
Ole Tange 3fc2bf228f parallel: GNU/Linux cpu detection by reading CPU topology. 2020-09-19 16:47:01 +02:00
Ole Tange 31031e521d parallel: Fixed bug #59010: Max command line length for MacOS 2020-09-12 23:33:55 +02:00
Ole Tange 555863c0b5 parallel: Fixed bug #58985: sem stall if .parallel/semaphore is chmod 0 2020-08-30 20:03:37 +02:00
Ole Tange e6c9dfe010 Fixed bug #59006: rsync version 3.2.3 is not detected correctly. 2020-08-29 22:12:46 +02:00
Ole Tange 5ea74055dd Released as 20200822 ('Beirut') 2020-08-23 01:31:39 +02:00
Ole Tange 19cd8e015f parallel: Attempt 3 at fixing https://lists.gnu.org/archive/html/parallel/2020-08/msg00003.html 2020-08-20 23:07:56 +02:00
Ole Tange 2ed5279f6a parallel: Attempt 2 at fixing https://lists.gnu.org/archive/html/parallel/2020-08/msg00003.html 2020-08-16 10:12:42 +02:00
Ole Tange 72dd439f20 parallel: Fix https://lists.gnu.org/archive/html/parallel/2020-08/msg00003.html 2020-08-11 22:55:31 +02:00
Ole Tange 79b56269bb parallel: Fixed bug #58802. Now passes testsuite. 2020-08-07 22:20:30 +02:00
Ole Tange ce2f84d151 env_parallel.bash: More read-only variables. 2020-07-22 22:45:09 +02:00
Ole Tange 28620b2c49 parallel: Avoid warning in MySQL, fish and perl. 2020-06-25 13:07:02 +02:00
Ole Tange 62ff9a8722 Released as 20200622 ('Floyd') 2020-06-23 00:34:52 +02:00
Ole Tange 3cd3f75200 parallel: With many --sqlworkers minimize the number of duplicates. 2020-06-11 23:25:18 +02:00
Ole Tange b5b3d5dc3e release procedure updated. 
parallel: --plus --onall now works.
parallel: --blocktimeout must be >= 1.
 2020-05-31 16:42:04 +02:00
Ole Tange 1e7da025c4 Released as 20200522 ('Kraftwerk') 2020-05-23 20:04:09 +02:00
Ole Tange 5bba5c922d parallel: $PARALLEL_JOBSLOT = {%} unless the job is being retried. 
parallel: $PARALLEL_SSHLOGIN = sshlogin with number of cores removed.
parallel: $PARALLEL_SSHHOST = the host part of an sshlogin.
parallel: {slot} {sshlogin} {host} added to --plus.
 2020-05-23 18:44:42 +02:00
Ole Tange 4430ee5f49 testsuite: Test all assigned UTF8 characters. 2020-05-23 18:44:12 +02:00
Ole Tange 6a67fd09d4 parallel: Fixed bug #57055: {sshlogin} shorthand for $PARALLEL_SSHLOGIN. 2020-05-08 03:35:51 +02:00
Ole Tange e5fd1c0767 Released as 20200422 ('10years') 2020-04-22 20:15:59 +02:00
Ole Tange d44cb9f336 parallel: CSV uses special DBI->connect() options for subdirs. 2020-03-21 19:07:16 +01:00
Ole Tange b34b30b566 parallel: --sql* should add Vn columns for --colsep. 2020-03-15 04:28:12 +01:00
Ole Tange f90250f2cc Released as 20200222 ('BrexitDay') 2020-02-23 01:10:44 +01:00
Ole Tange 0fe9be5f00 Released as 20200122 ('Soleimani') 2020-01-22 18:03:29 +01:00
Ole Tange fc97f4f61b testsuite: parallel-local-*s.sh will now timeout if a test takes >10x the median time. 2020-01-12 09:14:21 +01:00
Ole Tange b804568ffd parallel: Fixed bug #56403: --pipe block by time. Passes testsuite. 
Yearly copyright update.
 2020-01-09 14:37:41 +01:00
Ole Tange a785e66b6c Fixed bug #57364: Race condition creating len cache file. 2019-12-22 15:41:03 +01:00
Ole Tange 21fb3b6e60 Released as 20191122 ('QuantumSupremacy') 2019-11-23 22:14:03 +01:00
Ole Tange 1ba05d3bb7 Released as 20191022 ('DrivingIT') 2019-10-21 21:18:32 +02:00
Ole Tange eac8944b1d parallel: Fixed bug #56981: --tee should try and use --output-error=warn-nopipe 2019-10-02 21:35:02 +02:00
Ole Tange 34cd579c98 Released as 20190922 ('Stallman') 2019-09-22 09:12:28 +02:00
Ole Tange 372d3fdf24 Fixed bug #55992: --delay with ms accuracy (around 5 ms). 2019-09-22 07:30:08 +02:00
Ole Tange c7851f76e2 testsuite/REQUIREMENTS: Updated for Ubuntu 18.04. 2019-09-15 15:55:56 +02:00
Ole Tange c0e63fb81c Released as 20190822 ('JesperSvarre') 2019-08-22 23:07:56 +02:00
Ole Tange 2aabbf5e76 parallel: --header : sets named replacement string if input line ends in \r\n'. 2019-07-31 22:38:30 +02:00
Ole Tange 3b7b988c16 Released as 20190722 ('Ryugu') 2019-07-23 09:00:09 +02:00
Ole Tange e91d8597a0 parallel: Fixed $HOME and cached setpgrp. 2019-07-20 20:58:54 +02:00
Ole Tange c36cb46a23 parallel: Fixed bug #56578: --lb --tag misses some lines. 
parallel: Experimental (buggy) --bin.
 2019-07-14 16:48:57 +02:00
Ole Tange 088b43b5b0 parallel: $PARALLEL_SSHLOGIN can be used in command line. 2019-06-27 15:49:49 +02:00
Ole Tange 2e26627e39 parallel: -J ./profile, -J /abs/profile, -J configprofile. 
parallel: Fixed bug #56558: --rrs with --recend that is not regexp.
 2019-06-26 23:11:33 +02:00
Ole Tange a24bef3d03 parallel: Fixed bug in optimized finding (grand)*parent shell. 2019-06-26 13:46:29 +02:00
Ole Tange f8782f43a7 parallel: Cache CPU spec and setpgrp method in file. Startup 15% faster. 2019-06-25 21:18:27 +02:00
Ole Tange ebdc4c641a parallel: Fixed bug #56540: parallel echo $(printf "\257\256") ::: $(printf "\257\256"). 
parallel: added uq() as function for unquoting replacement string.
 2019-06-23 08:31:28 +02:00
Ole Tange f8ce632157 Released as 20190622 ('HongKong') 2019-06-21 16:52:48 +02:00
Ole Tange 5d81c7c053 parallel: Fixed bug #56275: --shard with named column and perl expr. 2019-06-17 01:21:45 +02:00
Ole Tange c25ae9cc87 parallel: --pipepart --groupby implemented. 2019-05-22 21:57:08 +02:00
Ole Tange aa62104eb5 --pipepart --group-by implemented (except column names). 2019-05-20 01:05:14 +02:00
Ole Tange 324a9f3a07 parallel: --group-by bug: Column name with Capitals. 
testsuite: Re-org for faster execution.
 2019-05-06 01:06:48 +02:00
Ole Tange 818439c3ff parallel: --group-by initial version. Documentation missing. 2019-05-04 23:00:25 +02:00
Ole Tange 9fd39b122d Fixed: bug #56096: dbi-csv no such column. 2019-04-28 23:02:10 +02:00
Ole Tange 3319fcad5b Released as 20190422 ('Invitation') 2019-04-21 20:16:33 +02:00
Ole Tange dbc36fb062 Released as 20190322 ('FridayforFuture') 2019-03-21 23:27:39 +01:00
Ole Tange fe4173927f parallel: Fixed: --null conflicts with --resume --joblog. 2019-03-17 23:07:32 +01:00
Ole Tange 5e1e3775fc parallel: --line-buffer memory usage changed from 2x to 1x. 2019-02-24 01:16:40 +01:00
Ole Tange fd4694c66b Released as 20190222 ('Baghuz') 2019-02-22 22:20:59 +01:00
Ole Tange 321419c73a parallel: Unexplainable bug in --interactive fixed. 2019-02-22 19:00:42 +01:00
Ole Tange 79666b4906 parallel: Include parcat code in sharding to avoid depending on parcat. 2019-02-16 17:23:08 +01:00
Ole Tange 904cda6e19 parallel: --demux initial version. 2019-02-14 01:35:32 +01:00
Ole Tange 14581e8483 parallel: Support for Android/Termux. 2019-02-13 21:32:49 +01:00
Ole Tange 0615d0340b parallel: --shellquote can be given multiple times. 2019-01-29 06:58:12 +01:00
Ole Tange 62e34af892 Released as 20190122 ('Shutdown') 2019-01-21 03:16:59 +01:00
Ole Tange 8700e957fc parallel: Calculation of total_jobs() make better. 
parallel: Buffer size for --linebuffer increased for better performance.
parallel: --(n)onall now respects --memfree.
 2019-01-19 02:20:44 +01:00
Ole Tange 4234c24658 env_parallel: --end-session implemented. 2019-01-18 16:15:47 +01:00
Ole Tange e79d1d978b bug #55399: Clean up --wd ... when run locally. 
bug #55398: set $OLDPWD when using --wd.
 2019-01-06 13:45:43 +01:00
Ole Tange 48b1743b84 parallel: Prototypes on most functions added. 
parallel: Control flow for --roundrobin simplyfied.
 2019-01-01 14:34:04 +01:00
Ole Tange 036319dc09 parallel --halt soon,fail=100% </dev/null should not give division by zero. 2018-12-29 23:21:46 +01:00
Ole Tange f9ff5717fe sem --quote should not add empty argument. 2018-12-29 22:33:50 +01:00
Ole Tange 9fc4ad53af testsuite: Make some tests more stable. 2018-12-29 21:04:58 +01:00
Ole Tange a51c54dafe env_parallel.fish: Converted to '-quoting. 2018-12-28 12:47:25 +01:00
Ole Tange 1501d93eea Merge branch 'master' of ssh://git.sv.gnu.org/srv/git/parallel 2018-11-30 07:15:46 +01:00
Ole Tange 8286e771ec parallel: Simpler job scheduling flow. 2018-11-25 19:06:06 +01:00
Ole Tange 83ffe1af13 parallel: Simpler job control flow. 2018-11-23 00:30:23 +01:00
Ole Tange 001d9d0f66 env_parallel.fish: Initial support for --session. 
parallel: 'true | parallel --shuf echo' fixed.
testsuite: Updates due to Ubuntu 18.04.
parallel: Fixed bug #54869: Long lines break.
 2018-10-23 00:46:38 +02:00
Ole Tange 4f0422d9b0 Released as 20180922 ('Danske') 2018-09-22 23:09:30 +02:00
Ole Tange 36a8238a20 parallel: bug #54647: parset ignores empty lines. 
parallel: minix is working again.
parallel: bug #54128: command too long when exporting big env
testsuite: polarhome parallelized.
 2018-09-21 00:15:14 +02:00
Ole Tange b7e789c02f Fixed bug #54352: env_parallel -Slo --nonall myfunc broken in 20180722. 2018-08-27 01:54:11 +02:00
Ole Tange 490474ea8c parset: set exit code. 2018-08-23 00:21:29 +02:00
Ole Tange 2dc37640a6 env_parallel.fish: Recursive env_parallel possible. 
parallel: --rr = --round-robin.
 2018-07-24 19:50:31 +02:00
Ole Tange 75007fcbbf parallel: \-quoting replaced with '-quoting. 2018-07-22 08:58:32 +02:00
Ole Tange 628c0029cc env_parallel: Fixed bug #54212: env_parallel env_parallel echo ::: 1 fails. 2018-07-18 17:29:57 +02:00
Ole Tange fe92398309 parallel: Fixed perl expressions spanning multiple lines. 2018-07-18 14:36:04 +02:00
Ole Tange e1e8693797 parallel: Fixed bug #54328: --pipe --recend '' blocks. 2018-07-18 09:49:24 +02:00
Ole Tange 896048efbc parallel: Calculate #CPU as either #threads, #cores, or #sockets. 2018-07-14 06:11:58 +02:00
Ole Tange 0d5072907d env_parallel.mksh: Initial version. 2018-07-13 07:33:11 +02:00
Ole Tange dd5fb4a08b env_parallel: Code is now more similar for {d,b,}ash,{k,z}sh. 2018-07-11 18:46:05 +02:00
Ole Tange 1a81db5e2b parallel: Test that PARALLEL_ENV as a fifo works. 
testsuite: Check normal installation (incl. building docs).
testsuite: Less sensitive to run on slow machine.
 2018-07-08 20:45:39 +02:00
Ole Tange efec4ca8a2 Released as 20180622 ('KimTrump') 2018-06-21 00:10:08 +02:00
Ole Tange 4e301386e3 parallel: Deal better with multibyte chars by forcing LC_ALL=C. 2018-06-10 17:07:24 +02:00
Ole Tange 87b9d9fe29 Released as 20180522 ('GreatMarchOfReturn') 2018-05-23 01:07:40 +02:00
Ole Tange 9b2012f021 parallel: Better parent_shell detection. 2018-05-22 21:02:10 +02:00
Ole Tange 94ac9fd72c parallel: --results test.csv bug incl. testing. 2018-05-21 10:04:31 +02:00
Ole Tange a050662275 Fixed bug #53864: env_parallel + parset as part of parallel --embed. 2018-05-08 23:16:48 +02:00
Ole Tange 60e45b20eb env_parallel: --session implemented. 2018-04-27 18:52:00 +02:00
Ole Tange 1422b7b43a parallel: Fixed bug #53748: -k --retries 10 + out of filehandles = blocking. 2018-04-25 22:38:42 +02:00
Ole Tange 9a1d2e9dad parallel: Fixed bug #53718: --pipe --regexp -N blocks. 2018-04-23 23:45:16 +02:00
Ole Tange 3fdd3a6019 Released as 20180422 ('Tiangong-1') 2018-04-22 23:32:22 +02:00
Ole Tange 1e15645faa parallel: --pipe --csv: Pass only full CSV-records. 2018-04-22 16:28:01 +02:00
Ole Tange bbcef1032c parallel: --csv initial version. 2018-04-21 21:50:42 +02:00
Ole Tange 8b050b68d4 env_parallel.*sh: Parsing 'type' depends on $LANG. Set LANG=C. 
--tee: No longer spawns cat, but uses redirection instead.
 2018-04-20 23:29:44 +02:00
Ole Tange 130e299af6 parallel: --timeout now gives warning. 
niceload: --pid PID,PID,PID implemented.
 2018-03-21 22:57:28 +01:00
Ole Tange e2792e2101 parallel --embed uses same code for all shells. 
parallel --embed compatible with env_parallel, parset, env_parset.
env_parallel.* update to be more like env_parallel.sh.
 2018-03-06 01:35:26 +01:00
Ole Tange eb1a79b04b Released as 20180222 ('Henrik') 2018-02-22 22:53:38 +01:00
Ole Tange e6339f4512 parset: Now a copy of env_parallel. 2018-02-22 20:43:33 +01:00
Ole Tange 6657e056f2 parallel: --nice has not been working locally since 20161022. 2018-02-05 21:39:59 +01:00
Ole Tange 78fade1e62 parallel: --embed initial version. Incompatible with env_*. 
env_parallel.*: Minor bugfixes.
parallel: More commenting.
 2018-01-25 03:48:16 +01:00
Ole Tange b597f4166f Released as 20180122 ('Mayon') 2018-01-22 17:23:23 +01:00
Ole Tange a048f547eb Fixed bug #52207: Exit status 0 when child job is killed, even with "now,fail=1" 2018-01-06 19:58:01 +01:00
Ole Tange bf24d5e4db Fixed bug #52769: --lb puts stdout on stderr sometimes. 
Fixed bug #52507: parset arr1 -v echo ::: fails.
--dryrun should not append to joblog.
Cleaned up print_tag().
Some testsuite reorg.
 2018-01-03 09:03:16 +01:00
Ole Tange d1aa26c1c9 Fixed bug #52740: Bash redirection with process substitution blocks. 2017-12-26 15:46:00 +01:00
Ole Tange da545d53ff parallel: Check if PARALLEL_SHELL is in path. 
env_parallel compatible with more unices.
 2017-12-23 00:01:20 +01:00
Ole Tange b843ec7398 parallel: Auto add hostgroup if given on arg. 2017-12-21 18:53:07 +01:00
Ole Tange 414667b8b4 parallel: -j1 --halt soon,fail=1 bug. 2017-12-21 18:40:03 +01:00
Ole Tange 400611158b env_parallel: which is now _which(). Bugfix for (t)csh when tempfile does not exist. 2017-12-04 22:44:34 +01:00
Ole Tange 77599baa96 env_parallel: bugfix of ash/dash/sh + increased testing. 2017-12-03 01:40:01 +01:00
Ole Tange 8f63e3f5e7 env_parallel: Aliases with newlines either supported (ash/dash/zsh) or warning (bash). 
testsuite: functionized freebsd tests.
 2017-12-01 20:53:56 +01:00
Ole Tange 9e5433e3e5 parset/env_parset: Support for ash, dash, ksh, sh, zsh. 2017-11-26 16:18:55 +01:00
Ole Tange c73a27254a Released as 20171122 ('Mugabe') 2017-11-22 23:29:03 +01:00
Ole Tange 746b4304a6 Passes testsuite (except polarhome). 2017-10-16 15:41:54 +02:00
Ole Tange c63881c4cc parallel: $XDG_* 2017-10-10 00:33:43 +02:00
Ole Tange f09e0384ff parallel: {choose_k} added to --plus. 2017-09-22 00:50:39 +02:00
Ole Tange 897d9f5db9 parallel: PARALLEL_RSYNC_OPTS and --rsync-opts introduced. 
parallel: --bar -m bugfix.
 2017-08-24 00:43:37 +02:00
Ole Tange 3eef90da33 parallel: --line-buffer speedup. 
parallel: Max command line length relaxed due to bzip2'ing before transfer.
 2017-08-21 23:58:53 +02:00
Ole Tange 67c4377715 parcat: --rm, reading args from stdin. 2017-08-12 18:37:52 +02:00
Ole Tange 3a0cc34b8b Released as 20170722 ('Grenfell') 2017-07-21 23:29:19 +02:00
Ole Tange 9179a80bd3 parallel: SIGPIPE must be handled differently if printing to --pipe. 
parallel: --keep-dirlinks is not supported on Centos3/Redhat9.
 2017-07-21 21:43:34 +02:00
Ole Tange 10b4539b1f Fixed env_parallel not working on old versions of Bash. 
https://lists.gnu.org/archive/html/bug-parallel/2017-07/msg00000.html
 2017-07-06 17:22:50 +02:00
Ole Tange 8e22009706 Fixed newlines and positional replacement strings 
https://lists.gnu.org/archive/html/parallel/2017-07/msg00001.html
 2017-07-06 14:36:06 +02:00
Ole Tange e0baea9a4a Fixed bug #51337: --lb does not kill jobs at sigpipe. 2017-06-29 12:13:57 +02:00
Ole Tange 144164d516 Fixed bug #51299: --retry-failed with command with newline. 2017-06-23 23:00:05 +02:00
Ole Tange 215aa6039f parallel: Fixed bug #51290: Macron with -q. 2017-06-23 07:44:14 +02:00
Ole Tange f3d117e7bb parallel: Fixed bug #51293: parallel does not preserve symlinked directory structure on remote. 2017-06-22 23:14:32 +02:00
Ole Tange 526f2bfd4c Released as 20170622 ('Manchester') 2017-06-22 14:22:23 +02:00
Ole Tange dce32425eb testsuite: Made the tests more portable. 2017-06-22 13:35:58 +02:00
Ole Tange 0b8e949cbb parallel: Allow for empty loadavg file. This can happen on NFS. 
Passes testsuite.
 2017-06-18 21:15:36 +02:00
Ole Tange fc6ad919d3 parallel: Allow \257 (Macron) in the command line. 2017-06-05 13:41:15 +02:00