Commit graph

1259 commits

Author SHA1 Message Date
Ole Tange 72dd439f20 parallel: Fix https://lists.gnu.org/archive/html/parallel/2020-08/msg00003.html 2020-08-11 22:55:31 +02:00
Ole Tange 79b56269bb parallel: Fixed bug #58802. Now passes testsuite. 2020-08-07 22:20:30 +02:00
Ole Tange d8f99bf85f parallel: Fixed bug #58802: --results unreliable under Cygwin. 2020-07-23 10:31:08 +02:00
Ole Tange 22cc1f06e6 Released as 20200722 ('PrivacyShield') 2020-07-22 23:06:03 +02:00
Ole Tange ce2f84d151 env_parallel.bash: More read-only variables. 2020-07-22 22:45:09 +02:00
Ole Tange 28620b2c49 parallel: Avoid warning in MySQL, fish and perl. 2020-06-25 13:07:02 +02:00
Ole Tange 62ff9a8722 Released as 20200622 ('Floyd') 2020-06-23 00:34:52 +02:00
Ole Tange 3cd3f75200 parallel: With many --sqlworkers minimize the number of duplicates. 2020-06-11 23:25:18 +02:00
Ole Tange b5b3d5dc3e release procedure updated.
parallel: --plus --onall now works.
parallel: --blocktimeout must be >= 1.
2020-05-31 16:42:04 +02:00
Ole Tange 1e7da025c4 Released as 20200522 ('Kraftwerk') 2020-05-23 20:04:09 +02:00
Ole Tange 5bba5c922d parallel: $PARALLEL_JOBSLOT = {%} unless the job is being retried.
parallel: $PARALLEL_SSHLOGIN = sshlogin with number of cores removed.
parallel: $PARALLEL_SSHHOST = the host part of an sshlogin.
parallel: {slot} {sshlogin} {host} added to --plus.
2020-05-23 18:44:42 +02:00
Ole Tange 6a67fd09d4 parallel: Fixed bug #57055: {sshlogin} shorthand for $PARALLEL_SSHLOGIN. 2020-05-08 03:35:51 +02:00
Ole Tange e5fd1c0767 Released as 20200422 ('10years') 2020-04-22 20:15:59 +02:00
Ole Tange 0c21f74a00 Fixed bug #58027: If .parallel/tmp missing on CygWin... 2020-03-23 16:35:37 +01:00
Ole Tange 36912dc230 Fixed bug #57886: Errors when using different version on remote. 2020-03-22 13:50:17 +01:00
Ole Tange ab074aa198 Released as 20200322 ('Corona') 2020-03-21 21:32:24 +01:00
Ole Tange d44cb9f336 parallel: CSV uses special DBI->connect() options for subdirs. 2020-03-21 19:07:16 +01:00
Ole Tange b34b30b566 parallel: --sql* should add Vn columns for --colsep. 2020-03-15 04:28:12 +01:00
Ole Tange f90250f2cc Released as 20200222 ('BrexitDay') 2020-02-23 01:10:44 +01:00
Ole Tange 0fe9be5f00 Released as 20200122 ('Soleimani') 2020-01-22 18:03:29 +01:00
Ole Tange 033dd3df91 parallel: Fix 2 of bug #57364: Race condition creating len cache file.
parallel: New sysread loop of --pipe broken on perl 5.14 (32-bit issue).
2020-01-22 17:33:53 +01:00
Ole Tange b804568ffd parallel: Fixed bug #56403: --pipe block by time. Passes testsuite.
Yearly copyright update.
2020-01-09 14:37:41 +01:00
Ole Tange a785e66b6c Fixed bug #57364: Race condition creating len cache file. 2019-12-22 15:41:03 +01:00
Ole Tange f1e58af040 --retries works (possibly breaking something else). 2019-11-23 23:16:20 +01:00
Ole Tange 21fb3b6e60 Released as 20191122 ('QuantumSupremacy') 2019-11-23 22:14:03 +01:00
Ole Tange 7bab1b45bc Documentation update. 2019-11-21 23:46:15 +01:00
Ole Tange 95ecf18d0c parallel: CPU detection bug on Android fixed. 2019-10-25 00:47:38 +02:00
Ole Tange 1ba05d3bb7 Released as 20191022 ('DrivingIT') 2019-10-21 21:18:32 +02:00
Ole Tange 73f554ad8f parallel: Give better error message if file not found when using --pipepart. 2019-10-09 19:18:53 +02:00
Ole Tange eac8944b1d parallel: Fixed bug #56981: --tee should try and use --output-error=warn-nopipe 2019-10-02 21:35:02 +02:00
Ole Tange 34cd579c98 Released as 20190922 ('Stallman') 2019-09-22 09:12:28 +02:00
Ole Tange 372d3fdf24 Fixed bug #55992: --delay with ms accuracy (around 5 ms). 2019-09-22 07:30:08 +02:00
Ole Tange 512059bf1e parallel: Fixed bug #56873: Auto detect --nice level. 2019-09-16 23:12:53 +02:00
Ole Tange c0e63fb81c Released as 20190822 ('JesperSvarre') 2019-08-22 23:07:56 +02:00
Ole Tange 2aabbf5e76 parallel: --header : sets named replacement string if input line ends in \r\n'. 2019-07-31 22:38:30 +02:00
Ole Tange 3b7b988c16 Released as 20190722 ('Ryugu') 2019-07-23 09:00:09 +02:00
Ole Tange e91d8597a0 parallel: Fixed $HOME and cached setpgrp. 2019-07-20 20:58:54 +02:00
Ole Tange c36cb46a23 parallel: Fixed bug #56578: --lb --tag misses some lines.
parallel: Experimental (buggy) --bin.
2019-07-14 16:48:57 +02:00
Ole Tange 088b43b5b0 parallel: $PARALLEL_SSHLOGIN can be used in command line. 2019-06-27 15:49:49 +02:00
Ole Tange 2e26627e39 parallel: -J ./profile, -J /abs/profile, -J configprofile.
parallel: Fixed bug #56558: --rrs with --recend that is not regexp.
2019-06-26 23:11:33 +02:00
Ole Tange e8d7b1627a parallel: Evaluate --tagstring {=...=} for each line with --lb. 2019-06-26 20:35:00 +02:00
Ole Tange a24bef3d03 parallel: Fixed bug in optimized finding (grand)*parent shell. 2019-06-26 13:46:29 +02:00
Ole Tange 7aa0394278 parallel: Speedup finding shell of (grand)*parent pid. 2019-06-25 23:58:22 +02:00
Ole Tange f8782f43a7 parallel: Cache CPU spec and setpgrp method in file. Startup 15% faster. 2019-06-25 21:18:27 +02:00
Ole Tange ebdc4c641a parallel: Fixed bug #56540: parallel echo $(printf "\257\256") ::: $(printf "\257\256").
parallel: added uq() as function for unquoting replacement string.
2019-06-23 08:31:28 +02:00
Ole Tange 41866970d6 R: Autoinstall plyr and data.table if not already installed. 2019-06-22 22:01:11 +02:00
Ole Tange f8ce632157 Released as 20190622 ('HongKong') 2019-06-21 16:52:48 +02:00
Ole Tange 5d81c7c053 parallel: Fixed bug #56275: --shard with named column and perl expr. 2019-06-17 01:21:45 +02:00
Ole Tange 17a5fd702d Released as 20190522 ('Akihito') 2019-05-22 22:18:04 +02:00
Ole Tange c25ae9cc87 parallel: --pipepart --groupby implemented. 2019-05-22 21:57:08 +02:00
Ole Tange aa62104eb5 --pipepart --group-by implemented (except column names). 2019-05-20 01:05:14 +02:00
Ole Tange 324a9f3a07 parallel: --group-by bug: Column name with Capitals.
testsuite: Re-org for faster execution.
2019-05-06 01:06:48 +02:00
Ole Tange 818439c3ff parallel: --group-by initial version. Documentation missing. 2019-05-04 23:00:25 +02:00
Ole Tange 32318fca9c 10seconds_install: Update copyright year. 2019-05-02 00:58:51 +02:00
Ole Tange 9fd39b122d Fixed: bug #56096: dbi-csv no such column. 2019-04-28 23:02:10 +02:00
Ole Tange 81741d3dbc Re-fixed #56115: Compute max-line-length fast on CygWin.
Fixed bug #56214: *Q is not set in shell_quote_scalar.
2019-04-28 22:13:10 +02:00
Ole Tange d6a3848b68 niceload: Fix https://lists.gnu.org/archive/html/bug-parallel/2019-04/msg00000.html 2019-04-22 01:26:32 +02:00
Ole Tange 3319fcad5b Released as 20190422 ('Invitation') 2019-04-21 20:16:33 +02:00
Ole Tange e475d04069 Fixed bug #56115: Compute max-line-length fast on CygWin. 2019-04-21 14:44:07 +02:00
Ole Tange dbc36fb062 Released as 20190322 ('FridayforFuture') 2019-03-21 23:27:39 +01:00
Ole Tange 0fa1bbff20 parallel: SIGHUP instead of SIGTERM, and SIGTERM instead of 2xSIGTERM. 2019-03-17 23:28:49 +01:00
Ole Tange fe4173927f parallel: Fixed: --null conflicts with --resume --joblog. 2019-03-17 23:07:32 +01:00
Ole Tange 8ee7777ee9 parallel_cheat.fodt: Initial release (correction). 2019-03-04 22:52:15 +01:00
Ole Tange b8039a2764 parallel_cheat.fodt: Initial cheat sheet. 2019-03-04 22:05:44 +01:00
Ole Tange 5e1e3775fc parallel: --line-buffer memory usage changed from 2x to 1x. 2019-02-24 01:16:40 +01:00
Ole Tange fd4694c66b Released as 20190222 ('Baghuz') 2019-02-22 22:20:59 +01:00
Ole Tange 321419c73a parallel: Unexplainable bug in --interactive fixed. 2019-02-22 19:00:42 +01:00
Ole Tange cc528fbbfb parallel: --shard parallelized. Can do 1M records on 4 core with hyperthread. 2019-02-20 00:48:09 +01:00
Ole Tange 79666b4906 parallel: Include parcat code in sharding to avoid depending on parcat. 2019-02-16 17:23:08 +01:00
Ole Tange 904cda6e19 parallel: --demux initial version. 2019-02-14 01:35:32 +01:00
Ole Tange 14581e8483 parallel: Support for Android/Termux. 2019-02-13 21:32:49 +01:00
Ole Tange 0615d0340b parallel: --shellquote can be given multiple times. 2019-01-29 06:58:12 +01:00
Ole Tange 2259251575 parallel_alternatives.pod: More tools compared. 2019-01-25 06:16:35 +01:00
Ole Tange 62e34af892 Released as 20190122 ('Shutdown') 2019-01-21 03:16:59 +01:00
Ole Tange 3cdfcc1926 env_parallel: Support $PARALLEL in (t)csh. 2019-01-21 03:16:23 +01:00
Ole Tange 8700e957fc parallel: Calculation of total_jobs() make better.
parallel: Buffer size for --linebuffer increased for better performance.
parallel: --(n)onall now respects --memfree.
2019-01-19 02:20:44 +01:00
Ole Tange 4234c24658 env_parallel: --end-session implemented. 2019-01-18 16:15:47 +01:00
Ole Tange e79d1d978b bug #55399: Clean up --wd ... when run locally.
bug #55398: set $OLDPWD when using --wd.
2019-01-06 13:45:43 +01:00
Ole Tange 48b1743b84 parallel: Prototypes on most functions added.
parallel: Control flow for --roundrobin simplyfied.
2019-01-01 14:34:04 +01:00
Ole Tange 036319dc09 parallel --halt soon,fail=100% </dev/null should not give division by zero. 2018-12-29 23:21:46 +01:00
Ole Tange f9ff5717fe sem --quote should not add empty argument. 2018-12-29 22:33:50 +01:00
Ole Tange 9fc4ad53af testsuite: Make some tests more stable. 2018-12-29 21:04:58 +01:00
Ole Tange a51c54dafe env_parallel.fish: Converted to '-quoting. 2018-12-28 12:47:25 +01:00
Ole Tange 1501d93eea Merge branch 'master' of ssh://git.sv.gnu.org/srv/git/parallel 2018-11-30 07:15:46 +01:00
Ole Tange 8286e771ec parallel: Simpler job scheduling flow. 2018-11-25 19:06:06 +01:00
Ole Tange addb7ee8b4 Released as 20181122 ('Kilogram') 2018-11-23 00:40:20 +01:00
Ole Tange 83ffe1af13 parallel: Simpler job control flow. 2018-11-23 00:30:23 +01:00
Ole Tange a6ccb85f14 Released as 20181022 ('Khashoggi') 2018-10-23 01:26:36 +02:00
Ole Tange 001d9d0f66 env_parallel.fish: Initial support for --session.
parallel: 'true | parallel --shuf echo' fixed.
testsuite: Updates due to Ubuntu 18.04.
parallel: Fixed bug #54869: Long lines break.
2018-10-23 00:46:38 +02:00
Ole Tange 4f0422d9b0 Released as 20180922 ('Danske') 2018-09-22 23:09:30 +02:00
Ole Tange 36a8238a20 parallel: bug #54647: parset ignores empty lines.
parallel: minix is working again.
parallel: bug #54128: command too long when exporting big env
testsuite: polarhome parallelized.
2018-09-21 00:15:14 +02:00
Ole Tange 24de94187a 10seconds_install: Fall back to pool.sks-keyservers.net if keys.gnupg.net fails. 2018-09-06 17:00:29 +02:00
Ole Tange b7e789c02f Fixed bug #54352: env_parallel -Slo --nonall myfunc broken in 20180722. 2018-08-27 01:54:11 +02:00
Ole Tange a6b96a3472 Released as 20180822 ('Genova') 2018-08-23 00:48:40 +02:00
Ole Tange 490474ea8c parset: set exit code. 2018-08-23 00:21:29 +02:00
Ole Tange 2dc37640a6 env_parallel.fish: Recursive env_parallel possible.
parallel: --rr = --round-robin.
2018-07-24 19:50:31 +02:00
Ole Tange 75007fcbbf parallel: \-quoting replaced with '-quoting. 2018-07-22 08:58:32 +02:00
Ole Tange 628c0029cc env_parallel: Fixed bug #54212: env_parallel env_parallel echo ::: 1 fails. 2018-07-18 17:29:57 +02:00
Ole Tange fe92398309 parallel: Fixed perl expressions spanning multiple lines. 2018-07-18 14:36:04 +02:00
Ole Tange e1e8693797 parallel: Fixed bug #54328: --pipe --recend '' blocks. 2018-07-18 09:49:24 +02:00
Ole Tange 896048efbc parallel: Calculate #CPU as either #threads, #cores, or #sockets. 2018-07-14 06:11:58 +02:00
Ole Tange 0d5072907d env_parallel.mksh: Initial version. 2018-07-13 07:33:11 +02:00
Ole Tange dd5fb4a08b env_parallel: Code is now more similar for {d,b,}ash,{k,z}sh. 2018-07-11 18:46:05 +02:00
Ole Tange 1a81db5e2b parallel: Test that PARALLEL_ENV as a fifo works.
testsuite: Check normal installation (incl. building docs).
testsuite: Less sensitive to run on slow machine.
2018-07-08 20:45:39 +02:00
Ole Tange efec4ca8a2 Released as 20180622 ('KimTrump') 2018-06-21 00:10:08 +02:00
Ole Tange 4e301386e3 parallel: Deal better with multibyte chars by forcing LC_ALL=C. 2018-06-10 17:07:24 +02:00
Ole Tange e5fc686b3f env_parallel.*: Mention --session as an option if environment is too long. 2018-05-24 00:04:28 +02:00
Ole Tange 87b9d9fe29 Released as 20180522 ('GreatMarchOfReturn') 2018-05-23 01:07:40 +02:00
Ole Tange 9b2012f021 parallel: Better parent_shell detection. 2018-05-22 21:02:10 +02:00
Ole Tange f2b403b7fb parallel: --tty allows for more programs accessing /dev/tty in parallel. 2018-05-21 10:31:57 +02:00
Ole Tange 94ac9fd72c parallel: --results test.csv bug incl. testing. 2018-05-21 10:04:31 +02:00
Ole Tange a050662275 Fixed bug #53864: env_parallel + parset as part of parallel --embed. 2018-05-08 23:16:48 +02:00
Ole Tange 60e45b20eb env_parallel: --session implemented. 2018-04-27 18:52:00 +02:00
Ole Tange 1422b7b43a parallel: Fixed bug #53748: -k --retries 10 + out of filehandles = blocking. 2018-04-25 22:38:42 +02:00
Ole Tange 9a1d2e9dad parallel: Fixed bug #53718: --pipe --regexp -N blocks. 2018-04-23 23:45:16 +02:00
Ole Tange 3fdd3a6019 Released as 20180422 ('Tiangong-1') 2018-04-22 23:32:22 +02:00
Ole Tange 1e15645faa parallel: --pipe --csv: Pass only full CSV-records. 2018-04-22 16:28:01 +02:00
Ole Tange bbcef1032c parallel: --csv initial version. 2018-04-21 21:50:42 +02:00
Ole Tange 8b050b68d4 env_parallel.*sh: Parsing 'type' depends on $LANG. Set LANG=C.
--tee: No longer spawns cat, but uses redirection instead.
2018-04-20 23:29:44 +02:00
Ole Tange b60a203bd8 parallel: Time in --bar is printed as 1d02h03m04s. 2018-03-25 00:19:08 +01:00
Ole Tange 733d882260 Released as 20180322 ('Hawking') 2018-03-22 09:00:48 +01:00
Ole Tange 130e299af6 parallel: --timeout now gives warning.
niceload: --pid PID,PID,PID implemented.
2018-03-21 22:57:28 +01:00
Ole Tange e2792e2101 parallel --embed uses same code for all shells.
parallel --embed compatible with env_parallel, parset, env_parset.
env_parallel.* update to be more like env_parallel.sh.
2018-03-06 01:35:26 +01:00
Ole Tange e6339f4512 parset: Now a copy of env_parallel. 2018-02-22 20:43:33 +01:00
Ole Tange 6657e056f2 parallel: --nice has not been working locally since 20161022. 2018-02-05 21:39:59 +01:00
Ole Tange 78fade1e62 parallel: --embed initial version. Incompatible with env_*.
env_parallel.*: Minor bugfixes.
parallel: More commenting.
2018-01-25 03:48:16 +01:00
Ole Tange b597f4166f Released as 20180122 ('Mayon') 2018-01-22 17:23:23 +01:00
Ole Tange 2d3989d36b New Year copyright update. 2018-01-16 16:21:55 +01:00
Ole Tange a9dc4fdf32 Documentation update. 2018-01-14 05:27:48 +01:00
Ole Tange a048f547eb Fixed bug #52207: Exit status 0 when child job is killed, even with "now,fail=1" 2018-01-06 19:58:01 +01:00
Ole Tange bf24d5e4db Fixed bug #52769: --lb puts stdout on stderr sometimes.
Fixed bug #52507: parset arr1 -v echo ::: fails.
--dryrun should not append to joblog.
Cleaned up print_tag().
Some testsuite reorg.
2018-01-03 09:03:16 +01:00
Ole Tange d1aa26c1c9 Fixed bug #52740: Bash redirection with process substitution blocks. 2017-12-26 15:46:00 +01:00
Ole Tange d9bac1136f Released as 20171222 ('Jerusalem') 2017-12-23 00:58:02 +01:00
Ole Tange da545d53ff parallel: Check if PARALLEL_SHELL is in path.
env_parallel compatible with more unices.
2017-12-23 00:01:20 +01:00
Ole Tange b843ec7398 parallel: Auto add hostgroup if given on arg. 2017-12-21 18:53:07 +01:00
Ole Tange 414667b8b4 parallel: -j1 --halt soon,fail=1 bug. 2017-12-21 18:40:03 +01:00
Ole Tange 400611158b env_parallel: which is now _which(). Bugfix for (t)csh when tempfile does not exist. 2017-12-04 22:44:34 +01:00
Ole Tange 77599baa96 env_parallel: bugfix of ash/dash/sh + increased testing. 2017-12-03 01:40:01 +01:00
Ole Tange 8f63e3f5e7 env_parallel: Aliases with newlines either supported (ash/dash/zsh) or warning (bash).
testsuite: functionized freebsd tests.
2017-12-01 20:53:56 +01:00
Ole Tange 9e5433e3e5 parset/env_parset: Support for ash, dash, ksh, sh, zsh. 2017-11-26 16:18:55 +01:00
Ole Tange c73a27254a Released as 20171122 ('Mugabe') 2017-11-22 23:29:03 +01:00
Ole Tange 04cca9fe43 env_parallel.bash: Allow for $array[1]-variables to be used for parset.
env_parallel: Install in .shrc.
2017-11-22 21:48:00 +01:00
Ole Tange 823645285f Released as 20171022 ('Catalonia') 2017-10-23 09:08:28 +02:00
Ole Tange 746b4304a6 Passes testsuite (except polarhome). 2017-10-16 15:41:54 +02:00
Ole Tange c63881c4cc parallel: $XDG_* 2017-10-10 00:33:43 +02:00
Ole Tange f09e0384ff parallel: {choose_k} added to --plus. 2017-09-22 00:50:39 +02:00
Ole Tange 68114b93e7 parallel: Fixed bug #51920: BUG: Set $/ in lots of places before calling chomp.
parallel: chomp used more aggressively.
2017-09-07 22:33:25 +02:00
Ole Tange 1e62be2464 parallel: --limit scripts. 2017-08-28 23:18:43 +02:00
Ole Tange 897d9f5db9 parallel: PARALLEL_RSYNC_OPTS and --rsync-opts introduced.
parallel: --bar -m bugfix.
2017-08-24 00:43:37 +02:00
Ole Tange 5c9712ec2c Released as 20170822 ('Barcelona') 2017-08-22 00:12:32 +02:00