parallel/src/niceload.pod

427 lines
9.8 KiB
Plaintext
Raw Normal View History

#!/usr/bin/perl -w
=head1 NAME
niceload - slow down a program when the load average is above a certain limit
=head1 SYNOPSIS
2011-07-20 16:20:29 +00:00
B<niceload> [-v] [-h] [-n nice] [-I io] [-L load] [-M mem] [-N]
[--sensor program] [-t time] [-s time|-f factor]
( command | -p PID [-p PID ...] | --prg program )
2012-11-09 15:51:38 +00:00
=head1 DESCRIPTION
2011-07-20 16:20:29 +00:00
GNU B<niceload> will slow down a program when the load average (or
other system activity) is above a certain limit. When the limit is
reached the program will be suspended for some time. Then resumed
again for some time. Then the load average is checked again and we
start over.
Instead of load average B<niceload> can also look at disk I/O, amount
of free memory, or swapping activity.
If the load is 3.00 then the default settings will run a program
like this:
run 1 second, suspend (3.00-1.00) seconds, run 1 second, suspend
(3.00-1.00) seconds, run 1 second, ...
=head1 OPTIONS
=over 9
=item B<-B>
=item B<--battery>
2018-08-22 22:21:29 +00:00
Suspend if the system is running on battery. Shorthand for:
-l -1 --sensor 'cat /sys/class/power_supply/BAT0/status
/proc/acpi/battery/BAT0/state 2>/dev/null | grep -i -q discharging;
echo $?'
2011-11-22 21:38:57 +00:00
=item B<-f> I<FACTOR>
2011-11-22 21:38:57 +00:00
=item B<--factor> I<FACTOR>
Suspend time factor. Dynamically set B<-s> as amount over limit *
factor. Default is 1.
2011-11-22 21:38:57 +00:00
=item B<-H>
2011-11-22 21:38:57 +00:00
=item B<--hard>
Hard limit. B<--hard> will suspend the process until the system is
under the limits. The default is B<--soft>.
2011-11-22 21:38:57 +00:00
=item B<--io> I<iolimit>
2011-11-22 21:38:57 +00:00
=item B<-I> I<iolimit>
Limit for I/O. The amount of disk I/O will be computed as a value 0 -
10, where 0 is no I/O and 10 is at least one disk is 100% saturated.
2018-08-22 22:21:29 +00:00
B<--io> will set both B<--start-io> and B<--run-io>.
2011-11-22 21:38:57 +00:00
=item B<--load> I<loadlimit>
2011-11-22 21:38:57 +00:00
=item B<-L> I<loadlimit>
Limit for load average.
2018-08-22 22:21:29 +00:00
B<--load> will set both B<--start-load> and B<--run-load>.
2011-11-22 21:38:57 +00:00
=item B<--mem> I<memlimit>
2011-11-22 21:38:57 +00:00
=item B<-M> I<memlimit>
Limit for free memory. This is the amount of bytes available as free
+ cache. This limit is treated opposite other limits: If the system
is above the limit the program will run, if it is below the limit the
program will stop
I<memlimit> can be postfixed with K, M, G, T, or P which would
multiply the size with 1024, 1048576, 1073741824, or 1099511627776
respectively.
2018-08-22 22:21:29 +00:00
B<--mem> will set both B<--start-mem> and B<--run-mem>.
2011-11-22 21:38:57 +00:00
=item B<--noswap>
2011-11-22 21:38:57 +00:00
=item B<-N>
No swapping. If the system is swapping both in and out it is a good
indication that the system is memory stressed.
B<--noswap> is over limit if the system is swapping both in and out.
2018-08-22 22:21:29 +00:00
B<--noswap> will set both B<--start-noswap> and B<--run-noswap>.
=item B<--net>
Shorthand for B<--nethops 3>.
=item B<--nethops> I<h>
Network nice. Pause if the internet connection is overloaded.
B<niceload> finds a router I<h> hops closer to the internet. It
B<ping>s this every second. If the latency is more than 50% bigger
than the median, it is regarded as being over the limit.
B<--nethops> can be combined with B<--hard>. Without B<--hard> the
program may be able to queue up so much traffic that it will take
longer than the B<--suspend> time to clear it. B<--hard> is useful for
traffic that does not break by being suspended for a longer time.
B<--nethops> can be combined with a high B<--suspend>. This way a
program can be allowed to do a bit of traffic now and then. This is
useful to keep the connection alive.
2011-11-22 21:38:57 +00:00
=item B<-n> I<niceness>
2011-11-22 21:38:57 +00:00
=item B<--nice> I<niceness>
Sets niceness. See B<nice>(1).
=item B<-p> I<PID>[,I<PID>]
=item B<--pid> I<PID>[,I<PID>]
Process IDs of processes to suspend. You can specify multiple process
IDs with multiple B<-p> I<PID> or by separating the PIDs with comma.
2012-12-10 22:16:25 +00:00
=item B<--prg> I<program>
2012-12-10 22:16:25 +00:00
=item B<--program> I<program>
2012-12-10 22:16:25 +00:00
Name of running program to suspend. You can specify multiple programs
with multiple B<--prg> I<program>. If no processes with the name
I<program> is found, B<niceload> with search for substrings containing
I<program>.
2011-11-22 21:38:57 +00:00
=item B<--quote>
2011-07-20 16:20:29 +00:00
2011-11-22 21:38:57 +00:00
=item B<-q>
2011-07-20 16:20:29 +00:00
Quote the command line. Useful if the command contains chars like *,
$, >, and " that should not be interpreted by the shell.
2011-11-22 21:38:57 +00:00
=item B<--run-io> I<iolimit>
2011-11-22 21:38:57 +00:00
=item B<--ri> I<iolimit>
2011-11-22 21:38:57 +00:00
=item B<--run-load> I<loadlimit>
2011-11-22 21:38:57 +00:00
=item B<--rl> I<loadlimit>
2011-11-22 21:38:57 +00:00
=item B<--run-mem> I<memlimit>
2011-11-22 21:38:57 +00:00
=item B<--rm> I<memlimit>
Run limit. The running program will be slowed down if the system is
above the limit. See: B<--io>, B<--load>, B<--mem>, B<--noswap>.
=item B<--sensor> I<sensor program>
2012-11-09 15:51:38 +00:00
Read sensor. Use I<sensor program> to read a sensor.
This will keep the CPU temperature below 80 deg C on GNU/Linux:
niceload -l 80000 -f 0.001 --sensor 'sort -n /sys/devices/platform/coretemp*/temp*_input' gzip *
This will stop if the disk space < 100000.
niceload -H -l -100000 --sensor "df . | awk '{ print \$4 }'" echo
2011-11-22 21:38:57 +00:00
=item B<--start-io> I<iolimit>
2011-11-22 21:38:57 +00:00
=item B<--si> I<iolimit>
2011-11-22 21:38:57 +00:00
=item B<--start-load> I<loadlimit>
2011-11-22 21:38:57 +00:00
=item B<--sl> I<loadlimit>
2011-11-22 21:38:57 +00:00
=item B<--start-mem> I<memlimit>
2011-11-22 21:38:57 +00:00
=item B<--sm> I<memlimit>
Start limit. The program will not start until the system is below the
limit. See: B<--io>, B<--load>, B<--mem>, B<--noswap>.
2011-11-22 21:38:57 +00:00
=item B<--soft>
2011-11-22 21:38:57 +00:00
=item B<-S>
Soft limit. B<niceload> will suspend a process for a while and then
let it run for a second thus only slowing down a process while the
system is over one of the given limits. This is the default.
2011-11-22 21:38:57 +00:00
=item B<--suspend> I<SEC>
2011-07-20 16:20:29 +00:00
2011-11-22 21:38:57 +00:00
=item B<-s> I<SEC>
2011-07-20 16:20:29 +00:00
Suspend time. Suspend the command this many seconds when the max load
average is reached.
2011-11-22 21:38:57 +00:00
=item B<--recheck> I<SEC>
2011-11-22 21:38:57 +00:00
=item B<-t> I<SEC>
Recheck load time. Sleep SEC seconds before checking load
again. Default is 1 second.
2011-11-22 21:38:57 +00:00
=item B<--verbose>
2011-11-22 21:38:57 +00:00
=item B<-v>
Verbose. Print some extra output on what is happening. Use B<-v> until
you know what your are doing.
=back
=head1 EXAMPLE: See niceload in action
In terminal 1 run: top
In terminal 2 run:
B<niceload -q perl -e '$|=1;do{$l==$r or print "."; $l=$r}until(($r=time-$^T)>>B<50)'>
This will print a '.' every second for 50 seconds and eat a lot of
CPU. When the load rises to 1.0 the process is suspended.
=head1 EXAMPLE: Run updatedb
2018-08-22 22:21:29 +00:00
Running B<updatedb> can often starve the system for disk I/O and thus result in a high load.
2018-08-22 22:21:29 +00:00
Run B<updatedb> but suspend B<updatedb> if the load is above 2.00:
B<niceload -L 2 updatedb>
=head1 EXAMPLE: Run rsync
2018-08-22 22:21:29 +00:00
B<rsync> can, just like B<updatedb>, starve the system for disk I/O
and thus result in a high load.
2018-08-22 22:21:29 +00:00
Run B<rsync> but keep load below 3.4. If load reaches 7 sleep for
(7-3.4)*12 seconds:
B<niceload -L 3.4 -f 12 rsync -Ha /home/ /backup/home/>
=head1 EXAMPLE: Ensure enough disk cache
Assume the program B<foo> uses 2 GB files intensively. B<foo> will run
fast if the files are in disk cache and be slow as a crawl if they are
not in the cache.
To ensure 2 GB are reserved for disk cache run:
B<niceload --hard --run-mem 2g foo>
This will not guarantee that the 2 GB memory will be used for the
files for B<foo>, but it will stop B<foo> if the memory for disk cache
is too low.
=head1 ENVIRONMENT VARIABLES
None. In future versions $NICELOAD will be able to contain default settings.
=head1 EXIT STATUS
Exit status should be the same as the command being run (untested).
=head1 REPORTING BUGS
Report bugs to <bug-parallel@gnu.org>.
=head1 AUTHOR
Copyright (C) 2004-11-19 Ole Tange, http://ole.tange.dk
Copyright (C) 2005-2010 Ole Tange, http://ole.tange.dk
Copyright (C) 2010-2021 Ole Tange, http://ole.tange.dk and Free
Software Foundation, Inc.
=head1 LICENSE
This program is free software; you can redistribute it and/or modify
it under the terms of the GNU General Public License as published by
the Free Software Foundation; either version 3 of the License, or
at your option any later version.
This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
GNU General Public License for more details.
You should have received a copy of the GNU General Public License
along with this program. If not, see <http://www.gnu.org/licenses/>.
=head2 Documentation license I
Permission is granted to copy, distribute and/or modify this documentation
under the terms of the GNU Free Documentation License, Version 1.3 or
any later version published by the Free Software Foundation; with no
Invariant Sections, with no Front-Cover Texts, and with no Back-Cover
Texts. A copy of the license is included in the file fdl.txt.
=head2 Documentation license II
You are free:
=over 9
=item B<to Share>
to copy, distribute and transmit the work
=item B<to Remix>
to adapt the work
=back
Under the following conditions:
=over 9
=item B<Attribution>
You must attribute the work in the manner specified by the author or
licensor (but not in any way that suggests that they endorse you or
your use of the work).
=item B<Share Alike>
If you alter, transform, or build upon this work, you may distribute
the resulting work only under the same, similar or a compatible
license.
=back
With the understanding that:
=over 9
=item B<Waiver>
Any of the above conditions can be waived if you get permission from
the copyright holder.
=item B<Public Domain>
Where the work or any of its elements is in the public domain under
applicable law, that status is in no way affected by the license.
=item B<Other Rights>
In no way are any of the following rights affected by the license:
=over 2
=item *
Your fair dealing or fair use rights, or other applicable
copyright exceptions and limitations;
=item *
The author's moral rights;
=item *
Rights other persons may have either in the work itself or in
how the work is used, such as publicity or privacy rights.
=back
=back
=over 9
=item B<Notice>
For any reuse or distribution, you must make clear to others the
license terms of this work.
=back
A copy of the full license is included in the file as cc-by-sa.txt.
=head1 DEPENDENCIES
GNU B<niceload> uses Perl, and the Perl modules POSIX, and
Getopt::Long.
=head1 SEE ALSO
B<parallel>(1), B<nice>(1), B<uptime>(1)
=cut