123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511512513514515516517518519520521522523524525526527528529530531532533534535536537538539540541542543544545546547548549550551552553554555556557558559560561562563564565566567568569570571572573574575576577578579580581582583584585586587588589590591592593594595596597598599600601602603604605606607608609610611612613614615616617618619620621622623624625626627628629630631632633634635636637638639640641642643644645646647648649650651652653654655656657658659660661662663664665666667668669670671672673674675676677678679680681682683684685686687688689690691692693694695696697698699700701702703704705706707708709710711712713714715716717718719720721722723724725726727728729730731732733734735736737738739740741742743744745746747748749750751752753754755756757758759760761762763764765766767768769770771772773774775776777778779780781782783784785786787788789790791792793794795796797798799800801802803804805806807808809810811812813814815816817818819820821822823824825826827828829830831832833834835836837838839840841842843844845846847848849850851852853854855856857858859860861862863864865866867868869870871872873874875876877878879880881882883884885886887888889890891892893894895896897898899900901902903904905906907908909910911912913914915916917918919920921922923924925926927928929930931932933934935936937938939940941942943944945946947948949950951952953954955956957958959960961962963964965966967968969970971972973974975976977978979980981982983984985986987988989990991992993994995996997998999100010011002100310041005100610071008100910101011101210131014101510161017101810191020102110221023102410251026102710281029103010311032103310341035103610371038103910401041104210431044104510461047104810491050105110521053105410551056105710581059106010611062106310641065106610671068106910701071107210731074107510761077107810791080108110821083108410851086108710881089109010911092109310941095109610971098109911001101110211031104110511061107110811091110111111121113111411151116111711181119112011211122112311241125112611271128112911301131113211331134113511361137113811391140114111421143114411451146114711481149115011511152 |
- .\" Copyright (C) 1994-2018 Altair Engineering, Inc.
- .\" For more information, contact Altair at www.altair.com.
- .\"
- .\" This file is part of the PBS Professional ("PBS Pro") software.
- .\"
- .\" Open Source License Information:
- .\"
- .\" PBS Pro is free software. You can redistribute it and/or modify it under the
- .\" terms of the GNU Affero General Public License as published by the Free
- .\" Software Foundation, either version 3 of the License, or (at your option) any
- .\" later version.
- .\"
- .\" PBS Pro is distributed in the hope that it will be useful, but WITHOUT ANY
- .\" WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS
- .\" FOR A PARTICULAR PURPOSE.
- .\" See the GNU Affero General Public License for more details.
- .\"
- .\" You should have received a copy of the GNU Affero General Public License
- .\" along with this program. If not, see <http://www.gnu.org/licenses/>.
- .\"
- .\" Commercial License Information:
- .\"
- .\" For a copy of the commercial license terms and conditions,
- .\" go to: (http://www.pbspro.com/UserArea/agreement.html)
- .\" or contact the Altair Legal Department.
- .\"
- .\" Altair’s dual-license business model allows companies, individuals, and
- .\" organizations to create proprietary derivative works of PBS Pro and
- .\" distribute them - whether embedded or bundled with other software -
- .\" under a commercial license agreement.
- .\"
- .\" Use of Altair’s trademarks, including but not limited to "PBS™",
- .\" "PBS Professional®", and "PBS Pro™" and Altair’s logos is subject to Altair's
- .\" trademark licensing policies.
- .\"
- .TH pbs_sched 8B "16 April 2018" Local "PBS Professional"
- .SH NAME
- .B pbs_sched
- \- run a PBS scheduler
- .SH SYNOPSIS
- .B pbs_sched
- [-a <alarm>] [-c <clientsfile>] [-d <home dir>]
- [-I <scheduler name>] [-L <logfile>] [-n] [-N]
- [-p <output file>] [-R <port number>] [-S <port number>]
- .B pbs_sched
- --version
- .SH DESCRIPTION
- .B pbs_sched
- is a PBS scheduling daemon. It schedules PBS jobs.
- .LP
- .B pbs_sched
- must be executed with root permission on Linux or Admin privilege on Windows.
- .SH OPTIONS
- .IP "-a <alarm>" 13
- .B Deprecated.
- Overwrites value of
- .I sched_cycle_length
- scheduler attribute.
- .br
- Time in seconds to wait for a scheduling cycle to finish.
- .br
- Format: Time, in seconds.
- .br
- .IP "-c <clientsfile>" 13
- Add clients to this scheduler's list of known clients.
- The
- .I clientsfile
- contains single-line entries of the form
- .RS 17
- .I $clienthost <hostname>
- .RE
- .IP
- Each
- .I hostname
- is added to the list of hosts allowed to connect to this scheduler.
- If
- .I clientsfile
- cannot be opened, this scheduler aborts.
- Path can be absolute or relative. If relative, it is relative to
- PBS_HOME/sched_priv.
- .IP "-d <home dir>" 13
- The directory in which this scheduler will run.
- .br
- Default: PBS_HOME/sched_priv.
- .IP "-I <scheduler name>" 13
- Name of scheduler to start. Required when starting a multisched.
- .IP "-L <logfile>" 13
- The absolute path and filename of the log file.
- A scheduler writes its PBS version and build information to
- the logfile whenever it starts up or
- the logfile is rolled to a new file. See the
- .I -d
- option.
- .br
- Default: A scheduler opens a file named for the current
- date in the PBS_HOME/sched_logs directory.
- .IP "-n" 13
- Tells this scheduler to not restart itself if it receives a
- .I sigsegv
- or a
- .I sigbus.
- A scheduler by default restarts itself if it receives either
- of these two signals more than five minutes after starting.
- A scheduler does not restart itself if it receives
- either one within five minutes of starting.
- .IP "-N" 13
- Instructs this scheduler not to detach itself from the current session.
- .LP
- .IP "-p <output file>" 13
- Any output which is written to standard out or standard error is
- written to
- .I output file.
- The pathname can be absolute or relative,
- in which case it is relative to PBS_HOME/sched_priv.
- See the
- .I -d
- option.
- .br
- Default: PBS_HOME/sched_priv/sched_out
- .IP "-R <port number>" 13
- The port for MOM to use. If this option is not given,
- the port number is taken from PBS_MANAGER_SERVICE_PORT, in pbs.conf.
- .br
- Default: 15003
- .IP "-S <port number>" 13
- The port for this scheduler to use.
- Required when starting a multisched.
- For the default scheduler, if this option is not specified
- the default port is taken from PBS_SCHEDULER_SERVICE_PORT,
- in pbs.conf.
- .br
- Default value for default scheduler: 15004
- .br
- Default value for multisched: none
- .IP "--version" 13
- The
- .B pbs_sched
- command returns its PBS version information and exits.
- This option can only be used alone.
- .SH CONFIGURATION FILE
- The file PBS_HOME/sched_priv/sched_config contains configuration parameters
- for this scheduler. Each entry must be a single unbroken line.
- .br
- Format:
- .I name: value [prime | non-prime | all | none]
- .br
- where
- .RS 3
- .IP name 13
- Must not contain whitespace.
- .IP value 13
- Must be double-quoted if it contains whitespace.
- .I value
- can be
- .I True | False | <number> | <string>.
- .I True
- and
- .I False
- are not case-sensitive.
- .IP "[prime | non-prime | all | none]" 13
- Specifies when this setting applies:
- during primetime,
- non-primetime, all the time, or none of the time. A blank third field
- is equivalent to
- .I all
- which means that it applies to both primetime and non-primetime.
- .br
- Valid values:
- .I "all", "ALL", "none", "NONE", "prime", "PRIME", "non_prime", "NON_PRIME"
- .LP
- .RE
- Any line starting with a hashmark, "#", is a comment, and is ignored.
- .B Configuration Parameters
- .br
- .IP "backfill " 13
- Toggle that controls whether PBS uses backfilling.
- If this is set to True, this scheduler attempts to schedule
- smaller jobs around higher-priority jobs when using
- .I strict_ordering,
- as long as running the smaller jobs won't change the
- start time of the jobs they were scheduled around. A scheduler
- chooses jobs in the standard order, so other high-priority jobs will be
- considered first in the set to fit around the highest-priority job.
- When this parameter is
- .I True
- and
- .I help_starving_jobs
- is
- .I True,
- this scheduler backfills around starving jobs.
- Can be used
- with
- .I strict_ordering
- and
- .I help_starving_jobs.
- .br
- Format: Boolean.
- .br
- Default:
- .I True all
- .IP "backfill_prime " 13
- This Scheduler will not run jobs which would overlap
- the boundary between primetime and non-primetime. This assures
- that jobs restricted to running in either primetime or non-primetime
- can start as soon as the time boundary happens. See also
- .I prime_spill, prime_exempt_anytime_queues.
- .br
- Format: Boolean.
- .br
- Default:
- .I False all
- .IP "by_queue " 13
- If set to
- .I True,
- all jobs that can be run from the highest-priority
- queue are run, then any jobs that can be run from the next queue are
- run, and so on. If
- .I by_queue
- is set to
- .I False,
- all jobs are treated as if they are in one large queue. The
- .I by_queue
- parameter is overridden
- by the
- .I round_robin
- parameter when
- .I round_robin
- is set to
- .I True.
- .br
- Format: Boolean.
- .br
- Default:
- .I True all
- .IP cpus_per_ssinode 13
- .B Deprecated.
- Such configuration now occurs automatically.
- .IP dedicated_prefix 13
- Queue names with this prefix are treated as dedicated
- queues, meaning jobs in that queue are considered for
- execution only when the system is in dedicated time as specified in the
- configuration file PBS_HOME/sched_priv/dedicated_time.
- .br
- Format: String
- .br
- Default:
- .I ded
- .IP fair_share 13
- Enables the fairshare algorithm, and
- turns on usage collecting. Jobs will be selected based on a
- function of their recent usage and priority (shares). Not a prime option.
- .br
- Format: Boolean
- .br
- Default:
- .I False all
- .IP fairshare_decay_factor 13
- Decay multiplier for fairshare usage reduction. Each decay period, the
- usage is multiplied by this value.
- .br
- Valid values: between 0 and 1, not inclusive. Not a prime option.
- .br
- Format: Float
- .br
- Default:
- .I 0.5
- .IP fairshare_decay_time 13
- Time between fairshare usage decay operations. Not a prime option.
- .br
- Format: Duration
- .br
- Default:
- .I 24:00:00
- .IP fairshare_entity 13
- Specifies the entity for which fairshare usage data will
- be collected. Can be
- .I euser, egroup, Account_Name, queue,
- or
- .I egroup:euser.
- Not a prime option.
- .br
- Format: String
- .br
- Default:
- .I euser
- .IP fairshare_enforce_no_shares 13
- If this option is enabled, jobs whose entity has zero
- shares will never run. Requires
- .I fair_share
- parameter to be enabled.
- .br
- Format: Boolean
- .br
- Default:
- .I False
- .IP fairshare_usage_res 13
- Specifies the mathematical formula to use in fairshare calculations.
- Is composed of PBS resources as well as mathematical operations that
- are standard Python operators and/or those in the Python math module.
- When using a PBS resource, if
- .I resources_used.<resource name>
- exists, that value is used. Otherwise, the value is taken from
- .I Resource_List.<resource name>.
- Not a prime option.
- .br
- Format: String
- .br
- Default:
- .I cput
- .IP half_life 13
- .B Deprecated
- (as of 13.0).
- The half-life for fairshare usage; after the amount of time
- specified, the fairshare usage is halved. Requires that
- .I fair_share
- parameter be enabled. Not a prime option.
- .br
- Format: Duration
- .br
- Default:
- .I 24:00:00
- .IP help_starving_jobs 13
- Setting this option enables starving job support. Once
- jobs have waited for the amount of time given by
- .I max_starve
- they are considered starving. If a job is considered starving, no
- lower-priority jobs will run until the starving job can be run, unless
- backfilling is also specified. To use this option, the
- .I max_starve
- configuration parameter needs to be set as well. See also
- .I backfill, max_starve,
- and the server's
- .I eligible_time_enable
- attribute.
- .br
- At each scheduler iteration, PBS calculates
- .I estimated.start_time
- and
- .I estimated.exec_vnode
- for starving jobs being backfilled around.
- .br
- Format: Boolean
- .br
- Default:
- .I True all
- .IP job_sort_key 13
- .RS
- Specifies how jobs should be sorted.
- .I job_sort_key
- can be used to sort either by resources or by special case sorting
- routines. Multiple
- .I job_sort_key
- entries can be used, one to a line, in which
- case the first entry will be the primary sort key, the second will be
- used to sort equivalent items from the first sort, etc.
- The
- .I HIGH
- option implies descending sorting,
- .I LOW
- implies ascending. See example for details.
- This attribute is overridden by the
- .I job_sort_formula
- attribute.
- If both are set,
- .I job_sort_key
- is ignored and an error message is
- printed.
- .br
- Syntax:
- .br
- .I job_sort_key: """<resource name> HIGH|LOW"""
- .br
- .I job_sort_key: """fairshare_perc HIGH|LOW"""
- .br
- .I job_sort_key: """job_priority HIGH|LOW"""
- .br
- There are three special case sorting routines, which can be used
- instead of
- .I <resource name>:
- .RS
- .IP "fairshare_perc HIGH" 13
- Sort based on how much fairshare percentage the entity deserves,
- based on the values in the
- .I resource group
- file. If user A has more priority than user B, all of user A's
- jobs will always run first. Past history is not used.
- This should only
- be used if entity share (strict priority) sorting is needed.
- Incompatible with
- .I fair_share
- scheduling parameter being
- .I True.
- .IP "job_priority HIGH | LOW" 13
- Sort jobs by the job
- .I priority
- attribute regardless of job owner.
- .IP "sort_priority HIGH|LOW" 13
- .B Deprecated.
- See
- .I job_priority
- above.
- .RE
- The following example shows how to sort jobs so that those with
- high CPU count come first:
- .RS
- job_sort_key: "ncpus HIGH" all
- .br
- .RE
- The following example shows how to sort jobs so that those with
- lower memory come first:
- .br
- .RS
- job_sort_key: "mem LOW" prime
- .RE
- .br
- Format: Quoted string
- .br
- Default: Not in force
- .RE
- .IP key 13
- .B Deprecated.
- Use
- .I job_sort_key.
- .IP load_balancing 13
- When set to
- .I True,
- this scheduler takes into account the load average on vnodes as
- well as the resources listed in the
- .I resources
- line in sched_config. Load balancing can result in overloaded CPUs.
- .br
- Format: Boolean
- .br
- Default:
- .I False all
- .IP load_balancing_rr 13
- .B Deprecated.
- To duplicate this setting, enable
- .I load_balancing
- and
- .I set smp_cluster_dist
- to
- .I round_robin.
- .IP log_filter 13
- Defines which event types to keep out of this scheduler's
- logfile. The value should be set to the bitwise OR of the event
- classes which should be filtered. A value of 0 specifies maximum
- logging.
- .br
- Format: Integer
- .br
- Default:
- .I 3328
- .IP max_starve 13
- The amount of time before a job is considered starving. This
- variable is used only if
- .I help_starving_jobs
- is set.
- .br
- Upper limit: None
- .br
- Format: Duration
- .br
- Default:
- .I 24:00:00
- .IP mem_per_ssinode 13
- .B Deprecated.
- Such configuration now occurs automatically.
- .IP mom_resources 13
- This option is used to query the MoMs to set the value of
- .I resources_available.<resource name>
- where
- .I resource name
- is a site-defined
- resource. Each MoM is queried with the resource name and the
- return value is used to replace
- .I resources_available.<resource name>
- on that vnode. On a multi-vnoded machine with a natural vnode,
- all vnodes share anything set in
- .I mom_resources.
- .br
- Format: String
- .IP node_sort_key 13
- .RS
- Defines sorting on resource or priority values on vnodes. Resource
- must be numerical, for example, long or float. Up to 20
- .I node_sort_key entries
- can be used, in which
- case the first entry will be the primary sort key, the second will be
- used to sort equivalent items from the first sort, etc.
- .br
- Syntax:
- .br
- .I node_sort_key: <resource name>|sort_priority <HIGH | LOW>
- .br
- .I node_sort_key: <resource name> <HIGH | LOW> <total | assigned | unused>
- .br
- where
- .RS
- .IP total
- Use the
- .I resources_available
- value.
- .IP assigned
- Use the
- .I resources_assigned
- value.
- .IP unused
- Use the value given by
- .I resources_available - resources_assigned.
- .IP sort_priority
- Sort vnodes by the value of the vnode
- .I priority
- attribute.
- .RE
- .br
- When sorting on a resource, the default third field is "total".
- .br
- Format: String
- .br
- Default:
- .I node_sort_key: sort_priority HIGH all
- .RE
- .IP nonprimetime_prefix 13
- Queue names which start with this prefix are treated
- as non-primetime queues. Jobs in these queues
- run only during non-primetime. Primetime and non-primetime are
- defined in the holidays file.
- .br
- Format: String
- .br
- Default:
- .I np_
- .IP peer_queue 13
- Defines the mapping of a pulling queue to a furnishing queue
- for peer scheduling. Maximum number is 50 peer queues per
- scheduler.
- .br
- Format: String
- .br
- Default: Unset
- .IP preemptive_sched 13
- Enables job preemption. See
- .I preempt_order.
- .br
- Format: String
- .br
- Default:
- .I True all
- .IP preempt_checkpoint 13
- .B Deprecated.
- Add "C" to
- .I preempt_order
- parameter.
- .IP preempt_fairshare 13
- .B Deprecated.
- Add "fairshare" to
- .I preempt_prio
- parameter.
- .IP preempt_order 13
- .RS
- Defines the order of preemption methods which the
- scheduler uses on jobs. This order can change depending on
- the percentage of time remaining on the job. The ordering can
- be any combination of
- .I S, C,
- and
- .I R.
- .RS
- .IP S
- Suspend
- .IP C
- Checkpoint
- .IP R
- Requeue
- .RE
- The usage is an ordering (SCR) optionally followed
- by a percentage of time remaining and another ordering.
- Must be a quoted list("").
- For example, PBS should first attempt to use suspension to preempt a
- job, and if that is unsuccessful, then requeue the job:
- .RS
- .I preempt_order: "SR"
- .RE
- For example, if the job has between 100% and 81% requested time
- remaining, first try to suspend the job, then try checkpoint, then
- requeue. If the job has between 80% and 51% requested time remaining,
- attempt suspend, then checkpoint. Between 50% and 0% time
- remaining, just attempt to suspend the job:
- .RS
- .I preempt_order: "SCR 80 SC 50 S"
- .RE
- .br
- Format: Quoted list
- .br
- Default:
- .I SCR
- .RE
- .IP preempt_prio 13
- .RS
- Specifies the ordering of priority for different preemption
- levels. Two or more job types may be combined at the
- same priority level with a + between them, using no whitespace.
- Comma-separated preemption levels are evaluated left to right,
- with higher priority to the left.
- The table below lists the six preemption levels.
- Any level not specified in the
- .I preempt_prio
- list is
- ignored.
- .RS
- .IP express_queue 13
- Jobs in express queues preempt other jobs. See also
- .I preempt_queue_prio.
- Does not require
- .I by_queue
- to be
- .I True.
- .IP starving_jobs 13
- When a job becomes starving it can preempt other jobs.
- .IP fairshare 13
- When the entity owning a job exceeds its fairshare limit.
- .IP queue_softlimits 13
- Jobs which are over their queue soft limits
- .IP server_softlimits 13
- Jobs which are over their server soft limits
- .IP normal_jobs 13
- The preemption level into which a job falls if it does not
- fit into any other specified level.
- .RE
- For example, starving jobs have the highest priority, then normal
- jobs, and jobs whose entities are over their fairshare limit are third
- highest:
- .RS
- .I preempt_prio: "starving_jobs, normal_jobs, fairshare"
- .RE
- For example,starving jobs whose entities are also over
- their fairshare limit are lower priority than normal jobs:
- .RS
- .I preempt_prio: "normal_jobs, starving_jobs+fairshare"
- .RE
- Format: Quoted list
- .br
- Default:
- .I """express_queue, normal_jobs"""
- .RE
- .IP preempt_queue_prio 13
- Specifies the minimum queue priority required for a queue to be
- classified as an express queue. Express queues do not require
- .I by_queue
- to be
- .I True.
- .br
- Format: Integer
- .br
- Default:
- .I 150
- .IP preempt_requeue 13
- .B Deprecated.
- Add an "R" to
- .I preempt_order
- parameter.
- .IP preempt_sort 13
- Specifies whether those jobs most eligible for preemption are sorted
- according to their start times.
- .br
- If set
- to
- .I min_time_since_start,
- first job preempted will be that with most recent start time.
- .br
- If not
- set, meaning that this parameter is commented out, preempted
- job will be that with longest running time.
- .br
- Must be commented out in order to be unset.
- .br
- Allowable values:
- .I min_time_since_start,
- or no setting.
- .br
- Format: String
- .br
- Default:
- .I min_time_since_start
- .IP preempt_starving 13
- .B Deprecated.
- Add
- .I """starving_jobs"""
- to
- .I preempt_prio
- parameter.
- .IP preempt_suspend 13
- .B Deprecated.
- Add an
- .I """S"""
- to
- .I preempt_order
- parameter.
- .IP primetime_prefix 13
- Queue names starting with this prefix are treated as
- primetime queues. Jobs in these queues run only during
- primetime. Primetime and non-primetime are defined in the
- holidays file.
- .br
- Format: String
- .br
- Default:
- .I p_
- .IP prime_exempt_anytime_queues 13
- Determines whether
- .I anytime
- queues are controlled by
- .I backfill_prime.
- If set to true, jobs in an
- .I anytime
- queue
- are not prevented from running across a primetime/nonprimetime
- or non-primetime/primetime boundary. If set to
- false, the jobs in an
- .I anytime
- queue may not cross this boundary,
- except for the amount specified by their
- .I prime_spill
- setting.
- See also
- .I backfill_prime, prime_spill.
- .br
- Format: Boolean
- .br
- Default:
- .I False
- .IP prime_spill 13
- .RS
- Specifies the amount of time a job can spill over from non-primetime
- into primetime or from primetime into non-primetime.
- This option is only meaningful if
- .I backfill_prime
- is
- .I True.
- This option can be separately specified for
- primetime and non-primetime. See also
- .I backfill_prime, prime_exempt_anytime_queues.
- .br
- For example, non-primetime jobs can spill into primetime by 1 hour:
- .RS
- .I prime_spill: 1:00:00 prime
- .RE
- For example, jobs in either prime/non-prime can spill into
- the other by 1 hour:
- .RS
- .I prime_spill: 1:00:00 all
- .RE
- .br
- Format: Duration
- .br
- Default:
- .I 00:00:00
- .RE
- .IP provision_policy
- Specifies how vnodes are selected for provisioning. Can be set by
- Manager only; readable by all. Can be set to one of the following:
- .RS
- .IP "avoid_provision" 5
- PBS first tries to satisfy the job's request from free vnodes that
- already have the requested AOE instantiated. PBS uses
- .I node_sort_key
- to sort these vnodes.
- If it cannot satisfy the job's request using vnodes that already have
- the requested AOE instantiated, PBS uses the server's
- .I node_sort_key
- to select the free vnodes that must be
- provisioned in order to run the job, choosing from any free vnodes,
- regardless of which AOE is instantiated on them.
- Of the selected vnodes, PBS provisions any that do not have the
- requested AOE instantiated on them.
- .IP "aggressive_provision" 5
- PBS selects vnodes to be provisioned without considering which AOE
- is currently instantiated.
- PBS uses the server's
- .I node_sort_key
- to select the vnodes on which to run the job,
- choosing from any free vnodes, regardless of which AOE is instantiated
- on them. Of the selected vnodes, PBS provisions any that do not have
- the requested AOE instantiated on them.
- .LP
- Format: string
- .br
- Default:
- .I "aggressive_provision"
- .RE
- .IP resources 13
- .RS
- Specifies those resources which are not to be over-allocated,
- or if Boolean, are to be honored, when
- scheduling jobs. Vnode-level Boolean resources are automatically
- enforced and do not need to be listed here. Limits are set
- by setting
- .I resources_available.<resource name>
- on vnodes, queues, and the server. A scheduler
- considers numeric (integer or float) items as consumable
- resources and ensures that no more are assigned than are available
- (e.g.
- .I ncpus
- or
- .I mem
- ). Any string resources are compared
- using string comparisons (e.g.
- .I arch
- ).
- .br
- If "host" is not added to the
- resources line, then when the user submits a job requesting a specific
- vnode in the following syntax:
- .RS
- qsub -l select=host=vnodeName
- .RE
- the job will run on any host.
- .br
- Format: String
- .br
- Default:
- .I ncpus, mem, arch, host, vnode, aoe
- .RE
- .IP resource_unset_infinite 13
- Resources in this list are treated as infinite if they are unset.
- Cannot be set differently
- for primetime and non-primetime.
- .br
- Example:
- .I resource_unset_infinite: vmem, foo_licenses
- .br
- Format: Comma-delimited list of resources
- .br
- Default: Empty list
- .IP round_robin 13
- If set to
- .I True,
- this scheduler considers one job from
- the first queue, then one job from the second queue, and so on
- in a circular fashion. If
- .I sort_queues
- is set to
- .I True,
- the queues are ordered with the highest-priority queue first. Each
- scheduling cycle starts with the same highest-priority queue,
- which will therefore get preferential treatment. If
- .I round_robin
- is set to
- .I False,
- this scheduler considers jobs according to the setting of the
- .I by_queue
- attribute.
- When
- .I True,
- overrides the
- .I by_queue
- attribute.
- .br
- Format: Boolean
- .br
- Default:
- .I False all
- .IP server_dyn_res 13
- Directs this scheduler to replace the server's
- .I resources_available
- values with new values returned
- by a site-specific external program.
- .br
- Format: String
- .br
- Default: Unset
- .IP smp_cluster_dist 13
- .RS
- .B Deprecated (12.2).
- Specifies how single-host jobs should be distributed to
- all hosts of the complex. Options:
- .RS
- .IP pack
- Keep putting jobs onto one host until it is full and then move on to the next.
- .IP round_robin
- Put one job on each vnode in turn before cycling back to the first one.
- .IP lowest_load
- Put the job on the lowest-loaded host.
- .RE
- .br
- Format: String
- .br
- Default:
- .I pack all
- .RE
- .IP sort_by 13
- .B Deprecated.
- Use
- .I job_sort_key.
- .IP sort_queues 13
- .B Deprecated.
- When set to
- .I True,
- queues are sorted so that the highest-priority queues
- are considered first. Queues are sorted by each queue's
- .I priority
- attribute. The queues are sorted in a descending
- fashion, that is, a queue with priority 6 comes before a
- queue with priority 3.
- When set to
- .I False,
- queues are not sorted.
- This is a prime option, which means it can be selectively
- applied to primetime or non-primetime.
- The sorted order of queues is not taken into consideration unless
- .I by_queue
- is set to
- .I True.
- .br
- Format: Boolean
- .br
- Default:
- .I True ALL
- .IP strict_fifo 13
- .B Deprecated.
- Use
- .I strict_ordering.
- .IP strict_ordering 13
- Specifies that jobs must be run in the order determined
- by whatever sorting parameters are being used. This means that
- a job cannot be skipped due to resources required not being
- available.
- If a job due to run next cannot run, no job will run, unless
- backfilling is used, in which case jobs can be backfilled around the job that is
- due to run next.
- .br
- Example line in PBS_HOME/sched_priv/sched_config:
- .RS
- .I strict_ordering: true ALL
- .br
- Format: Boolean
- .br
- Default:
- .I False all
- .RE
- .IP sync_time 13
- .B Deprecated.
- The amount of time between writing the fairshare usage
- data to disk. Requires
- .I fair_share
- to be enabled.
- .br
- Format: Duration
- .br
- Default:
- .I 1:00:00
- .IP unknown_shares 13
- The number of shares for the
- .I unknown
- group. These
- shares determine the portion of a resource to be allotted to that
- group via fairshare. Requires
- .I fair_share
- to be enabled.
- .br
- Format: Integer
- .br
- Default: The unknown group gets 0 shares
- .SH FORMATS
- .IP Boolean 10
- Allowable values (case insensitive): True|T|Y|1|False|F|N|0
- .IP Duration 10
- Period of time. Expressed either as
- .br
- .I \ \ \ integer seconds
- .br
- or
- .br
- .I \ \ \ [[hours:]minutes:]seconds[.milliseconds]
- .br
- Milliseconds are rounded to the nearest second.
- .LP
- .IP Float 10
- Allowable values: [+-] 0-9 [[0-9] ...][.][[0-9] ...]
- .IP Long 10
- Long integer.
- Allowable values: 0-9 [[0-9] ...], and + and -
- .IP Size 10
- Number of bytes or words. The size of a word is 64 bits.
- .br
- Format:
- .I <integer>[<suffix>]
- .br
- where
- .I suffix
- can be
- .RS 13
- .IP "\ b\ or\ \ w" 13
- bytes or words
- .IP "kb\ or\ kw"
- Kilobytes or kilowords (2 to the 10th, or 1024)
- .IP "mb\ or\ mw" 13
- Megabytes or megawords (2 to the 20th, or 1,048,576)
- .IP "gb\ or\ gw" 13
- Gigabytes or gigawords (2 to the 30th, or 1,073,741,824)
- .IP "tb\ or\ tw" 13
- Terabytes or terawords (2 to the 40th, or 1024 gigabytes)
- .IP "pb\ or\ pw" 13
- Petabytes or petawords (2 to the 50th, or 1,048,576 gigabytes)
- .RE
- .IP
- Default:
- .I bytes
- .IP String 10
- (Resource value)
- .br
- Any character, including the space character.
- .br
- Only one of the two types of quote characters, " or ', may appear in any given value.
- .br
- Allowable values: [_a-zA-Z0-9][[-_a-zA-Z0-9 !"#$%' ()*+,-./:;<=>?@[\\]^_{|}~] ...]
- .br
- String resource values are case-sensitive.
- .SH FILES
- $PBS_HOME/sched_priv is
- the default directory for configuration files.
- $PBS_HOME/sched_priv/holidays is the holidays file.
- .SH SIGNAL HANDLING
- All signals are ignored until the end of the cycle. Most signals are
- handled in the standard UNIX fashion.
- .IP SIGHUP
- This scheduler closes and reopens its log file and rereads its
- configuration file if one exists.
- .IP "SIGALRM, SIGBUS, etc."
- Ignored until end of scheduling cycle. This scheduler quits.
- .IP "SIGINT and SIGTERM"
- This scheduler closes its log file and shuts down.
- .LP
- .SH EXIT STATUS
- Zero upon normal termination.
- .SH SEE ALSO
- The
- .B PBS Professional Administrator's Guide,
- pbs_server(8B), pbs_mom(8B)
|