slurm_20_11-doc-20.11.7-6.7.1 >
A amp9|0Y 6uQD/)l
g=S6BȬZÁFδ] ~|o,B
\ " e ubn/o81!ya:4?f&kJ T=(dˡI2{;<"SQ ~D~پliC.Hc}[aJ=.~U7@AL;Kȓ
VWr9YSh@zv9b] J\C-_Xgdf64d4a3b955d93b7094157da7a479252c52e189 9f6bfe4cf980dcaf7aaaf34d1ea5b6d6a16241a203e11b870cd5291b76adfe88 \ amp9|;8 khO; Tg9MmUG7r!i ܣ&PCpKJك77]Ocajw/|y[:::\|E`)+0`8DqN7m@n-֍1ֵ$o+JߑJ T|86
( D%uҹšc?3 ej##»ҍì 3?mqEU5G&Q#ߋ}ft0aB(u :"t > p > d ? T d 8 x | + 1 <
h .
/\ 1 4 7 7 :@ :t : : ; ; ; ( ; 8 ; n 9 < n : C& n F G H 0 I X 0 Y < \ ` ] ^ b U c d e f l u v # z P C slurm_20_11-doc 20.11.7 6.7.1 Documentation for SLURM Documentation (HTML) for the SLURM cluster managment software. amibs-arm-5 9vSUSE Linux Enterprise 15 SUSE LLC SUSE-GPL-2.0-with-openssl-exception https://www.suse.com/ Documentation/HTML https://www.schedmd.com linux aarch64 i [ * U_ dQ 3 97 :p 6@ YL 0 L^ 5 T %o O y O E6 / ' - ?y 33 2< 'S " 2 \ 4 - ) 0 t U m du j + E
G~ X ?x s N G . % 08 G L * QO $ U .- 0I $s Qh 3 % sg / < t n w 7 D )N :; ;9 n E 2 2 > ? ! < nZ $ 2 `- & - 2 Md qS ? U j !W R E
d P %' . - / % &D * C " b ) 9 <[ D . 0 z 4 ( +F 6k x _8 AA큤 amamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamamam de21d8d6957c5fb0e71f5dc13a64caf0a895ba9d74941ca79e18a73967f70080 146912620ac629f7c922a34f46e8e1d43fa19f6600b913fafe163934873c63f3 41136abd4b37b1906fb72e7676cfc6c20cc4e1cb1bae1e7115241bce1ecae314 34557214fb0b45e04e38926c51bf83584116738ddd8b22c751f3e3020f66b980 ae57b022fb484ba57d50e22c5f081f931ad81fb44e39eb9196914809281eb7dc f698415231367d34946ce8f7e1aa07011cecf0a636845917fa5ea853cbadf214 e413cbaf4aba1bd078b3293622746e66edae62f6f9aa0065fe6f5c3f7918487b ae001f1746debd8f9e2c487c014b6f29813bb78d528f2451ab5e0049a453712f 86c999336fb89e5ce6e3ba2a7f547e66b7897c0e2d8e24e844e66fa61b206878 2a187deeeb4bd1f6f503aaf6a8bd29c1e606d00c080e9411f5dbebfcb0de5551 e5ae0839077ca9c0860fc903b70dbfb879f5ed4851d14da3cd97850ab1b53eb5 ee3439c7009e5ab41295f7a46dce5da769e0be13dd40b6cfe87e411d84b80538 629b3d17c86ad009d3d57e88521c1ba6e16b4fcbc67529f4bed15456166add60 4e0e3f5f3121da290d9fc62b1d33ece0a8d8369ca16b06cfec8b2e4661f0273e 933b781ae743a73b8410b29c78d829679ffd02b717dc2291609e77e533679e26 6a71ce1bde6ffac983a7e682e7a6b483f628fa1b580f2b7b9eff97d33200dc6a 0f3add50d21d9e603d3d0fd4ba50765053bac09e25b3eadff20adadb90ad37ae ea87a27653147d35c6efe771267b27c6652056b66cf3fec7eb85a32642d66236 62ed56c28c21b93c8d348425be9dbcebdefcd5c975913bc7d6909ea1063a5ebf 46ad8ab4d96313184a035bf089cf89102e1db80794b1c556903fb2d3f8d21459 9b9d654b7fbfb5bd3370f0a7d82669a06ee51478f64f08edba9d27186c2c2240 6e4914c6d45ee54e23d701eaf65ee697b4e326afd4a1cfc347a7a969d1a1459c ab4f8e9b23288e77b229e4fec0c517e987b6521e8334932e84ac0ca9838cc37b 19243e92c861e7bb40be03876aeb7773272a67c67b2076930477afa96965b37a 49b083e3cb2db82e4db0aae62963334ca45c729f861ec1705421efdd06b93c1c 1663cf7ba14180f1d3fb4b423eed9176794bdca1c8e23d111166ea67947579f6 9ddc64413c55af5eb1c825b2535e87d67248de60ce2dabee33c4d3e15f909e23 e09287fbab79c4e879928ff62527ea3c75d317593cac693cff05805c1a0484af d9cb95bdccdfab7505bf7b32fd208d06c05554c949c4c1b0decc032f994dada8 88086a946eddef14ec78a88c1beca67a9d7cd1e2f65ec9db33f73b2cee637ba5 acdd695116c1e745a03f266fd0f7d8734fdc875536704d254c433dc0196c9508 3354053571faaa6cd40fe737e48f2f04310ed108659f0fe8d354ba115120e7a6 2449564a908292020cf04389cc10c925ca5023c3f1965ba3d3539bf5f9767c18 966f8f387120cfe33439e4ea5dc5fc56da6c690a3c40b791878245511fd02948 9a2bf26b819aa1e7e2a30202cebd1150ecdfb765db2c70a93f61d4af1c604219 a27a85eec591f62e89e5a0a597decc8177273bc7b41632e3ed0a5d3cb57654b4 1507e488f2605587b0cb614ec51a4f0649318a631ac185fdb877e16239206fd0 961c6739341e4b12d55a5d9d34f0513c63a2951c3e73839ee1cd457b36c2566c b8353ec26e341a6b78b3920a11133a6bbb8ee083e6c5c8b9fa93ea248cb06cb1 1fdb3dd453ce3d4150f36e0d913b983c9b214f08cef01edae280cf8999292ca5 ff64e51f7acac4bc4b492ed9c8365d1710823795ca1f3b585b6169fd5ab86441 7e5462e3bec28f819692c17ba0c35f368fd74ad54590554ce172fb769420b9a5 ce48fcaa8250028e5d9cb76877cdfec799a77bd538e411a77da1d5b481e2556a 9e64f607d7af1a484dedab1cc460f518f94b024860aaa395ae395e559c94a782 731d5f90d0b689c372e228559efc77db0787c13f3337af27aab11308ac221f4d b9f8cc0c20be4614833fbf0f9fdba5a97d4b8296cebf826379f16e741a30ff52 aae559c48841ca08725b0cb41769c4165f5176a499d7347356cb9d3786f1e9be 97e22b0f3f41c663dc89e36cc8393760d2d16f462f582df41ced5657f4ddd2fd 2909379430fd2afd33aed2ed11b1f046bde9b4a5c1aaa36184f830bdf3990ad3 b284288c87ddf4161d607c61df56a9197be1959efb775987acdf8e69a51b5673 68a6016469bab6a1c3367c0c688abee46fd06ad38c6e50de2dab501d86956dba 2552c2118557220cb8c9c3c7b0cfb653a1edf08b745a1bd30263f03478a6292c 07464c8e4cb7247efa6535c0d69b263519c40334db0331e2c1642292bef99b79 71d527188757595da550f899fc680742ea7d3ef39160f445af94c9a399ebf8bf e60883f0549370dc98b14c68e14e2970ee19513a2923fb545cfb4787015e660b 1b6a956cd839a1c39886b620d7030b6b4e433fc19189c835c784deb707926e97 774f07d620242f2b6cdb12e9f7ee1dab7c7cf2b19bdc9ab8c263709d8953487f f8cdc50ad93fddff0d4c49e2d45ee63b44afcd1fa3f40d320a5f8068086245aa aa282b73edef5054fa36adad757b9f7676a13d481c14f420f9c3106e8a197af1 1a21547144448a45d549d962fcbd7477ef8c6ed9246fdb7101db93cbe4d18378 2eddc7a93dffc875228fcbd1d5d2bd67c30ddd40fafd66e8aa48ef2fb5e1fcdb e4af1f83841d64924d5a8ac19902ad73271efa1d6fc8b0a38fe3b2d932c9cfca b1c80b3be1eaea9644b65d37270e1cba0a9b0a683f40d24b340773a33f5168e2 702b9e051e82b32038ffdb33a4f7eb5f7b38f4cf6f514e4182d8898f4eb0b7fb acb0e41fe2474e76ea951b90d91f49409a55b9a23b482d0061b9c73ad719e795 94b546516c7eb619d4d84cad6fb422e075b0965494570d021a0fd24e88a08860 8ee15ba041ca3ad406ef0494f2558f33e85358de5256bfb1a5e87bcae0a9f039 4b2d2846312b65bbb86a911569b938b93acbbe0f97ba34d7b9bb5877e17e5d19 2551f3681701fc9bc5115f0d29af67a9ca504f1c0eebb13e568edb099c09b3e3 880e5327e3d8516d5f8d2deab11b0617b6e5e3d7feb7a4f83bf93beafe3469c6 83fb0c99156e449aa94c0b2af446033615185de6d8e88fa3d969429dfd6ce5dd bcaed13c14baafc4aab1e0b8f5a7503dfe805b9d47996587df1851bb03900943 4d084dcce5a6c13e736bfeb4b7e7a3e23dfe618cb9f1cbaebd21c680a90db725 96c32d20f5103c3c11838f353537df5c191c014687766eab94819312af8c7a3f 4e3e52d6046f05e93bb50b0dd9635e6b82858f739f0d98ac53d1e2ca4d3b34fe 6694f806d6ab2aa6787d95fba7395a03db902c264416b7a4ef5801b170f7d173 ce1bc7738ef1434af593cc7cd87279f86327a3c48d4c3c44dfab0aa33a797c09 8771d89ca6146088476e37a15809cb7627d61f59eae76d1245cb83635666d0f6 f2814d661ffe5302b445f7f105e194b9de47aee6e54f10c706fb47d98ab5ae86 e5bb36b3f5376e2590868653fd3fd1d2bbd0c837bda8a7c380c38f77f73438ef d01a733f7c7fc5287e794b64ca46ba54d181cf63586c6734c380d204867ff65f 73a77beba206b4163a1ebd1080e872cb3acff1f7c23d101109a9119fd7872d57 138d328c2fe700ebc0c1134ed39fbd981b4bed6de0826270f7662aa66cd7b3dc 15e5e7e05bd87d26ec21b0dd4d6683c1ccdf391b63dfd9406fc73a8d94ed7e78 7aa601a87a5cc746bbd85e213819e81e4daf7874525a80fd72e7ae643f4112f9 dccd5f8edd23173924d38a15f604b0666cf6feee0735a2581c639386b88763eb 88731c0ae77469b2808aa6c48c73188918aa438171b61f166325cd80e0ea25ce 2fe61f2be2d105c5d94cb68576a5a8e6d3e6ab9e7991225bfeeed917f84ee379 98ae820f3a5ff9c40d346a0e9005a01a1d1b87b4e19cf631403b3a3c6dcfd5d1 abb020e301dc2e6e6fd2925d3c73bf5a1a930929d08af0d61b1cda0ff7a7f846 de67019880ffcd0be3722945816c3ea3626a7ec987a78bd596d9891aa765b6cf 5d600c5a5b5054b85e4a79fbd648c508f1d7d40352b249cc538039bae2537148 42a7509dddd89e0dacb6b6bb211632d7e5b7fbbdccc30a639ba3fd7e874e8fac f33084146276e0fc4bc3bb783b787d9dcaf7b934396bd30bef44109a28074bd1 de9f48f8c27292c5ab38f3ae40df179c23e45d775c818b0ffaff22dbf00298ac 410ee75f684840b9c30ee5f81bf85d787606b45d8eed8e306b3407729e0021af 398e339aecd73c7a816b6a1bf55af94901d64e1ba7ee96ff06a36e51c6bbb596 31b231fe5f41e6ea94a267d91b8f65402fc5c0775a3db9aef591c3075935841d 769ddd645b4a05c77ea3a1b5acd8040d312c2ac5a05ba140968fd6701dec2099 55cf6087ebe764e82cb798abd0fd0bb061210bac170c2c484199c8c6b3122d1a f1f2aba905cc5436ced4f876fb6f06af088e7334204981c4bda9a718fb59e8a3 0d8253a11889bf45592fa8d25619c84296afd52137558792ecc1c497d4ceee5c 19d232c21c897453ef7fd8941fdc1722a0488a1e1580b477f72f2d7e0b33a3c3 6c65dad9e569bd09681b491d0336e239db7af1a5d81cbff2c0000d51cb4294b1 6266ec290bf9a7f4bde2cb32a55fb734d9dec79b361b3e0275f8175c905a3b87 1848f9de466e826458d81b6a61c954f6eb35aaa839bb655f4d0e45e1de997087 b5d76d34245498414102e1cf9f1c188dfc6baa2ba0be9be7b2ddac8a4d7df86e 866c6cd7ccb858adfa88efa5a435c68e2ae37ee20e2808bb018fd822a8b0405a be76b32c63e3a45c5563502ea85e514586ba70fc7e59e0dad9f6ce22d1312bc9 fc33c3a9cc610461cd721bb9ef0950b599ebc9d6ccef2bac3d3dff81bfa00924 ee3ca487d01cc81d2c9ab245700ac3ae6f13102e97082c67384d3fe431ee38fc 327e454a1ac20a4928480708f1cc6580e81873fa427399343619b72a957d2fcc 99150066e0e1d288c9920ade6ae742055a1c58765a31ec5bf8e887fdcf20165d 4883381e4d4a475087d8739b9159db38d4c3692427da4140989adc89466f4da9 d57cb6e067227e33e29efc9af0a806c1e7c49d6332aa999655ab3b5016971b8b 7c34a564af32953ec144ebd4d81f5b9ff399a9b95ba73d1728cd88081021b341 21c673b74ddecf667e3c4f99474fa87afd8b37b035d2dad79bf74e75f3ec1bcc cbbfc051959dee198b8df4e3dd2b1f0b4aec98192dcdb6a70c9740988037708a 2e94efac9875b88896191e78fb13c5d0c366acdeb465d35cfe903ea2dfaec95d e967747ba000ddb6cc61ccd72bba78701ba2bffec1ed0ab5f9bf34d7cbbed0d2 8156af30eaabd38f4229a02fab68731607887fe3f73f8bd3406ed1d30424e25a 690c04c9d5226d9729bdbac3b6947a626d638530f538a9f88a2ed29de280c8f4 dcf2cdb9b8c83faf4cc6dc97ca58113f1cd988142e6683078ab053d42f1bebbb 35743309ab60ee003c5a5235e4de0926331766811f8a0f12e4ae48cac68ba2c6 c31d1af80ac60e401eaa8120e3bc19222ddb7389dac0eb6095b33d05f4aa2b06 400fa37b17297c77d2035bbc35e802af76aa6eae697bcc9a9458ea77004e6bac fa88564d9d7dea64a3d634411a61d5e468303c05f956a8ff77bef6439d00a8d1 c80fdf826986dcd45ee931723bab90fa1716720c35b20f80e8263b5618691f4b e7da9532687d3bc1286e1eed35f4d4d241671b5e3d5afc0b9f175b1a5fc6bdfb e62d205771ba29d738af62b90a4e40ea6171262e571a1c34012390bcdb30e0d1 92968ab2cf861987b502b5ff4efa6eae456c2dda85fb584cebb57c6a5b19439b 1ea20351496de39cb077b63960a3774c8878363091679ddc7db6f94540aa21bd 50fe2660a04eb15e05b864ed955ae6f7474f2a101136dd247e464f6e6e3293d4 311f75443d14fddca05af696f2a0515b5e3b9e465e9173a9e88aff2618c556e2 f3451292f010139ab692b041ced4a172027960f2a128fc836d0de51489eb0403 0fbc8e7f8058638cbb46bd493783a2ad29056dbea41a33e2f71b5a25bb1a37f1 07233ae9f56a84942f14fe009a80e29bb5e13184e73539dacad2d33f7005114d a7ec466b6a5d999e7c0a017b4cef9907bee77d8dc413de14d67f8b103fdfe84a 0de50c428299769befa28bff6e43d5578a312818f6fc22cf99f7605910f1be6e da037968c6b44129b6e435d49d46511e4e78eb452ab418edd0addd04f1ea881a 317e1a815d401a588e740dff04ef4a6916db80b7f7d737a60d977020f97de20c b9a96d9f1b2ea99ba4d38228e9fa11c98385f1ea305efc84a814349f1b1bb460 ebdde57c79ded3e533f44ba2dc051631e2cdcc0485d4c991f58157503e96e784 ba43d394c67391e89679e4671c4227fbe4aa24714c0a24991ce94b5950808700 19c408ef8bc090c86132451577680ee01d21e58da5870a051e26e4fda1cb2c7a 656957ef0a1bd61415a220db352c2cf7032cd41a57bdd10da40a76b749097725 c6cc2024929ff52ff1b7a56162cf5249ed3ae4fd4bd2a3021391bcf919f9d748 21d203df81f473c4fbdb88817e8be4ca080bdfe71f0a2cb2c1c4cb0e74d2af0a afec711730193a1008f388bd5f327ea18d19d88654d0697766a9ccee3b8f614b ff46207cdf0730745dcf2a43d61af2855286ae2d9c5d2d056404fbf27294858b 557ffe04296aa25eae45be58c58eeaef6222cda9a4e0cbc1803193e123efdc87 root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root root slurm_20_11-20.11.7-6.7.1.src.rpm slurm-doc slurm_20_11-doc slurm_20_11-doc(aarch-64)
rpmlib(CompressedFileNames) rpmlib(FileDigests) rpmlib(PayloadFilesHavePrefix) rpmlib(PayloadIsXz) 3.0.4-1 4.6.0-1 4.0-1 5.2-1 slurm-doc 4.14.1 `f@``Q@`4@`@_I@_I@_T___ _F@__c^א^Ǿ^^}^d@^_@^Y ^W@^W@^V]^M#@^E:@^B@^:@^.^*@^*@^)^ [^@^
@] @]@]]B]]](]@]x]W@]+@](v@]'$]#0@]#0@] @] @] @\v{\T4\R@\R@\I\U@\[@[@[@[@[[[.[r@[b@[`O@[`O@[\Z[E@[{@ZZЛZJ@ZJ@ZZ@ZZZo Zo Z_:Z!D@ZY@Yp@Y˒Y@Ycl@Y-^Y]XDX@XBXXXk@XAb@X>@X43@X x@X@X@V5UL@TV TV cgoll@suse.com eich@suse.com cgoll@suse.com cgoll@suse.com aguerrero@suse.com eich@suse.com eich@suse.com aguerrero@suse.com aguerrero@suse.com eich@suse.com aguerrero@suse.com fbui@suse.com aguerrero@suse.com eich@suse.com eich@suse.com cgoll@suse.com eich@suse.com cgoll@suse.com eich@suse.com cgoll@suse.com eich@suse.com kasimir_@outlook.de cgoll@suse.com eich@suse.com eich@suse.com eich@suse.com cgoll@suse.com cgoll@suse.com eich@suse.com eich@suse.com dimstar@opensuse.org cgoll@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com cgoll@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com cgoll@suse.com cgoll@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com cgoll@suse.com eich@suse.com eich@suse.com eich@suse.com cgoll@suse.com cgoll@suse.com cgoll@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com cgoll@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com cgoll@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com cgoll@suse.com cgoll@suse.com eich@suse.com cgoll@suse.com jjolly@suse.com cgoll@suse.com cgoll@suse.com eich@suse.com eich@suse.com jengelh@inai.de jjolly@suse.com jjolly@suse.com jjolly@suse.com eich@suse.com eich@suse.com eich@suse.com jengelh@inai.de eich@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com eich@suse.com scorot@free.fr scorot@free.fr scorot@free.fr scorot@free.fr - Updated to 20.11.7 which fixes CVE-2021-31215 (bsc#1186024)
- New features in 20.11.7:
* slurmd - handle configless failures gracefully instead of hanging
indefinitely.
* select/cons_tres - fix Dragonfly topology not selecting nodes in the same
leaf switch when it should as well as requests with *-switches option.
* Fix issue where certain step requests wouldn't run if the first node in the
job allocation was full and there were idle resources on other nodes in
the job allocation.
* Fix deadlock issue with Slurmctld.
* torque/qstat - fix printf error message in output.
* When adding associations or wckeys avoid checking multiple times a user or
cluster name.
* Fix wrong jobacctgather information on a step on multiple nodes
due to timeouts sending its the information gathered on its node.
* Fix missing xstrdup which could result in slurmctld segfault on array jobs.
* Fix security issue in PrologSlurmctld and EpilogSlurmctld by always
prepending SPANK_ to all user-set environment variables. CVE-2021-31215.
- New features in 20.11.6:
* Fix sacct assert with the --qos option.
* Use pkg-config --atleast-version instead of --modversion for systemd.
* common/fd - fix getsockopt() call in fd_get_socket_error().
* Properly handle the return from fd_get_socket_error() in _conn_readable().
* cons_res - Fix issue where running jobs were not taken into consideration
when creating a reservation.
* Avoid a deadlock between job_list for_each and assoc QOS_LOCK.
* Fix TRESRunMins usage for partition qos on restart/reconfig.
* Fix printing of number of tasks on a completed job that didn't request
tasks.
* Fix updating GrpTRESRunMins when decrementing job time is bigger than it.
* Make it so we handle multithreaded allocations correctly when doing
- -exclusive or --core-spec allocations.
* Fix incorrect round-up division in _pick_step_cores
* Use appropriate math to adjust cpu counts when --ntasks-per-core=1.
* cons_tres - Fix consideration of power downed nodes.
* cons_tres - Fix DefCpuPerGPU, increase cpus-per-task to match with
gpus-per-task * cpus-per-gpu.
* Fix under-cpu memory auto-adjustment when MaxMemPerCPU is set.
* Make it possible to override CR_CORE_DEFAULT_DIST_BLOCK.
* Perl API - fix retrieving/storing of slurm_step_id_t in job_step_info_t.
* Recover state of burst buffers when slurmctld is restarted to avoid skipping
burst buffer stages.
* Fix race condition in burst buffer plugin which caused a burst buffer
in stage-in to not get state saved if slurmctld stopped.
* auth/jwt - print an error if jwt_file= has not been set in slurmdbd.
* Fix RESV_DEL_HOLD not being a valid state when using squeue --states.
* Add missing squeue selectable states in valid states error message.
* Fix scheduling last array task multiple times on error, causing segfault.
* Fix issue where a step could be allocated more memory than the job when
dealing with --mem-per-cpu and --threads-per-core.
* Fix removing qos from assoc with -= can lead to assoc with no qos
* auth/jwt - fix segfault on invalid credential in slurmdbd due to
missing validate_slurm_user() function in context.
* Fix single Port= not being applied to range of nodes in slurm.conf
* Fix Jobs not requesting a tres are not starting because of that tres limit.
* acct_gather_energy/rapl - fix AveWatts calculation.
* job_container/tmpfs - Fix issues with cleanup and slurmd restarting on
running jobs. - Ship REST API version and auth plugins with slurmrestd.
- Add YAML support for REST API to build (bsc#1185603). - Udpate to 20.11.5:
- New features:
* New job_container/tmpfs plugin developed by NERSC that can be used to
create per-job filesystem namespaces. Documentaiion and configuration
can be found in the respecting man page.
- Bug fixes:
* Fix main scheduler bug where bf_hetjob_prio truncates SchedulerParameters.
* Fix sacct not displaying UserCPU, SystemCPU and TotalCPU for large times.
* scrontab - fix to return the correct index for a bad #SCRON option.
* scrontab - fix memory leak when invalid option found in #SCRON line.
* Add errno for when a user requests multiple partitions and they are using
partition based associations.
* Fix issue where a job could run in a wrong partition when using
EnforcePartLimits=any and partition based associations.
* Remove possible deadlock when adding associations/wckeys in multiple
threads.
* When using PrologFlags=alloc make sure the correct Slurm version is set
in the credential.
* When sending a job a warning signal make sure we always send SIGCONT
beforehand.
* Fix issue where a batch job would continue running if a prolog failed on a
node that wasn't the batch host and requeuing was disabled.
* Fix issue where sometimes salloc/srun wouldn't get a message about a prolog
failure in the job's stdout.
* Requeue or kill job on a prolog failure when PrologFlags is not set.
* Fix race condition causing node reboots to get requeued before
ResumeTimeout expires.
* Preserve node boot_req_time on reconfigure.
* Preserve node power_save_req_time on reconfigure.
* Fix node reboots being queued and issued multiple times and preventing the
reboot to time out.
* Fix run_command to exit correctly if track_script kills the calling thread.
* Only requeue a job when the PrologSlurmctld returns nonzero.
* When a job is signaled with SIGKILL make sure we flush all
prologs/setup scripts.
* Handle burst buffer scripts if the job is canceled while stage_in is
happening.
* When shutting down the slurmctld make note to ignore error message when
we have to kill a prolog/setup script we are tracking.
* scrontab - add support for the --open-mode option.
* acct_gather_profile/influxdb - avoid segfault on plugin shutdown if setup
has not completed successfully.
* Reduce delay in starting salloc allocations when running with prologs.
* Alter AllocNodes check to work if the allocating node's domain doesn't
match the slurmctld's. This restores the pre*20.11 behavior.
* Fix slurmctld segfault if jobs from a prior version had the now-removed
INVALID_DEPEND state flag set and were allowed to run in 20.11.
* Add job_container/tmpfs plugin to give a method to provide a private /tmp
per job.
* Set the correct core affinity when using AutoDetect.
* slurmrestd - mark "environment" as required for job submissions in schema. - Udpate to 20.11.04
* Fix node selection for advanced reservations with features.
* mpi/pmix: Handle pipe failure better when using ucx.
* mpi/pmix: include PMIX_NODEID for each process entry.
* Fix job getting rejected after being requeued on same node that died.
* job_submit/lua - add "network" field.
* Fix situations when a reoccuring reservation could erroneously skip a
period.
* Ensure that a reservations [pro|epi]log are ran on reoccuring reservations.
* Fix threads-per-core memory allocation issue when using CR_CPU_MEMORY.
* Fix scheduling issue with --gpus.
* Fix gpu allocations that request --cpus-per-task.
* mpi/pmix: fixed print messages for all PMIXP_* macros
* Add mapping for XCPU to --signal option.
* Fix regression in 20.11 that prevented a full pass of the main scheduler
from ever executing.
* Work around a glibc bug in which "0" is incorrectly printed as "nan"
which will result in corrupted association state on restart.
* Fix regression in 20.11 which made slurmd incorrectly attempt to find the
parent slurmd address when not applicable and send incorrect reverse*tree
info to the slurmstepd.
* Fix cgroup ns detection when using containers (e.g. LXC or Docker).
* scrontab - change temporary file handling to work with emacs.
- Removed check-for-lipmix.so.MAJOR.patch
- Added: load-pmix-major-version.patch - Update to 20.11.03
- This release includes a major functional change to how job step launch is
handled compared to the previous 20.11 releases. This affects srun as
well as MPI stacks - such as Open MPI - which may use srun internally as
part of the process launch.
One of the changes made in the Slurm 20.11 release was to the semantics
for job steps launched through the 'srun' command. This also
inadvertently impacts many MPI releases that use srun underneath their
own mpiexec/mpirun command.
For 20.11.{0,1,2} releases, the default behavior for srun was changed
such that each step was allocated exactly what was requested by the
options given to srun, and did not have access to all resources assigned
to the job on the node by default. This change was equivalent to Slurm
setting the --exclusive option by default on all job steps. Job steps
desiring all resources on the node needed to explicitly request them
through the new '--whole' option.
In the 20.11.3 release, we have reverted to the 20.02 and older behavior
of assigning all resources on a node to the job step by default.
This reversion is a major behavioral change which we would not generally
do on a maintenance release, but is being done in the interest of
restoring compatibility with the large number of existing Open MPI (and
other MPI flavors) and job scripts that exist in production, and to
remove what has proven to be a significant hurdle in moving to the new
release.
Please note that one change to step launch remains - by default, in
20.11 steps are no longer permitted to overlap on the resources they
have been assigned. If that behavior is desired, all steps must
explicitly opt-in through the newly added '--overlap' option.
Further details and a full explanation of the issue can be found at:
https://bugs.schedmd.com/show_bug.cgi?id=10383#c63
- Other changes from 20.11.03
* Fix segfault when parsing bad "#SBATCH hetjob" directive.
* Allow countless gpu:srun, sbatch->srun sequence.
* Reject job credential if non-superuser sets the LAUNCH_NO_ALLOC flag.
* Make it so srun --no-allocate works again.
* jobacct_gather/linux - Don't count memory on tasks that have already
finished.
* Fix 19.05/20.02 batch steps talking with a 20.11 slurmctld.
* jobacct_gather/common - Do not process jobacct's with same taskid when
calling prec_extra.
* Cleanup all tracked jobacct tasks when extern step child process finishes.
* slurmrestd/dbv0.0.36 - Correct structure of dbv0.0.36_tres_list.
* Fix regression causing task/affinity and task/cgroup to be out of sync when
configured ThreadsPerCore is different than the physical threads per core.
* Fix situation when --gpus is given but not max nodes (-N1-1) in a job
allocation.
* Interactive step - ignore cpu bind and mem bind options, and do not set
the associated environment variables which lead to unexpected behavior
from srun commands launched within the interactive step.
* Handle exit code from pipe when using UCX with PMIx. - Fix fallout introduced by:
"Replace '%service_del_postun -n' with '%service_del_postun_without_restart'"
for older Leap/SLE versions. - Fix Provides:/Conflicts: for libnss_slurm (bsc#1180700). - Add support for configuration files from external plugins.
While built-in plugins have their configuration added in slurm.conf,
external SPANK plugins add their configuration to plugstack.conf
To allow packaging easily spank plugins, their configuration files
should be added independently at /etc/spack/plugstack.conf.d and
plugstack.conf should be left with an oneliner including all the
files under /etc/spack/plugstack.conf.d - Update to 20.11.02
* Fix older versions of sacct not working with 20.11.
* Fix slurmctld crash when using a pre-20.11 srun in a job allocation.
* Correct logic problem in _validate_user_access.
* Fix libpmi to initialize Slurm configuration correctly.
- Update to 20.11.01
* Fix spelling of "overcomited" to "overcomitted" in sreport's cluster
utilization report.
* Silence debug message about shutting down backup controllers if none are
configured.
* Don't create interactive srun until PrologSlurmctld is done.
* Fix fd symlink path resolution.
* Fix slurmctld segfault on subnode reservation restore after node
configuration change.
* Fix resource allocation response message environment allocation size.
* Ensure that details->env_sup is NULL terminated.
* select/cray_aries - Correctly remove jobs/steps from blades using NPC.
* cons_tres - Avoid max_node_gres when entire node is allocated with
- -ntasks-per-gpu.
* Allow NULL arg to data_get_type().
* In sreport have usage for a reservation contain all jobs that ran in the
reservation instead of just the ones that ran in the time specified. This
matches the report for the reservation is not truncated for a time period.
* Fix issue with sending wrong batch step id to a < 20.11 slurmd.
* Add a job's alloc_node to lua for job modification and completion.
* Fix regression getting a slurmdbd connection through the perl API.
* Stop the extern step terminate monitor right after proctrack_g_wait().
* Fix removing the normalized priority of assocs.
* slurmrestd/v0.0.36 - Use correct name for partition field:
"min nodes per job" -"min_nodes_per_job".
* slurmrestd/v0.0.36 - Add node comment field.
* Fix regression marking cloud nodes as "unexpectedly rebooted" after
multiple boots.
* Fix slurmctld segfault in _slurm_rpc_job_step_create().
* slurmrestd/v0.0.36 - Filter node states against NODE_STATE_BASE to avoid
the extended states all being reported as "invalid".
* Fix race that can prevent the prolog for a requeued job from running.
* cli_filter - add "type" to readily distinguish between the CLI command in
use.
* smail - reduce sleep before seff to 5 seconds.
* Ensure SPANK prolog and epilog run without an explicit PlugStackConfig.
* Disable MySQL automatic reconnection.
* Fix allowing "b" after memory unit suffixes.
* Fix slurmctld segfault with reservations without licenses.
* Due to internal restructuring ahead of the 20.11 release, applications
calling libslurm MUST call slurm_init(NULL) before any API calls.
Otherwise the API call is likely to fail due to libslurm's internal
configuration not being available.
* slurm.spec - allow custom paths for PMIx and UCX install locations.
* Use rpath if enabled when testing for Mellanox's UCX libraries.
* slurmrestd/dbv0.0.36 - Change user query for associations to optional.
* slurmrestd/dbv0.0.36 - Change account query for associations to optional.
* mpi/pmix - change the error handler error message to be more useful.
* Add missing connection in acct_storage_p_{clear_stats, reconfig, shutdown}.
* Perl API - fix issue when running in configless mode.
* nss_slurm - avoid deadlock when stray sockets are found.
* Display correct value for ScronParameters in 'scontrol show config' - Update to version 20.11.0
Slurm 20.11 includes a number of new features including:
* Overhaul of the job step management and launch code, alongside improved
GPU task placement support.
* A new "Interactive Step" mode of operation for salloc.
* A new "scrontab" command that can be used to submit and manage
periodically repeating jobs.
* IPv6 support.
* Changes to the reservation logic, with new options allowing users
to delete reservations, allowing admins to skip the next occurance of a
repeated reservation, and allowing for a job to be submitted and eligible
to run within multiple reservations.
* Dynamic Future Nodes - automatically associate a dynamically
provisioned (or "cloud") node against a NodeName definition with matching
hardware.
* An experimental new RPC queuing mode for slurmctld to reduce thread
contention on heavily loaded clusters.
* SlurmDBD integration with the Slurm REST API.
Also check
https://github.com/SchedMD/slurm/blob/slurm-20-11-0-1/RELEASE_NOTES - Updated to 20.02.6, addresses two security fixes:
* PMIx - fix potential buffer overflows from use of unpackmem().
CVE-2020-27745 (bsc#1178890)
* X11 forwarding - fix potential leak of the magic cookie when sent as an
argument to the xauth command. CVE-2020-27746 (bsc#1178891)
- And many other bugfixes, full log and details available at:
* https://lists.schedmd.com/pipermail/slurm-announce/2020/000045.html - Replace '%service_del_postun -n' with '%service_del_postun_without_restart'
'-n' is deprecated and will be removed in the future. - Updated to 20.02.5, changes:
* Fix leak of TRESRunMins when job time is changed with --time-min
* pam_slurm - explicitly initialize slurm config to support configless mode.
* scontrol - Fix exit code when creating/updating reservations with wrong
Flags.
* When a GRES has a no_consume flag, report 0 for allocated.
* Fix cgroup cleanup by jobacct_gather/cgroup.
* When creating reservations/jobs don't allow counts on a feature unless
using an XOR.
* Improve number of boards discovery
* Fix updating a reservation NodeCnt on a zero-count reservation.
* slurmrestd - provide an explicit error messages when PSK auth fails.
* cons_tres - fix job requesting single gres per-node getting two or more
nodes with less CPUs than requested per-task.
* cons_tres - fix calculation of cores when using gres and cpus-per-task.
* cons_tres - fix job not getting access to socket without GPU or with less
than --gpus-per-socket when not enough cpus available on required socket
and not using --gres-flags=enforce binding.
* Fix HDF5 type version build error.
* Fix creation of CoreCnt only reservations when the first node isn't
available.
* Fix wrong DBD Agent queue size in sdiag when using accounting_storage/none.
* Improve job constraints XOR option logic.
* Fix preemption of hetjobs when needed nodes not in leader component.
* Fix wrong bit_or() messing potential preemptor jobs node bitmap, causing
bad node deallocations and even allocation of nodes from other partitions.
* Fix double-deallocation of preempted non-leader hetjob components.
* slurmdbd - prevent truncation of the step nodelists over 4095.
* Fix nodes remaining in drain state state after rebooting with ASAP option.
- changes from 20.02.4:
* srun - suppress job step creation warning message when waiting on
PrologSlurmctld.
* slurmrestd - fix incorrect return values in data_list_for_each() functions.
* mpi/pmix - fix issue where HetJobs could fail to launch.
* slurmrestd - set content-type header in responses.
* Fix cons_res GRES overallocation for --gres-flags=disable-binding.
* Fix cons_res incorrectly filtering cores with respect to GRES locality for
- -gres-flags=disable-binding requests.
* Fix regression where a dependency on multiple jobs in a single array using
underscores would only add the first job.
* slurmrestd - fix corrupted output due to incorrect use of memcpy().
* slurmrestd - address a number of minor Coverity warnings.
* Handle retry failure when slurmstepd is communicating with srun correctly.
* Fix jobacct_gather possibly duplicate stats when _is_a_lwp error shows up.
* Fix tasks binding to GRES which are closest to the allocated CPUs.
* Fix AMD GPU ROCM 3.5 support.
* Fix handling of job arrays in sacct when querying specific steps.
* slurmrestd - avoid fallback to local socket authentication if JWT
authentication is ill-formed.
* slurmrestd - restrict ability of requests to use different authentication
plugins.
* slurmrestd - unlink named unix sockets before closing.
* slurmrestd - fix invalid formatting in openapi.json.
* Fix batch jobs stuck in CF state on FrontEnd mode.
* Add a separate explicit error message when rejecting changes to active node
features.
* cons_common/job_test - fix slurmctld SIGABRT due to double-free.
* Fix updating reservations to set the duration correctly if updating the
start time.
* Fix update reservation to promiscuous mode.
* Fix override of job tasks count to max when ntasks-per-node present.
* Fix min CPUs per node not being at least CPUs per task requested.
* Fix CPUs allocated to match CPUs requested when requesting GRES and
threads per core equal to one.
* Fix NodeName config parsing with Boards and without CPUs.
* Ensure SLURM_JOB_USER and SLURM_JOB_UID are set in SrunProlog/Epilog.
* Fix error messages for certain invalid salloc/sbatch/srun options.
* pmi2 - clean up sockets at step termination.
* Fix 'scontrol hold' to work with 'JobName'.
* sbatch - handle --uid/--gid in #SBATCH directives properly.
* Fix race condition in job termination on slurmd.
* Print specific error messages if trying to run use certain
priority/multifactor factors that cannot work without SlurmDBD.
* Avoid partial GRES allocation when --gpus-per-job is not satisfied.
* Cray - Avoid referencing a variable outside of it's correct scope when
dealing with creating steps within a het job.
* slurmrestd - correctly handle larger addresses from accept().
* Avoid freeing wrong pointer with SlurmctldParameters=max_dbd_msg_action
with another option after that.
* Restore MCS label when suspended job is resumed.
* Fix insufficient lock levels.
* slurmrestd - use errno from job submission.
* Fix "user" filter for sacctmgr show transactions.
* Fix preemption logic.
* Fix no_consume GRES for exclusive (whole node) requests.
* Fix regression in 20.02 that caused an infinite loop in slurmctld when
requesting --distribution=plane for the job.
* Fix parsing of the --distribution option.
* Add CONF READ_LOCK to _handle_fed_send_job_sync.
* prep/script - always call slurmctld PrEp callback in _run_script().
* Fix node estimation for jobs that use GPUs or --cpus-per-task.
* Fix jobcomp, job_submit and cli_filter Lua implementation plugins causing
slurmctld and/or job submission CLI tools segfaults due to bad return
handling when the respective Lua script failed to load.
* Fix propagation of gpu options through hetjob components.
* Add SLURM_CLUSTERS environment variable to scancel.
* Fix packing/unpacking of "unlinked" jobs.
* Connect slurmstepd's stderr to srun for steps launched with --pty.
* Handle MPS correctly when doing exclusive allocations.
* slurmrestd - fix compiling against libhttpparser in a non-default path.
* slurmrestd - avoid compilation issues with libhttpparser < 2.6.
* Fix compile issues when compiling slurmrestd without --enable-debug.
* Reset idle time on a reservation that is getting purged.
* Fix reoccurring reservations that have Purge_comp= to keep correct
duration if they are purged.
* scontrol - changed the "PROMISCUOUS" flag to "MAGNETIC"
* Early return from epilog_set_env in case of no_consume.
* Fix cons_common/job_test start time discovery logic to prevent skewed
results between "will run test" executions.
* Ensure TRESRunMins limits are maintained during "scontrol reconfigure".
* Improve error message when host lookup fails.
- Refresh patch: pam_slurm-Initialize-arrays-and-pass-sizes.patch - Add support for openPMIx also for Leap/SLE 15.0/1 (bsc#1173805).
- Do not run %check on SLE-12-SP2: Some incompatibility in tcl
makes this fail.
- Remove unneeded build dependency to postgresql-devel.
- Disable build on s390 (requires 64bit). - Bring QA to the package build: add %%check stage.
- Remove cruft that isn't needed any longer.
- Add 'ghosted' run-file.
- Add rpmlint filter to handle issues with library packages
for Leap and enterprise upgrade versions. - Updated to 20.02.3 which fixes CVE-2020-12693 (bsc#1172004).
- Other changes are:
* Factor in ntasks-per-core=1 with cons_tres.
* Fix formatting in error message in cons_tres.
* Fix calling stat on a NULL variable.
* Fix minor memory leak when using reservations with flags=first_cores.
* Fix gpu bind issue when CPUs=Cores and ThreadsPerCore > 1 on a node.
* Fix --mem-per-gpu for heterogenous --gres requests.
* Fix slurmctld load order in load_all_part_state().
* Fix race condition not finding jobacct gather task cgroup entry.
* Suppress error message when selecting nodes on disjoint topologies.
* Improve performance of _pack_default_job_details() with large number of job
* arguments.
* Fix archive loading previous to 17.11 jobs per-node req_mem.
* Fix regresion validating that --gpus-per-socket requires --sockets-per-node
* for steps. Should only validate allocation requests.
* error() instead of fatal() when parsing an invalid hostlist.
* nss_slurm - fix potential deadlock in slurmstepd on overloaded systems.
* cons_tres - fix --gres-flags=enforce-binding and related --cpus-per-gres.
* cons_tres - Allocate lowest numbered cores when filtering cores with gres.
* Fix getting system counts for named GRES/TRES.
* MySQL - Fix for handing typed GRES for association rollups.
* Fix step allocations when tasks_per_core > 1.
* Fix allocating more GRES than requested when asking for multiple GRES types. - Treat libnss_slurm like any other package: add version string to
upgrade package. - Updated to 20.02.1 with following changes"
* Improve job state reason for jobs hitting partition_job_depth.
* Speed up testing of singleton dependencies.
* Fix negative loop bound in cons_tres.
* srun - capture the MPI plugin return code from mpi_hook_client_fini() and
use as final return code for step failure.
* Fix segfault in cli_filter/lua.
* Fix --gpu-bind=map_gpu reusability if tasks > elements.
* Make sure config_flags on a gres are sent to the slurmctld on node
registration.
* Prolog/Epilog - Fix missing GPU information.
* Fix segfault when using config parser for expanded lines.
* Fix bit overlap test function.
* Don't accrue time if job begin time is in the future.
* Remove accrue time when updating a job start/eligible time to the future.
* Fix regression in 20.02.0 that broke --depend=expand.
* Reset begin time on job release if it's not in the future.
* Fix for recovering burst buffers when using high-availability.
* Fix invalid read due to freeing an incorrectly allocated env array.
* Update slurmctld -i message to warn about losing data.
* Fix scontrol cancel_reboot so it clears the DRAIN flag and node reason for a
pending ASAP reboot. - Remove legacy_cray: with 20.02 the special treatment for
cray-specific plugins on SLE version prior to 15SP2 is
no longer required. - slurm-plugins will now also require pmix not only libpmix
(bsc#1164326) - Removed autopatch as it doesn't work for the SLE-11-SP4 build. - Disable %arm builds as this is no longer supported. - pmix searches now also for libpmix.so.2 so that there is no dependency
for devel package (bsc#1164386)
* added patch file check-for-lipmix.so.MAJOR.patch
* reworded patch file Remove-rpath-from-build.patch to use %autopatch - Update to version 20.02.0 (jsc#SLE-8491)
* Fix minor memory leak in slurmd on reconfig.
* Fix invalid ptr reference when rolling up data in the database.
* Change shtml2html.py to require python3 for RHEL8 support, and match
man2html.py.
* slurm.spec - override "hardening" linker flags to ensure RHEL8 builds
in a usable manner.
* Fix type mismatches in the perl API.
* Prevent use of uninitialized slurmctld_diag_stats.
* Fixed various Coverity issues.
* Only show warning about root-less topology in daemons.
* Fix accounting of jobs in IGNORE_JOBS reservations.
* Fix issue with batch steps state not loading correctly when upgrading from
19.05.
* Deprecate max_depend_depth in SchedulerParameters and move it to
DependencyParameters.
* Silence erroneous error on slurmctld upgrade when loading federation state.
* Break infinite loop in cons_tres dealing with incorrect tasks per tres
request resulting in slurmctld hang.
* Improve handling of --gpus-per-task to make sure appropriate number of GPUs
is assigned to job.
* Fix seg fault on cons_res when requesting --spread-job.
- Move to python3 for everything but SLE-11-SP4
* For SLE-11-SP4 add a workaround to handle a python3 script (python2.7
compliant). - Add explicit version dependency to libpmix as well.
'slurm-devel' has a tight version dependency on libpmix -
allowing multiple libpmix versions in one package repository
is therefore essential. - Update to version 20.02.0-rc1
* sbatch - fix segfault when no newline at the end of a burst buffer file.
* Change scancel to only check job's base state when matching -t options.
* Save job dependency list in state files.
* cons_tres - allow jobs to be run on systems with root-less topologies.
* Restore pre-20.02pre1 PrologSlurmctld synchonization behavior to avoid
various race conditions, and ensure proper batch job launch.
* Add new slurmrestd command/daemon which implements the Slurm REST API. - Update to version 20.02.0-0pre1, highlights are
Highlights:
* Exclusive behavior of a node includes all GRES on a node as well
as the cpus.
* Use python3 instead of python for internal build/test scripts.
The slurm.spec file has been updated to depend on python3 as well.
* Added new NodeSet configuration option to help simplify partition
configuration sections for heterogeneous / condo*style clusters.
* Added slurm.conf option MaxDBDMsgs to control how many messages will be
stored in the slurmctld before throwing them away when the slurmdbd is down.
* The checkpoint plugin interface and all associated API calls have been
removed.
* slurm_init_job_desc_msg() initializes mail_type as uint16_t. This allows
mail_type to be set to NONE with scontrol.
* Add new slurm_spank_log() function to print messages back to the user from
within a SPANK plugin without prepending "error: " from slurm_error().
* Enforce having partition name and nodelist=ALL when creating reservations
with flags=PART_NODES.
* SPANK - removed never-implemented slurm_spank_slurmd_init() interface. This
hook has always been accessible through slurm_spank_init() in the
S_CTX_SLURMD context instead.
* sbcast - add new BcastAddr option to NodeName lines to allow sbcast traffic
to flow over an alternate network path.
* Added auth/jwt plugin, and 'scontrol token' subcommand. PMIx - improve
* performance of proc map generation. Deprecate kill_invalid_depend in
* SchedulerParameters and move it to a new
option called DependencyParameters.
* Enable job dependencies for any job on any cluster in the same federation.
* Allow clusters to be added automatically to db at startup of ctld. Add
* AccountingStorageExternalHost slurm.conf parameter. The
* "ConditionPathExists" condition in slurmd.service has been disabled by
default to permit simpler installation of a "configless" Slurm cluster.
* In SchedulerParameters remove deprecated max_job_bf and replace with
bf_max_job_test.
* Disable sbatch, salloc, srun --reboot for non-admins. SPANK - added support
* for S_JOB_GID in the job script context with
spank_get_item().
* Prolog/Epilog - add SLURM_JOB_GID environment variable.
configuration file changes:
* The mpi/openmpi plugin has been removed as it does nothing.
MpiDefault=openmpi will be translated to the functionally-equivalent
MpiDefault=none.
command changes (see man pages for details)
* Display StepId=.batch instead of StepId=.4294967294 in output
of "scontrol show step". (slurm_sprint_job_step_info())
* MPMD in srun will now defer PATH resolution for the commands to launch to
slurmstepd. Previously it would handle resolution client*side, but with
a non*standard approach that walked PATH in reverse.
* squeue - added "--me" option, equivalent to --user=$USER.
* The LicensesUsed line has been removed from 'scontrol show config'.
Please see the 'scontrol show licenses' command as an alternative.
* sbatch - adjusted backoff times for "--wait" option to reduce load on
slurmctld. This results in a steady*state delay of 32s between queries,
instead of the prior 10s delay.
- Removed following deprecated patches:
* removed patch slurmctld-rerun-agent_init-when-backup-controller-takes-over.patch
* removed patch split-xdaemon-in-xdaemon_init-and-xdaemon_finish-for.patch
* removed patch slurmctld-uses-xdaemon_-for-systemd.patch
* removed patch slurmd-uses-xdaemon_-for-systemd.patch
* removed patch slurmdbd-uses-xdaemon_-for-systemd.patch
* removed patch slurmsmwd-uses-xdaemon_-for-systemd.patch
* removed patch removed-deprecated-xdaemon.patch - standard slurm.conf uses now also SlurmctldHost on all build
targets (bsc#1162377) - Fix a missed systemd_requires -> systemd_ordering conversion. - Remove special OHPC compatibility macro: these settings should
be applied univerally.
- Add a Recommends for mariadb to slurm-slurmdbd: it is recommened
to run the database on the same machine as the daemon. - BuildRequire pkgconfig(systemd) instead of systemd: allow OBS to
shortcut through the -mini flavors.
- Use systemd_ordering instead of systemd_requires: systemd is
never a strict requirement; but in case the system is scheduled
for installation together with systemd, we want systemd to be
installed prior to slurm. - start slurmdbd after mariadb (bsc#1161716) - Fix base_ver for SLE 15 SP2. - Update to version 19.05.5 (jsc#SLE-8491)
* Check %docdir/NEWS for details.
* Includes security fixes CVE-2019-19727, CVE-2019-19728,
CVE-2019-12838.
* Disable i586 builds as this is no longer supported.
* Create libnss_slurm package to support user and group resolution
thru slurmstepd.
* slurm-2.4.4-rpath.patch -> Remove-rpath-from-build.patch
Obsoleted:
- pam_slurm_adopt-avoid-running-outside-of-the-sshd-PA.patch
- pam_slurm_adopt-send_user_msg-don-t-copy-undefined-d.patch
- pam_slurm_adopt-use-uid-to-determine-whether-root-is.patch - Deprecate "ControlMachine" only for SLURM version upgrades and
products newer than 1501. This ensures that the original setting
is retained for the SLURM version shipped origianlly with SLE-15-SP1
or Leap 15.1. - Update to v18.08.9 for fixing CVE-2019-19728 (bsc#1159692).
* Wrap END_TIMER{,2,3} macro definition in "do {} while (0)" block.
* Make sview work with glib2 v2.62.
* Make Slurm compile on linux after sys/sysctl.h was deprecated.
* Install slurmdbd.conf.example with 0600 permissions to encourage secure
use. CVE-2019-19727.
* srun - do not continue with job launch if --uid fails. CVE-2019-19728. - added pmix support jsc#SLE-10800 - Use --with-shared-libslurm to build slurm binaries using libslurm.
- Make libslurm depend on slurm-config. - Fix ownership of /var/spool/slurm on new installations
and upgrade (boo#1158696). - Fix permissions of slurmdbd.conf (bsc#1155784, CVE-2019-19727).
- Fix %posttrans macro _res_update to cope with added newline
(bsc#1153259). - Add package slurm-webdoc which sets up a web server to provide
the documentation for the version shipped. - Move srun from 'slurm' to 'slurm-node': srun is required on the
nodes as well so sbatch will work. 'slurm-node' is a requirement
when 'slurm' is installed (bsc#1153095). - Set %base_ver for SLE-15-SP2 to 18.08 (for now). - Edit sample configuration to deprecate "ControlMachine",
"ControlAddr", "BackupController" and "BackupAddr" in favor
"SlurmctldHost". - Fix logic of slurm-munge recommends: slurm-munge requires munge
already, so if we have munge installed we recommend slurm-munge
as the authentication when installing slurm or slurm-node. - Fix build for SLE-11-SP4 and older. - added cray depend libraries to seperate package, as they are now
built, since json is enabled - Updated to 18.08.8 for fixing (CVE-2019-12838, bsc#1140709, jsc#SLE-7341,
jsc#SLE-7342)
* Update "xauth list" to use the same 10000ms timeout as the other xauth
commands.
* Fix issue in gres code to handle a gres cnt of 0.
* Don't purge jobs if backfill is running.
* Verify job is pending add/removing accrual time.
* Don't abort when the job doesn't have an association that was removed
before the job was able to make it to the database.
* Set state_reason if select_nodes() fails job for QOS or Account.
* Avoid seg_fault on referencing association without a valid_qos bitmap.
* If Association/QOS is removed on a pending job set that job as ineligible.
* When changing a jobs account/qos always make sure you remove the old limits.
* Don't reset a FAIL_QOS or FAIL_ACCOUNT job reason until the qos or
account changed.
* Restore "sreport -T ALL" functionality.
* Correctly typecast signals being sent through the api.
* Properly initialize structures throughout Slurm.
* Sync "numtask" squeue format option for jobs and steps to "numtasks".
* Fix sacct -PD to avoid CA before start jobs.
* Fix potential deadlock with backup slurmctld.
* Fixed issue with jobs not appearing in sacct after dependency satisfied.
* Fix showing non-eligible jobs when asking with -j and not -s.
* Fix issue with backfill scheduler scheduling tasks of an array
when not the head job.
* accounting_storage/mysql - fix SIGABRT in the archive load logic.
* accounting_storage/mysql - fix memory leak in the archive load logic.
* Limit records per single SQL statement when loading archived data.
* Fix unnecessary reloading of job submit plugins.
* Allow job submit plugins to be turned on/off with a reconfigure.
* Fix segfault when loading/unloading Lua job submit plugin multiple times.
* Fix printing duplicate error messages of jobs rejected by job submit plugin.
* Fix printing of job submit plugin messages of het jobs without pack id.
* Fix memory leak in group_cache.c
* Fix jobs stuck from FedJobLock when requeueing in a federation
* Fix requeueing job in a federation of clusters with differing associations
* sacctmgr - free memory before exiting in 'sacctmgr show runaway'.
* Fix seff showing memory overflow when steps tres mem usage is 0.
* Upon archive file name collision, create new archive file instead of
overwriting the old one to prevent lost records.
* Limit archive files to 50000 records per file so that archiving large
databases will succeed.
* Remove stray newlines in SPANK plugin error messages.
* Fix archive loading events.
* In select/cons_res: Only allocate 1 CPU per node with the --overcommit and
- -nodelist options.
* Fix main scheduler from potentially not running through whole queue.
* cons_res/job_test - prevent a job from overallocating a node memory.
* cons_res/job_test - fix to consider a node's current allocated memory when
testing a job's memory request.
* Fix issue where multi-node job steps on cloud nodes wouldn't finish cleaning
up until the end of the job (rather than the end of the step).
* Fix issue with a 17.11 sbcast call to a 18.08 daemon.
* Add new job bit_flags of JOB_DEPENDENT.
* Make it so dependent jobs reset the AccrueTime and do not count against any
AccrueTime limits.
* Fix sacctmgr --parsable2 output for reservations and tres.
* Prevent slurmctld from potential segfault after job_start_data() called
for completing job.
* Fix jobs getting on nodes with "scontrol reboot asap".
* Record node reboot events to database.
* Fix node reboot failure message getting to event table.
* Don't write "(null)" to event table when no event reason exists.
* Fix minor memory leak when clearing runaway jobs.
* Avoid flooding slurmctld and logging when prolog complete RPC errors occur.
* Fix GCC 9 compiler warnings.
* Fix seff human readable memory string for values below a megabyte.
* Fix dump/load of rejected heterogeneous jobs.
* For heterogeneous jobs, do not count the each component against the QOS or
association job limit multiple times.
* slurmdbd - avoid reservation flag column corruption with the use of newer
flags, instead preserve the older flag fields that we can still fit in the
smallint field, and discard the rest.
* Fix security issue in accounting_storage/mysql plugin on archive file loads
by always escaping strings within the slurmdbd. CVE-2019-12838. - Fix build dependency issue around libibmad-devel introduced
in SLE-12-SP4. - Add BuildRequires to address warnings during build:
* for libcurl-devel, libssh2-devel and rrdtool-devel
* for libjson-c-devel and liblz4-devel where available,
disable these with --without-json and --without-lz4
where not.
* disable DataWarp (--without-datawarp). - Update SLURM to 18.08.7:
* Set debug statement to debug2 to avoid benign error messages.
* Add SchedulerParameters option of bf_hetjob_immediate to attempt to start
a heterogeneous job as soon as all of its components are determined able
to do so.
* Fix underflow causing decay thread to exit.
* Fix main scheduler not considering hetjobs when building the job queue.
* Fix regression for sacct to display old jobs without a start time.
* Fix setting correct number of gres topology bits.
* Update hetjobs pending state reason when appropriate.
* Fix accounting_storage/filetxt's understanding of TRES.
* Set Accrue time when not enforcing limits.
* Fix srun segfault when requesting a hetjob with test_exec or bcast
options.
* Hide multipart priorities log message behind Priority debug flag.
* sched/backfill - Make hetjobs sensitive to bf_max_job_start.
* Fix slurmctld segfault due to job's partition pointer NULL dereference.
* Fix issue with OR'ed job dependencies.
* Add new job's bit_flags of INVALID_DEPEND to prevent rebuilding a job's
dependency string when it has at least one invalid and purged dependency.
* Promote federation unsynced siblings log message from debug to info.
* burst_buffer/cray - fix slurmctld SIGABRT due to illegal read/writes.
* burst_buffer/cray - fix memory leak due to unfreed job script content.
* node_features/knl_cray - fix script_argv use-after-free.
* burst_buffer/cray - fix script_argv use-after-free.
* Fix invalid reads of size 1 due to non null-terminated string reads.
* Add extra debug2 logs to identify why BadConstraints reason is set. - Do not build hdf5 support where not available. - Add support for version updates on SLE: Update packages to a
later version than the version supported originally on SLE
will receive a version string in their package name. - added the hdf5 job data gathering plugin - Add backward compatibility with SLE-11 SP4 - Update to version 18.08.05-2:
This version obsoletes:
Fix-contrib-perlapi-to-build-with-the-fix-for-CVE-2019-6438-750cc23ed.patch
- Fix spec file for older SUSE versions. - Update to version 18.08.05:
* Add mitigation for a potential heap overflow on 32-bit systems in xmalloc.
(CVE-2019-6438, bsc#1123304).
* Other fixes:
+ Backfill - If a job has a time_limit guess the end time of a job better
if OverTimeLimit is Unlimited.
+ Fix "sacctmgr show events event=cluster"
+ Fix sacctmgr show runawayjobs from sibling cluster
+ Avoid bit offset of -1 in call to bit_nclear().
+ Insure that "hbm" is a configured GresType on knl systems.
+ Fix NodeFeaturesPlugins=node_features/knl_generic to allow other gres
other than knl.
+ cons_res: Prevent overflow on multiply.
+ Better debug for bad values in gres.conf.
+ Fix double accounting of energy at end of job.
+ Read gres.conf for cloud nodes on slurmctld.
+ Don't assume the first node of a job is the batch host when purging jobs
from a node.
+ Better debugging when a job doesn't have a job_resrcs ptr.
+ Store ave watts in energy plugins.
+ Add XCC plugin for reading Lenovo Power.
+ Fix minor memory leak when scheduling rebootable nodes.
+ Fix debug2 prefix for sched log.
+ Fix printing correct SLURM_JOB_ACCOUNT_PACK_GROUP_* in env for a Het Job.
+ sbatch - search current working directory first for job script.
+ Make it so held jobs reset the AccrueTime and do not count against any
AccrueTime limits.
+ Add SchedulerParameters option of bf_hetjob_prio=[min|avg|max] to alter
the job sorting algorithm for scheduling heterogeneous jobs.
+ Fix initialization of assoc_mgr_locks and slurmctld_locks lock
structures.
+ Fix segfault with job arrays using X11 forwarding.
+ Revert regression caused by e0ee1c7054 which caused negative values and
values starting with a decimal to be invalid for PriorityWeightTRES and
TRESBillingWeight.
+ Fix possibility to update a job's reservation to none.
+ Suppress connection errors to primary slurmdbd when backup dbd is active.
+ Suppress connection errors to primary db when backup db kicks in
+ Add missing fields for sacct --completion when using jobcomp/filetxt.
+ Fix incorrect values set for UserCPU, SystemCPU, and TotalCPU sacct
fields when JobAcctGatherType=jobacct_gather/cgroup.
+ Fixed srun from double printing invalid option msg twice.
+ Remove unused -b flag from getopt call in sbatch.
+ Disable reporting of node TRES in sreport.
+ Re-enabling features combined by OR within parenthesis for non-knl
setups.
+ Prevent sending duplicate requests to reboot a node before ResumeTimeout.
+ Down nodes that don't reboot by ResumeTimeout.
+ Update seff to reflect API change from rss_max to tres_usage_in_max.
+ Add missing TRES constants from perl API.
+ Fix issue where sacct would return incorrect array tasks when querying
specific tasks.
+ Add missing variables to slurmdb_stats_t in the perlapi.
+ Fix nodes not getting reboot RPC when job requires reboot of nodes.
+ Fix failing update the partition list of a job.
+ Use slurm.conf gres ids instead of gres.conf names to get a gres type
name.
* Disable
slurmctld-rerun-agent_init-when-backup-controller-takes-over.patch:
Believed to be fixed by commit c1a537dbbe6
See: https://bugs.schedmd.com/show_bug.cgi?id=5511
* Add
Fix-contrib-perlapi-to-build-with-the-fix-for-CVE-2019-6438-750cc23ed.patch:
Fix fallout from 750cc23ed for CVE-2019-6438. - Update to 18.08.04, with following highlights
* Fix message sent to user to display preempted instead of time limit when
a job is preempted.
* Fix memory leak when a failure happens processing a nodes gres config.
* Improve error message when failures happen processing a nodes gres config.
* Don't skip jobs in scontrol hold.
* Allow --cpu-bind=verbose to be used with SLURM_HINT environment variable.
* Enhanced handling for runaway jobs
* cons_res: Delay exiting cr_job_test until after cores/cpus are calculated
and distributed.
* Don't check existence of srun --prolog or --epilog executables when set to
"none" and SLURM_TEST_EXEC is used.
* Add "P" suffix support to job and step tres specifications.
* Fix jobacct_gather/cgroup to work correctly when more than one task is
started on a node.
* salloc - set SLURM_NTASKS_PER_CORE and SLURM_NTASKS_PER_SOCKET in the
environment if the corresponding command line options are used.
* slurmd - fix handling of the -f flag to specify alternate config file
locations.
* Add SchedulerParameters option of bf_ignore_newly_avail_nodes to avoid
scheduling lower priority jobs on resources that become available during
the backfill scheduling cycle when bf_continue is enabled.
* job_submit/lua: Add several slurmctld return codes and add user/group info
* salloc/sbatch/srun - print warning if mutually exclusive options of --mem
and --mem-per-cpu are both set.
- Refreshed:
* pam_slurm_adopt-avoid-running-outside-of-the-sshd-PA.patch - restarting services on update only when activated
- added rotation of logs
- Added backported patches which harden the pam module pam_slurm_adopt
(BOO#1116758) which will be in slurm 19.05.x
* added pam_slurm_adopt-avoid-running-outside-of-the-sshd-PA.patch
[PATCH 1/3] pam_slurm_adopt: avoid running outside of the sshd PAM
* added pam_slurm_adopt-send_user_msg-don-t-copy-undefined-d.patch
[PATCH 2/3] pam_slurm_adopt: send_user_msg: don't copy undefined data
* added pam_slurm_adopt-use-uid-to-determine-whether-root-is.patch
[PATCH 3/3] pam_slurm_adopt: use uid to determine whether root is
logging on
- package slurm-pam_slurm now depends on slurm-node and not on slurm - fixed code in %pretrans section to be compatible with lua 5.1 - Added missing perl-base dependency. - Moved HTML docs to doc package. - Moved config man pages to a separate package: This way, they won't
get installed on compute nodes. - Update to 18.08.3
* Add new burst buffer state of "teardown-fail" to indicate the burst
buffer teardown operation is failing on specific buffers.
* Multiple backup slurmctld daemons can be configured
* Enable jobs with zero node count for creation and/or deletion of persistent
burst buffers.
* Add "scontrol show dwstat" command to display Cray burst buffer status.
* Add "GetSysStatus" option to burst_buffer.conf file.
* Add node and partition configuration options of "CpuBind" to control
default task binding.
* Add "NumaCpuBind" option to knl.conf
* Add sbatch "--batch" option to identify features required on batch node.
* Add "BatchFeatures" field to output of "scontrol show job".
* Add support for "--bb" option to sbatch command.
* Add new SystemComment field to job data structure and database.
* Expand reservation "flags" field from 32 to 64 bits.
* Add job state flag of "SIGNALING" to avoid race condition.
* Properly handle srun --will-run option when there are jobs in COMPLETING
state.
* Properly report who is signaling a step.
* Don't combine updated reservation records in sreport's reservation report.
* node_features plugin - Add suport for XOR & XAND of job constraints (node
feature specifications).
* Improvements to how srun searches for the executible when using cwd.
* Now programs can be checked before execution if test_exec is set.
* Report NodeFeatures plugin configuration with scontrol and sview commands.
* Add acct_gather_profile/influxdb plugin.
* Add new job state of SO/STAGE_OUT
* Correct SLURM_NTASKS and SLURM_NPROCS environment variable for
heterogeneous job step.
* Expand advanced reservation feature specification to support parenthesis
and counts of nodes with specified features.
* Defer job signaling until prolog is completed
* Have the primary slurmctld wait until the backup has completely shutdown
before taking control.
* Fix issue where unpacking job state after TRES count changed could lead to
invalid reads.
* Heterogeneous job steps allocations supported with Open MPI.
* Remove redundant function arguments from task plugins.
* Add Slurm configuration file check logic using "slurmctld -t" command.
* Add the use of a xml file to help performance when using hwloc.
* Remove support for "ChosLoc" configuration parameter.
* Configuration parameters "ControlMachine", "ControlAddr",
"BackupController" and "BackupAddr" replaced by an ordered list of
"SlurmctldHost" records.
* Remove --immediate option from sbatch.
* Add infrastructure for per-job and per-step TRES parameters.
* Add DefCpuPerGpu and DefMemPerGpu to global and per-partition configuration
parameters.
* Add ValidateMode configuration parameter to knl_cray.conf.
* Disable local PTY output processing when using 'srun --unbuffered'.
* Change the column name for the %U (User ID) field in squeue to 'UID'.
* CRAY - Add CheckGhalQuiesce to the CommunicationParameters.
* When a process is core dumping, avoid terminating other processes in that
task group.
* CPU frequency management enhancements: If scaling_available_frequencies
file is not available, then derive values from scaling_min_freq and
scaling_max_freq values.
* Add pending jobs count to sdiag output.
* Add configuration paramerers SlurmctldPrimaryOnProg and
SlurmctldPrimaryOffProg, which define programs to execute when a slurmctld
daemon changes state.
* Add configuration paramerers SlurmctldAddr for use with virtual IP to
manage backup slurmctld daemons.
* Explicitly shutdown the slurmd process when instructed to reboot.
* Add ability to create/update partition with TRESBillingWeights through
scontrol.
* Calcuate TRES billing values at submission.
* Add node_features plugin function "node_features_p_reboot_weight()".
* Add NodeRebootWeight parameter to knl.conf configuration file.
* Completely remove "gres" field from step record. Use "tres_per_node",
"tres_per_socket", etc.
* Add "Links" parameter to gres.conf configuration file.
* Force slurm_mktime() to set tm_isdst to -1.
* burst_buffer.conf - Add SetExecHost flag to enable burst buffer access
from the login node for interactive jobs.
* Append ", with requeued tasks" to job array "end" emails if any tasks in
the array were requeued.
* Add ResumeFailProgram slurm.conf option to specify a program that is called
when a node fails to respond by ResumeTimeout.
* Add new job pending reason of "ReqNodeNotAvail, reserved for maintenance".
* Remove AdminComment += syntax from 'scontrol update job'.
* sched/backfill: Reset job time limit if needed for deadline scheduling.
* For heterogeneous job component with required nodes, explicitly exclude
those nodes from all other job components.
* Add name of partition used to output of srun --test-only output.
* sdiag output now reports outgoing slurmctld message queue contents.
* Improve escaping special characters on user commands when specifying paths.
* Add salloc/sbatch/srun option of --gres-flags=disable-binding to disable
filtering of CPUs with respect to generic resource locality.
* SlurmDBD - Print warning if MySQL/MariaDB internal tuning is not at least
half of the recommended values.
* Add ability to specify a node reason when rebooting nodes with "scontrol
reboot".
* Add nextstate option to "scontrol reboot".
* Consider "resuming" (nextstate=resume) nodes as available in backfill
future scheduling.
* Add TimelimitRaw sacct output field to display timelimit numbers.
* Add support for sacct --whole-hetjob=[yes|no] option.
* Make salloc handle node requests the same as sbatch.
* Add shutdown_on_reboot SlurmdParameter to control whether the Slurmd will
shutdown itself down or not when a reboot request is received.
* Add cancel_reboot scontrol option to cancel pending reboot of nodes.
* Make Users case insensitive in the database based on
Parameters=PreserveCaseUser in the slurmdbd.conf.
* Improve scheduling when dealing with node_features that could have a
boot delay.
* Changed the default AuthType for slurmdbd to auth/munge.
* Added 'remote-fs.target' to After directive of slurmd.service file.
* Remove drain on node when reboot nextstate used.
* Speed up pack of job's qos.
* Add sacctmgr options to prevent/manage job queue stuffing:
- GrpJobsAccrue=
- MaxJobsAccrue=
* MinPrioThreshold
Minimum priority required to reserve resources when scheduling.
* Add control_inx value to trigger_info_msg_t to permit future work in the
trigger management code to distinguish which of multiple backup controllers
has changed state.
* NOTES:
PreemptType=preempt/job_prio has been removed - use PreemptType=preempt/qos
instead.
* Bluegene support was deprecated has now been removed
* cgroup_allowed_devices_file.conf was removed. It was never used by
default, as ConstrainDevices was not set. If needed, refer to the
cgroups.conf man page on how to create one.
* slurm.epilog.clean: Removed. User should use pam_slurm_adopt instead.
- Refreshed:
* removed-deprecated-xdaemon.patch
* slurmctld-uses-xdaemon_-for-systemd.patch
* slurmd-uses-xdaemon_-for-systemd.patch
* slurmdbd-uses-xdaemon_-for-systemd.patch
* slurmsmwd-uses-xdaemon_-for-systemd.patch
* slurmctld-rerun-agent_init-when-backup-controller-takes-over.patch - Move config man-pages to config package. - added correct link flags for perl bindings (bsc#1108671)
* added correct linker search path in slurm-2.4.4-rpath.patch
* perl:Switch is required by slurm torque wrappers - Fix Requires(pre) and Requires(post) for slurm-config and slurm-node.
This fixes issues with failing slurm user creation when installed
during initial system installation (bsc#1109373). - Update to 17.11.9
* Fix segfault in slurmctld when a job's node bitmap is NULL during a
scheduling cycle. Primarily caused by EnforcePartLimits=ALL.
* Remove erroneous unlock in acct_gather_energy/ipmi.
* Enable support for hwloc version 2.0.1.
* Fix 'srun -q' (--qos) option handling.
* Fix socket communication issue that can lead to lost task completition
messages, which will cause a permanently stuck srun process.
* Handle creation of TMPDIR if environment variable is set or changed in
a task prolog script.
* Avoid node layout fragmentation if running with a fixed CPU count but
without Sockets and CoresPerSocket defined.
* burst_buffer/cray - Fix datawarp swap default pool overriding jobdw.
* Fix incorrect job priority assignment for multi-partition job with
different PriorityTier settings on the partitions.
* Fix sinfo to print correct node state. - When using a remote shared StateSaveLocation, slurmctld needs to
be started after remote filesystems have become available.
Add 'remote-fs.target' to the 'After=' directive in slurmctld.service
(boo#1103561). - Update to 17.11.8
* Fix incomplete RESPONSE_[RESOURCE|JOB_PACK]_ALLOCATION building path.
* Do not allocate nodes that were marked down due to the node not responding
by ResumeTimeout.
* task/cray plugin - search for "mems" cgroup information in the file
"cpuset.mems" then fall back to the file "mems".
* Fix ipmi profile debug uninitialized variable.
* PMIx: fixed the direct connect inline msg sending.
* MYSQL: Fix issue not handling all fields when loading an archive dump.
* Allow a job_submit plugin to change the admin_comment field during
job_submit_plugin_modify().
* job_submit/lua - fix access into reservation table.
* MySQL - Prevent deadlock caused by archive logic locking reads.
* Don't enforce MaxQueryTimeRange when requesting specific jobs.
* Modify --test-only logic to properly support jobs submitted to more than
one partition.
* Prevent slurmctld from abort when attempting to set non-existing
qos as def_qos_id.
* Add new job dependency type of "afterburstbuffer". The pending job will be
delayed until the first job completes execution and it's burst buffer
stage-out is completed.
* Reorder proctrack/task plugin load in the slurmstepd to match that of
slurmd
and avoid race condition calling task before proctrack can introduce.
* Prevent reboot of a busy KNL node when requesting inactive features.
* Revert to previous behavior when requesting memory per cpu/node introduced
in 17.11.7.
* Fix to reinitialize previously adjusted job members to their original
value
when validating the job memory in multi-partition requests.
* Fix _step_signal() from always returning SLURM_SUCCESS.
* Combine active and available node feature change logs on one line rather
than one line per node for performance reasons.
* Prevent occasionally leaking freezer cgroups.
* Fix potential segfault when closing the mpi/pmi2 plugin.
* Fix issues with --exclusive=[user|mcs] to work correctly
with preemption or when job requests a specific list of hosts.
* Make code compile with hdf5 1.10.2+
* mpi/pmix: Fixed the collectives canceling.
* SlurmDBD: improve error message handling on archive load failure.
* Fix incorrect locking when deleting reservations.
* Fix incorrect locking when setting up the power save module.
* Fix setting format output length for squeue when showing array jobs.
* Add xstrstr function.
* Fix printing out of --hint options in sbatch, salloc --help.
* Prevent possible divide by zero in _validate_time_limit().
* Add Delegate=yes to the slurmd.service file to prevent systemd from
interfering with the jobs' cgroup hierarchies.
* Change the backlog argument to the listen() syscall within srun to 4096
to match elsewhere in the code, and avoid communication problems at scale. - slurmctld-rerun-agent_init-when-backup-controller-takes-over.patch:
Fix race in the slurmctld backup controller which prevents it
to clean up allocations on nodes properly after failing over
(bsc#1084917).
- Handled %license in a backward compatible manner. - Add a 'Recommends: slurm-munge' to slurm-slurmdbd. - Shield comments between script snippets with a %{!?nil:...} to
avoid them being interpreted as scripts - in which case the update
level is passed as argument (see chapter 'Shared libraries' in:
https://en.opensuse.org/openSUSE:Packaging_scriptlet_snippets)
(bsc#1100850). - Update from 17.11.5 to 17.11.7
- Fix security issue in handling of username and gid fields
CVE-2018-10995 and bsc#1095508 what implied an
update from 17.11.5 to 17.11.7
Highlights of 17.11.6:
* CRAY - Add slurmsmwd to the contribs/cray dir
* PMIX - Added the direct connect authentication.
* Prevent the backup slurmctld from losing the active/available node
features list on takeover.
* Be able to force power_down of cloud node even if in power_save state.
* Allow cloud nodes to be recognized in Slurm when booted out of band.
* Numerous fixes - check 'NEWS' file.
Highlights of 17.11.7:
* Notify srun and ctld when unkillable stepd exits.
* Numerous fixes - check 'NEWS' file.
- Add: slurmsmwd-uses-xdaemon_-for-systemd.patch
* Fixes daemoniziation in newly introduced slurmsmwd daemon.
- Rename:
split-xdaemon-in-xdaemon_init-and-xdaemon_finish-for-systemd-compatibilty.patch
to split-xdaemon-in-xdaemon_init-and-xdaemon_finish-for.patch
* remain in sync with commit messages which introduced that file - Avoid running pretrans scripts when running in an instsys:
there may be not much installed, yet. pretrans code should
be done in lua, this way, it will be executed by the rpm-internal
lua interpreter and not be passed to a shell which may not be
around at the time this scriptlet is run (bsc#1090292). - Add requires for slurm-sql to the slurmdbd package. - Package READMEs for pam and pam_slurm_adopt.
- Use the new %%license directive for COPYING file. - Add:
* split-xdaemon-in-xdaemon_init-and-xdaemon_finish-for-systemd-compatibilty.patch
* slurmctld-uses-xdaemon_-for-systemd.patch
* slurmd-uses-xdaemon_-for-systemd.patch
* slurmdbd-uses-xdaemon_-for-systemd.patch
* removed-deprecated-xdaemon.patch
Fix interaction with systemd: systemd expects that a
daemonizing process doesn't go away until the PID file
with it PID of the daemon has bee written (bsc#1084125). - Make sure systemd services get restarted only when all
packages are in a consistent state, not in the middle
of an 'update' transaction (bsc#1088693).
Since the %postun scripts that run on update are from
the old package they cannot be changed - thus we work
around the restart breakage. - fixed wrong log file location in slurmdbd.conf and
fixed pid location for slurmdbd and made slurm-slurmdbd
depend on slurm config which provides the dir /var/run/slurm
(bsc#1086859). - added comment for (bsc#1085606) - Fix security issue in accounting_storage/mysql plugin by always escaping
strings within the slurmdbd. CVE-2018-7033
http://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2018-7033
(bsc#1085240).
- Update slurm to v17.11.5 (FATE#325451)
Highlights of 17.11:
* Support for federated clusters to manage a single work-flow
across a set of clusters.
* Support for heterogeneous job allocations (various processor types,
memory sizes, etc. by job component). Support for heterogeneous job
steps within a single MPI_COMM_WORLD is not yet supported for most
configurations.
* X11 support is now fully integrated with the main Slurm code. Remove
any X11 plugin configured in your plugstack.conf file to avoid errors
being logged about conflicting options.
* Added new advanced reservation flag of "flex", which permits jobs
requesting the reservation to begin prior to the reservation's
start time and use resources inside or outside of the reservation.
A typical use case is to prevent jobs not explicitly requesting the
reservation from using those reserved resources rather than forcing
jobs requesting the reservation to use those resources in the time
frame reserved.
* The sprio command has been modified to report a job's priority
information for every partition the job has been submitted to.
* Group ID lookup performed at job submit time to avoid lookup on
all compute nodes. Enable with PrologFlags=SendGIDs configuration
parameter.
* Slurm commands and daemons dynamically link to libslurmfull.so
instead of statically linking. This dramatically reduces the
footprint of Slurm.
* In switch plugin, added plugin_id symbol to plugins and wrapped
switch_jobinfo_t with dynamic_plugin_data_t in interface calls
in order to pass switch information between clusters with different
switch types.
* Changed default ProctrackType to cgroup.
* Changed default sched_min_interval from 0 to 2 microseconds.
* Added new 'scontrol write batch_script ' command to fetch a job's
batch script. Removed the ability to see the script as part of the
'scontrol -dd show job' command.
* Add new "billing" TRES which allows jobs to be limited based on the
job's billable TRES calculated by the job's partition's
TRESBillingWeights.
* Regular user use of "scontrol top" command is now disabled. Use the
configuration parameter "SchedulerParameters=enable_user_top" to
enable that functionality. The configuration parameter
"SchedulerParameters=disable_user_top" will be silently ignored.
* Change default to let pending jobs run outside of reservation after
reservation is gone to put jobs in held state. Added
NO_HOLD_JOBS_AFTER_END reservation flag to use old default.
Support for PMIx v2.0 as well as UCX support.
* Remove plugins for obsolete MPI stacks:
- lam
- mpich1_p4
- mpich1_shmem
- mvapich
* Numerous fixes - check 'NEWS' file.
- slurmd-Fix-slurmd-for-new-API-in-hwloc-2.0.patch
plugins-cgroup-Fix-slurmd-for-new-API-in-hwloc-2.0.patch:
Removed. Code upstream.
- slurmctld-service-var-run-path.patch:
Replaced by sed script.
- Fix some rpmlint warnings. - moved config files to slurm-config package (FATE#324574). - Moved slurmstepd and man page into slurm-node due to slurmd dependency
- Moved config files into slurm-node
- Moved slurmd rc scripts into slurm-node
- Made slurm-munge require slurm-plugins instead of slurm itself
- slurm-node suggested slurm-munge, causing the whole slurm to be
installed. The slurm-plugins seems to be a more base class
(FATE#324574). - split up light wight slurm-node package for deployment on nodes
(FATE#324574). - added /var/spool/ directory and removed duplicated entries from slurm.conf - Package so-versioned libs separately. libslurm is expected
to change more frequently and thus is packaged separately
from libpmi. - Updated to 17.02.9 to fix CVE-2017-15566 (bsc#1065697).
Changes in 17.0.9
* When resuming powered down nodes, mark DOWN nodes right after
ResumeTimeout
has been reached (previous logic would wait about one minute longer).
* Fix sreport not showing full column name for TRES Count.
* Fix slurmdb_reservations_get() giving wrong usage data when job's spanned
reservation that was modified.
* Fix sreport reservation utilization report showing bad data.
* Show all TRES' on a reservation in sreport reservation utilization report
by default.
* Fix sacctmgr show reservation handling "end" parameter.
* Work around issue with sysmacros.h and gcc7 / glibc 2.25.
* Fix layouts code to only allow setting a boolean.
* Fix sbatch --wait to keep waiting even if a message timeout occurs.
* CRAY - If configured with NodeFeatures=knl_cray and there are non-KNL
nodes which include no features the slurmctld will abort without
this patch when attemping strtok_r(NULL).
* Fix regression in 17.02.7 which would run the spank_task_privileged as
part of the slurmstepd instead of it's child process.
* Fix security issue in Prolog and Epilog by always prepending SPANK_ to
all user-set environment variables. CVE-2017-15566.
Changes in 17.0.8:
* Add 'slurmdbd:' to the accounting plugin to notify message is from dbd
instead of local.
* mpi/mvapich - Buffer being only partially cleared. No failures observed.
* Fix for job --switch option on dragonfly network.
* In salloc with --uid option, drop supplementary groups before changing UID.
* jobcomp/elasticsearch - strip any trailing slashes from JobCompLoc.
* jobcomp/elasticsearch - fix memory leak when transferring generated buffer.
* Prevent slurmstepd ABRT when parsing gres.conf CPUs.
* Fix sbatch --signal to signal all MPI ranks in a step instead of just those
on node 0.
* Check multiple partition limits when scheduling a job that were previously
only checked on submit.
* Cray: Avoid running application/step Node Health Check on the external
job step.
* Optimization enhancements for partition based job preemption.
* Address some build warnings from GCC 7.1, and one possible memory leak if
/proc is inaccessible.
* If creating/altering a core based reservation with scontrol/sview on a
remote cluster correctly determine the select type.
* Fix autoconf test for libcurl when clang is used.
* Fix default location for cgroup_allowed_devices_file.conf to use correct
default path.
* Document NewName option to sacctmgr.
* Reject a second PMI2_Init call within a single step to prevent slurmstepd
from hanging.
* Handle old 32bit values stored in the database for requested memory
correctly in sacct.
* Fix memory leaks in the task/cgroup plugin when constraining devices.
* Make extremely verbose info messages debug2 messages in the task/cgroup
plugin when constraining devices.
* Fix issue that would deny the stepd access to /dev/null where GRES has a
'type' but no file defined.
* Fix issue where the slurmstepd would fatal on job launch if you have no
gres listed in your slurm.conf but some in gres.conf.
* Fix validating time spec to correctly validate various time formats.
* Make scontrol work correctly with job update timelimit [+|-]=.
* Reduce the visibily of a number of warnings in _part_access_check.
* Prevent segfault in sacctmgr if no association name is specified for
an update command.
* burst_buffer/cray plugin modified to work with changes in Cray UP05
software release.
* Fix job reasons for jobs that are violating assoc MaxTRESPerNode limits.
* Fix segfault when unpacking a 16.05 slurm_cred in a 17.02 daemon.
* Fix setting TRES limits with case insensitive TRES names.
* Add alias for xstrncmp() -- slurm_xstrncmp().
* Fix sorting of case insensitive strings when using xstrcasecmp().
* Gracefully handle race condition when reading /proc as process exits.
* Avoid error on Cray duplicate setup of core specialization.
* Skip over undefined (hidden in Slurm) nodes in pbsnodes.
* Add empty hashes in perl api's slurm_load_node() for hidden nodes.
* CRAY - Add rpath logic to work for the alpscomm libs.
* Fixes for administrator extended TimeLimit (job reason & time limit reset).
* Fix gres selection on systems running select/linear.
* sview: Added window decorator for maximize,minimize,close buttons for all
systems.
* squeue: interpret negative length format specifiers as a request to
delimit values with spaces.
* Fix the torque pbsnodes wrapper script to parse a gres field with a type
set correctly.
- Fixed ABI version of libslurm. - Trim redundant wording in descriptions. - Updated to slurm 17-02-7-1
* Added python as BuildRequires
* Removed sched-wiki package
* Removed slurmdb-direct package
* Obsoleted sched-wiki and slurmdb-direct packages
* Removing Cray-specific files
* Added /etc/slurm/layout.d files (new for this version)
* Remove /etc/slurm/cgroup files from package
* Added lib/slurm/mcs_account.so
* Removed lib/slurm/jobacct_gather_aix.so
* Removed lib/slurm/job_submit_cnode.so
- Created slurm-sql package
- Moved files from slurm-plugins to slurm-torque package
- Moved creation of /usr/lib/tmpfiles.d/slurm.conf into slurm.spec
* Removed tmpfiles.d-slurm.conf
- Changed /var/run path for slurm daemons to /var/run/slurm
* Added slurmctld-service-var-run-path.patch
(FATE#324026). - Made tmpfiles_create post-install macro SLE12 SP2 or greater
- Directly calling systemd-tmpfiles --create for before SLE12 SP2 - Allows OpenSUSE Factory build as well
- Removes unused .service files from project
- Adds /var/run/slurm to /usr/lib/tmpfiles.d for boottime creation
* Patches upstream .service files to allow for /var/run/slurm path
* Modifies slurm.conf to allow for /var/run/slurm path - Move wrapper script mpiexec provided by slrum-torque to
mpiexec.slurm to avoid conflicts. This file is normally
provided by the MPI implementation (boo#1041706). - Replace remaining ${RPM_BUILD_ROOT}s.
- Improve description.
- Fix up changelog. - Spec file: Replace "Requires : slurm-perlapi" by
"Requires: perl-slurm = %{version}" (boo#1031872). - Trim redundant parts of description. Fixup RPM groups.
- Replace unnecessary %__ macro indirections;
replace historic $RPM_* variables by macros. - slurmd-Fix-for-newer-API-versions.patch:
Stale patch removed. - Use %slurm_u and %slurm_g macros defined at the beginning of the spec
file when adding the slurm user/group for consistency.
- Define these macros to daemon,root for non-systemd.
- For anything newer than Leap 42.1 or SLE-12-SP1 build OpenHPC compatible. - Updated to 16.05.8.1
* Remove StoragePass from being printed out in the slurmdbd log at debug2
level.
* Defer PATH search for task program until launch in slurmstepd.
* Modify regression test1.89 to avoid leaving vestigial job. Also reduce
logging to reduce likelyhood of Expect buffer overflow.
* Do not PATH search for mult-prog launches if LaunchParamters=test_exec is
enabled.
* Fix for possible infinite loop in select/cons_res plugin when trying to
satisfy a job's ntasks_per_core or socket specification.
* If job is held for bad constraints make it so once updated the job doesn't
go into JobAdminHeld.
* sched/backfill - Fix logic to reserve resources for jobs that require a
node reboot (i.e. to change KNL mode) in order to start.
* When unpacking a node or front_end record from state and the protocol
version is lower than the min version, set it to the min.
* Remove redundant lookup for part_ptr when updating a reservation's nodes.
* Fix memory and file descriptor leaks in slurmd daemon's sbcast logic.
* Do not allocate specialized cores to jobs using the --exclusive option.
* Cancel interactive job if Prolog failure with "PrologFlags=contain" or
"PrologFlags=alloc" configured. Send new error prolog failure message to
the salloc or srun command as needed.
* Prevent possible out-of-bounds read in slurmstepd on an invalid #! line.
* Fix check for PluginDir within slurmctld to work with multiple directories.
* Cancel interactive jobs automatically on communication error to launching
srun/salloc process.
* Fix security issue caused by insecure file path handling triggered by the
failure of a Prolog script. To exploit this a user needs to anticipate or
cause the Prolog to fail for their job. CVE-2016-10030 (bsc#1018371).
- Replace group/user add macros with function calls.
- Fix array initialzation and ensure strings are always NULL terminated in
- pam_slurm.c (bsc#1007053).
- Disable building with netloc support: the netloc API is part of the devel
branch of hwloc. Since this devel branch was included accidentally and has
been reversed since, we need to disable this for the time being.
- Conditionalized architecture specific pieces to support non-x86 architectures
better. - Remove: unneeded 'BuildRequires: python'
- Add:
BuildRequires: freeipmi-devel
BuildRequires: libibmad-devel
BuildRequires: libibumad-devel
so they are picked up by the slurm build.
- Enable modifications from openHPC Project.
- Enable lua API package build.
- Add a recommends for slurm-munge to the slurm package:
This is way, the munge auth method is available and slurm
works out of the box.
- Create /var/lib/slurm as StateSaveLocation directory.
/tmp is dangerous. - Create slurm user/group in preinstall script. - Keep %{_libdir}/libpmi* and %{_libdir}/mpi_pmi2* on SUSE. - Fix build with and without OHCP_BUILD define.
- Fix build for systemd and non-systemd. - Updated to 16-05-5 - equvalent to OpenHPC 1.2.
* Fix issue with resizing jobs and limits not be kept track of correctly.
* BGQ - Remove redeclaration of job_read_lock.
* BGQ - Tighter locks around structures when nodes/cables change state.
* Make it possible to change CPUsPerTask with scontrol.
* Make it so scontrol update part qos= will take away a partition QOS from
a partition.
* Backfill scheduling properly synchronized with Cray Node Health Check.
Prior logic could result in highest priority job getting improperly
postponed.
* Make it so daemons also support TopologyParam=NoInAddrAny.
* If scancel is operating on large number of jobs and RPC responses from
slurmctld daemon are slow then introduce a delay in sending the cancel job
requests from scancel in order to reduce load on slurmctld.
* Remove redundant logic when updating a job's task count.
* MySQL - Fix querying jobs with reservations when the id's have rolled.
* Perl - Fix use of uninitialized variable in slurm_job_step_get_pids.
* Launch batch job requsting --reboot after the boot completes.
* Do not attempt to power down a node which has never responded if the
slurmctld daemon restarts without state.
* Fix for possible slurmstepd segfault on invalid user ID.
* MySQL - Fix for possible race condition when archiving multiple clusters
at the same time.
* Add logic so that slurmstepd can be launched under valgrind.
* Increase buffer size to read /proc/*/stat files.
* Remove the SchedulerParameters option of "assoc_limit_continue", making it
the default value. Add option of "assoc_limit_stop". If "assoc_limit_stop"
is set and a job cannot start due to association limits, then do not attempt
to initiate any lower priority jobs in that partition. Setting this can
decrease system throughput and utlization, but avoid potentially starving
larger jobs by preventing them from launching indefinitely.
* Update a node's socket and cores per socket counts as needed after a node
boot to reflect configuration changes which can occur on KNL processors.
Note that the node's total core count must not change, only the distribution
of cores across varying socket counts (KNL NUMA nodes treated as sockets by
Slurm).
* Rename partition configuration from "Shared" to "OverSubscribe". Rename
salloc, sbatch, srun option from "--shared" to "--oversubscribe". The old
options will continue to function. Output field names also changed in
scontrol, sinfo, squeue and sview.
* Add SLURM_UMASK environment variable to user job.
* knl_conf: Added new configuration parameter of CapmcPollFreq.
* Cleanup two minor Coverity warnings.
* Make it so the tres units in a job's formatted string are converted like
they are in a step.
* Correct partition's MaxCPUsPerNode enforcement when nodes are shared by
multiple partitions.
* node_feature/knl_cray - Prevent slurmctld GRES errors for "hbm" references.
* Display thread name instead of thread id and remove process name in stderr
logging for "thread_id" LogTimeFormat.
* Log IP address of bad incomming message to slurmctld.
* If a user requests tasks, nodes and ntasks-per-node and
tasks-per-node/nodes != tasks print warning and ignore ntasks-per-node.
* Release CPU "owner" file locks.
* Update seff to fix warnings with ncpus, and list slurm-perlapi dependency
in spec file.
* Allow QOS timelimit to override partition timelimit when EnforcePartLimits
is set to all/any.
* Make it so qsub will do a "basename" on a wrapped command for the output
and error files.
* Add logic so that slurmstepd can be launched under valgrind.
* Increase buffer size to read /proc/*/stat files.
* Prevent job stuck in configuring state if slurmctld daemon restarted while
PrologSlurmctld is running. Also re-issue burst_buffer/pre-load operation
as needed.
* Move test for job wait reason value of BurstBufferResources and
BurstBufferStageIn later in the scheduling logic.
* Document which srun options apply to only job, only step, or job and step
allocations.
* Use more compatible function to get thread name (>= 2.6.11).
* Make it so the extern step uses a reverse tree when cleaning up.
* If extern step doesn't get added into the proctrack plugin make sure the
sleep is killed.
* Add web links to Slurm Diamond Collectors (from Harvard University) and
collectd (from EDF).
* Add job_submit plugin for the "reboot" field.
* Make some more Slurm constants (INFINITE, NO_VAL64, etc.) available to
job_submit/lua plugins.
* Send in a -1 for a taskid into spank_task_post_fork for the extern_step.
* MYSQL - Sightly better logic if a job completion comes in with an end time
of 0.
* task/cgroup plugin is configured with ConstrainRAMSpace=yes, then set soft
memory limit to allocated memory limit (previously no soft limit was set).
* Streamline when schedule() is called when running with message aggregation
on batch script completes.
* Fix incorrect casting when [un]packing derived_ec on slurmdb_job_rec_t.
* Document that persistent burst buffers can not be created or destroyed using
the salloc or srun --bb options.
* Add support for setting the SLURM_JOB_ACCOUNT, SLURM_JOB_QOS and
SLURM_JOB_RESERVAION environment variables are set for the salloc command.
Document the same environment variables for the salloc, sbatch and srun
commands in their man pages.
* Fix issue where sacctmgr load cluster.cfg wouldn't load associations
that had a partition in them.
* Don't return the extern step from sstat by default.
* In sstat print 'extern' instead of 4294967295 for the extern step.
* Make advanced reservations work properly with core specialization.
* slurmstepd modified to pre-load all relevant plugins at startup to avoid
the possibility of modified plugins later resulting in inconsistent API
or data structures and a failure of slurmstepd.
* Export functions from parse_time.c in libslurm.so.
* Export unit convert functions from slurm_protocol_api.c in libslurm.so.
* Fix scancel to allow multiple steps from a job to be cancelled at once.
* Update and expand upgrade guide (in Quick Start Administrator web page).
* burst_buffer/cray: Requeue, but do not hold a job which fails the pre_run
operation.
* Insure reported expected job start time is not in the past for pending jobs.
* Add support for PMIx v2.
Required for FATE#316379. - Setting 'download_files' service to mode='localonly'
and adding source tarball. (Required for Factory). - version 15.08.7.1
* Remove the 1024-character limit on lines in batch scripts.
task/affinity: Disable core-level task binding if more CPUs required than
available cores.
* Preemption/gang scheduling: If a job is suspended at slurmctld restart or
reconfiguration time, then leave it suspended rather than resume+suspend.
* Don't use lower weight nodes for job allocation when topology/tree used.
* Don't allow user specified reservation names to disrupt the normal
reservation sequeuece numbering scheme.
* Avoid hard-link/copy of script/environment files for job arrays. Use the
master job record file for all tasks of the job array.
NOTE: Job arrays submitted to Slurm version 15.08.6 or later will fail if
the slurmctld daemon is downgraded to an earlier version of Slurm.
* In slurmctld log file, log duplicate job ID found by slurmd. Previously was
being logged as prolog/epilog failure.
* If a job is requeued while in the process of being launch, remove it's
job ID from slurmd's record of active jobs in order to avoid generating a
duplicate job ID error when launched for the second time (which would
drain the node).
* Cleanup messages when handling job script and environment variables in
older directory structure formats.
* Prevent triggering gang scheduling within a partition if configured with
PreemptType=partition_prio and PreemptMode=suspend,gang.
* Decrease parallelism in job cancel request to prevent denial of service
when cancelling huge numbers of jobs.
* If all ephemeral ports are in use, try using other port numbers.
* Prevent "scontrol update job" from updating jobs that have already finished.
* Show requested TRES in "squeue -O tres" when job is pending.
* Backfill scheduler: Test association and QOS node limits before reserving
resources for pending job.
* Many bug fixes.
- Use source services to download package.
- Fix code for new API of hwloc-2.0.
- package netloc_to_topology where avialable.
- Package documentation. - version 15.08.3
* Many new features and bug fixes. See NEWS file
- update files list accordingly
- fix wrong end of line in some files - version 14.11.8
* Many bug fixes. See NEWS file
- update files list accordingly - add missing systemd requirements
- add missing rclink - version 14.03.9
* Many bug fixes. See NEWS file
- add systemd support ibs-arm-5 1634567298
! " # $ % & ' ( ) * + , - . / 0 1 2 3 4 5 6 7 8 9 : ; < = > ? @ A B C D E F G H I J K L M N O P Q R S T U V W X Y Z [ \ ] ^ _ ` a b c d e f g h i j k l m n o p q r s t u v w x y z { | } ~ 20.11.7 20.11.7-6.7.1 20.11.7-6.7.1 slurm-20.11.7 html Slurm_Entity.pdf Slurm_Individual.pdf accounting.html accounting_storageplugins.html acct_gather_energy_plugins.html acct_gather_profile_plugins.html add.html allocation_pies.gif api.html arch.gif authplugins.html bb_plugins.html big_sys.html burst_buffer.html cgroups.html classic_fair_share.html cli_filter_plugins.html coding_style.pdf configless_slurm.html configurator.easy.html configurator.html cons_res.html cons_res_share.html containers.html contributor.html core_spec.html core_spec_plugins.html cpu_management.html cray.html cred_plugins.html disclaimer.html dist_plane.html documentation.html download.html elastic_computing.html elasticsearch.html entities.gif example_usage.gif ext_sensorsplugins.html fair_tree.html faq.html federation.html fonts.css fonts.ttf gang_scheduling.html gres.html gres_design.html gres_plugins.html hdf5_job_outline.png hdf5_profile_user_guide.html hdf5_task_attr.png heterogeneous_jobs.html high_throughput.html ibm_pe_fig1.png ibm_pe_fig2.png intel_knl.html job_array.html job_container_plugins.html job_exit_code.html job_launch.html job_submit_plugins.html jobacct_gatherplugins.html jobcompplugins.html jquery.min.js jwt.html k_function.gif launch_plugins.html licenses.html mail.html man_index.html mc_support.gif mc_support.html mcs.html mcs_plugins.html meetings.html mpi_guide.html mpiplugins.html multi_cluster.html network.html network_failover.gif network_federation.gif network_multi_cluster.gif network_srun.gif network_standard.gif news.html node_features_plugins.html nss_slurm.html openapi.css overview.html pam_slurm_adopt.html plane_ex1.gif plane_ex2.gif plane_ex3.gif plane_ex4.gif plane_ex5.gif plane_ex6.gif plane_ex7.gif platforms.html plugins.html power_mgmt.html power_plugins.html power_save.html preempt.html preemption_plugins.html prep_plugins.html priority_multifactor.html priority_multifactor3.html priority_plugins.html proctrack_plugins.html programmer_guide.html prolog_epilog.html publications.html qos.html quickstart.html quickstart_admin.html reservations.html reset.css resource_binding.html resource_limits.html rest.html rest_api.html rosetta.html route_plugin.html sched_config.html schedmd.png schedplugins.html select_design.html selectplugins.html site_factor.html slurm.css slurm.html slurm_logo.png slurm_ug_agenda.html slurmctld_plugstack.html squeue_color.png style.css switchplugins.html taskplugins.html team.html testimonials.html topo_ex1.gif topo_ex2.gif topology.html topology_plugin.html tres.html troubleshoot.html tutorial_intro_files.tar tutorials.html usage_pies.gif user_permissions.html wckey.html /usr/share/doc/ /usr/share/doc/slurm-20.11.7/ /usr/share/doc/slurm-20.11.7/html/ -fmessage-length=0 -grecord-gcc-switches -O2 -Wall -D_FORTIFY_SOURCE=2 -fstack-protector-strong -funwind-tables -fasynchronous-unwind-tables -fstack-clash-protection -g obs://build.suse.de/SUSE:Maintenance:21534/SUSE_SLE-15-SP2_Update/a7a7386c0f44d8131987dbe3028edcb8-slurm_20_11.SUSE_SLE-15-SP2_Update cpio xz 5 aarch64-suse-linux
! " directory HTML document, ASCII text GIF image data, version 89a, 652 x 740 GIF image data, version 89a, 811 x 681 HTML document, ASCII text, with very long lines GIF image data, version 89a, 753 x 443 GIF image data, version 89a, 669 x 944 HTML document, UTF-8 Unicode text ASCII text TrueType Font data, 17 tables, 1st "GDEF", 7 names, Microsoft, language 0x409, type 1 string, Source Code ProRegular1.017;ADBE;SourceCodePro-Regular;ADOBEVersion 1.017;PS Version 1.000;hotc PNG image data, 274 x 761, 8-bit/color RGBA, non-interlaced PNG image data, 358 x 368, 8-bit/color RGBA, non-interlaced PNG image data, 960 x 720, 8-bit/color RGBA, non-interlaced ASCII text, with very long lines Python script, ASCII text executable GIF image data, version 89a, 575 x 340 GIF image data, version 89a, 380 x 310 GIF image data, version 89a, 923 x 698 GIF image data, version 89a, 740 x 718 GIF image data, version 89a, 785 x 715 GIF image data, version 89a, 956 x 732 GIF image data, version 89a, 911 x 489 GIF image data, version 89a, 211 x 282 GIF image data, version 89a, 595 x 178 GIF image data, version 89a, 523 x 194 GIF image data, version 89a, 390 x 241 GIF image data, version 89a, 600 x 497 GIF image data, version 89a, 723 x 442 PNG image data, 300 x 69, 8-bit/color RGBA, non-interlaced PNG image data, 436 x 400, 8-bit/color RGBA, non-interlaced PNG image data, 856 x 167, 8-bit/color RGBA, non-interlaced GIF image data, version 89a, 720 x 540 POSIX tar archive (GNU) GIF image data, version 89a, 650 x 738 )y[HHpzpg utf-8 2d26085e6893c8b65a6c1ece678cc1fd0f36be841d5366f9c4b414d587c25d2c ? 7zXZ
! t/⪱]
crt:bLL @cԫՊ] &CGqy.4;z#d*0ߧ+Bs=%(7Ϡ"gOf Dܓ7#߉} @㹲vE"/-t쐋ʙ6̴U?nD˂0ȂbvG߃ 6
~ Y
J /}EF TTJfۄFdLK| <۔k::۽c6t%cM:e.]c2A`䯧˒T!2pAF,37+Ԥmo%܋9CG>|@lrXhI_zK:E'A,*7D^k#Vosf;]̏h sWAr]+nNMN_(*5MƄbT\>}qo _J y|ILOg|ˏx)J21"!~)W/cߏn8dȣ_{Nk
GDM/֤&-wu[ŋ0z 0YCh=8)x(:F3қBlڗ)fr0YVyT@,Yr!J`ނ}˸g'
:D\XD6ynrUnVf],cf=p%tyYAQAۆ@}HaL!|ݨ,F.OnJ ;Np!S. 22i4g `3`1ګ='ۮ.`{\
vL@!r Z tS}H e U.A-d
|jTZ Zj`3̸PU+jcTf$$% ܷ x*/3C3@E 6Op)?UsƃqW{x5S& ;ctm&T^|^9`vRAG`h_KXT^8Mpkl"N(6-^rt3b 32la4=ݻe: ||.u@4ZMBC0| bw9d͝JxWIRN+|2%r3=BWECe;
_~
8<^]G
;gM[eH<\ByxG' zt A=nWd7z
QUA vsԆ'䰨ΪL0}'弽7ݩ:qK Nс>Giqb#& 66g%@`l<#-/#\p H۹-LS+ =+gO 5Hf(I d'ѯ6hkFeZzis $W t쥏JO/%&sy .B5%G7nZf93FQ@d=/|iuߨI᠗gN=S4u
4G,|8L; rSY ĽM'|!-71~,p;E+^eP/
jV+JD繎C2y5k- a#w$io>.WR.F+\i)@ &X]2]fy#FG C+VQREs\4
͏tނG'+gĠ҈JT Q\i=XCpRFO@K&` Z5VْE9U& ӪC5,l5,IJC4sL2? X61zYUv"xvr۶P.gwٰxXAco O[itT'ȒQ
ʁjtTP+{o` BnUf -Q 5HA r^ȻkG gGBk -c\Y`8S14|Qir}'=ΓUim74X/շm4 QӰ.aڣeh5cCY?pG_x ǼJ
lzIz e*M,_r \m9r0p` dǢ Y 1 co-B
]wJ/ӣy>]ʑbKڌ{3+i 堲@%oMbP6YcLCFȀv(ݤ3W AY_2sJS ɡj0^=VlT#%m=E,lwQi5a]ɥPD}liM;qjx lY2=YVO" ?z {QPCǨ1G"9/a"ݮޘgLih))Ai =\_=_hn\3qN8&89n=_fn:9+$G Pbv{Q$]9F[I;FTHEπBk' hf^ " rb ' Ih?):_ thzQfMp-N$= \kC֢YԡKA&a 9/X觵~`~8juZԌs*2{56xO{2;mU "Iܲ 76&fP10 pe+19ieV9ЋJ5%H8ߣ1hiWm6ꪝ^75g!33|
yb=! m6nPkdw,S&z5jdCe:7|5XTMf~aɴ
\Thծ-1f[f1ۓ-^Ñ:m'$Ip ս<ۡm/O&
Ip"ʩ0 4a lo"m}-ث+9W d]Cu{'Z4Her3$l wc̺t$9!jIt)&Sv%*bH2-;߲iBiwOOP6
9Ù WP+^q :.ħpO36sT
*J9qEN(u:" av>VotlE\WMý7H=IH[S~mnnE NeR_^5-7RJAk0 F|md_Ҩp=ޙQNZ kj [m$ufO :%gyСi:"OV4
Ed
6K>ӱ4gr=Q|Ӹз=LѸ0Ǡb nn@-m~ Wl'1K /b`K3eLCo*˲ü W&Ry:|88k _tÇ5C'@!1)֏ |t2XFr¼'Ѐ]TN0 '#>kxkR(套] ك_~L>IMAKR15.sK1rz!8chȸ%f*.cR X`(5x#
/S$XTN.} vDRNF ƃ d+J
Er63I͠|T#oqJvjeu&Y3A.v٣B4>9*'tu.oR۹d_G%滞Nxy|<9Go&/o: e#&nR%$H#.w/ ݱQlЮ+:Dѯq>3O9³.MR2eĹæ$ \8jn/RBJ><.(
>C'+Jӭn\ٔ)qU\LS#$V hՙzRxl5fQ*V S2 ̎iw@ A.ٷBme[,d;BSY3[NwҲɮ8z6laT{vPҿPSPJv 16}&
PR%N;¹,?"D CƸ,.|:o' t1*2MEp~OE(E nHE<:Zj^1- z%ːqH*;ְG}6izDM_43(j`#P
Dt(v^ˢPN WgMvū%z\4` -KZ
JV[.A#(3M D6^̍@z
{Q?,= Z e S M:xq~dIA*&W4a"΄#Bb9Ֆ:T`
Hy1xDzFڳrɴyunoQjR1{Kk&C:Rx NF D1%s IENoE4zOb>h6a PEb|HptdJXO<%A+O *a@Ux`sIMIu
nM縈:-dW{Nm.
ٍN2^ha>Iv͛E6A ,wY%O 6h`AoJk}ө _rh;@Ueo*MjC7E Iz +ź t!`L)JW̪Hk2wyZq W5t6)8t,NUK-9YW_n G-dM@a@
vv
;U0BP
_}Is)>w =:ý> :'ULX|dd*NXFt
KӑRytQH#_!q@,(ܘLlzރk/4cgT[V"UAEX3tSI YLWގ Aa9h9?P7Sym jN- \\5.ţɄAjU^uZBg z RKa!&Z1dS 4qK̦B(\-L|Y9.mԍSx<ԭҠd!(킭= Ht=K5}.
h"Z1K#I)T+wuwӵ稄 RW:^'xq g 'SoÁ$h1O]LS<"+|Зa7{; JyH}SZ*/u)3gϰ H[&wyN=i$oxO5ఛ!OL_ /нoMdlh2Y[ۗDavRnݙ_"o4d+&lrP?t,ߺC>C˲t}ڕ1\2Q\ž a ՓNq̟͒R|~YE1zg*e X4zʽF`zޚ0KקvQ V82v5T n}(9o f b( ՜yx K&
\(EPehpj3 ?Q@W/:[^71㾵Oan1S 4,?N6k}l%(LNB$X_<'rdP;8kҊ%ok'\=2&^mTiQ,JI\ 'n%ڬ`9$x˧ Kw@e1Sg<N܂QRipr S-k+u
2"8:"'BmV*˨˩AX 8@@ĄQuh |ti3.=V"-Ԋ O̓PpRY y)t) e}G6ke$s%G88zIY+&~륪)+T^I}9E LbC
3Гei '"#-7BP^ z!REG3%52Eki)+ 8vʠڢtټί
^Z?1:{q ,kk'-$_7YZ L (,i(Cr8K«sɖ&{9u .2¿ qsqrSQ=~ɫhMֵng4V+>o9\~U=Xv
lކm Csic tu =<:AA*B1YNwI R ayTBj8LClX*@!O(:y֣Eq{. bˏu C@ }GFCě - { #PM2?+7!7nS
ׇI7WAL5QК
K q p 7 <^>;-Ρ[%z(B?IWTyFvTOV${ct8\TŠJ1s8yW .Զ(rhM 5n5賙 s y@yvDw*): [
^I3 <}y39?LN~vq/m[܊Rw
#mXa[KSQ7 `0NUçnϝ2ps
i;)ZAxH b<>krf fx$[at9~7-~|qCV62o=`r~ PMtRp>%7k8a4 b ? R7pEUIPC?Mߝ 8Cg hi
a} a`wFbxh ] d%6Ɂ07IVC`B"߇-y.Mj|:aų|52FG9Juxxh 2Jdd| nzBwJFahfU`vӂ /ʇ\%9+-8Ll̵*17GGV&hQAXe&8!2",}fr)
ԄTZВ|x _7usFd{|Y c鮽I
#+ s:j\8iZK2 'GJ!5.N&J4*RO' 3 l;{9/&5~U)zBkOsO?G&p#7Ho^ Dt9uf&?E]_? >u_iu;'se@qvG]¶dю+t +/F(7 F&4VY]\ywRl)Sʼ.6=֊-!Fs"=U):ZnI#
n jJ3 =J=nrTS=J)R{K'[/O7'`x$1.aE%F`X1S& )rGRxt9sɚ4gBUَ͜4T2b$6 f͌莃 EBnwT'G>{5w~
Y&s29Gp\q:X>2 Koyujm<5* 6
|8 3~,[]Q^.w 1oٔ6ε`
QEf
r|Bsys )붛,
eO= MMracEzAh35 5ιoyDcYM֯WS= JBWֺdHGRduMP 8kK5ſz-ACW8s .ƗIfP2<O)3r9]nY kf ֧5F6-5OSU}C+/y7-@}AGo>L'
F ֤
hٿ\0$>?f:k$oqIq e I4#؝,(]ibO&fdq?WÎcҊY5ȭϩ )EԲj2B]˷5DD ]b :+ށ`:ِ792 bA&S"X;T
?V(
j-F}Sc1' +Hh~Z=CҀү3m
4q-7 TB*p[B_O#C
Q5y 8K^On%Ɛa
`տ ي=,
3RT+ S_o[`kdI䲱 =LhMsqy
Ȱ͌1\"\<.W9YN%04(hkח> #ƫeU|}$I>6 >lFʩdR؆H,m'>p[ۖp~TGHIF `[,]]<Ӡ~#mqg j,Ŝ3N1]0竝
HU"rP~8).zc % 1d() ajUz
zJ0`
;BY&`33+nov"ĞeAi E8q54 '&`JF/}nHP3LEf4vn_NLzβ|Se{Ol ݭt=%pÌb@D9mQ! K]^Xjg&HZXMo
x8,,af'?a3C
H?וL3%n3ZTduf7P !"ةÐ{MJ$Z/o.@~!+gzYk6YhS(R( Vؙ>w=XSވj"d[CQb(so/S~n^
E%6ּ
{^T.&G'D HX b+8{ ^o*8iל,gbmGnfW a:dz i 鲔c~"m_jPzK[1$/$Ң -$
Yk
]|:`sM\EZg+cI?v\I偙۾$.Y(z@.1y9E=1J2ô
D1 ߺz rWA҃tRVM'N2ă61r'`gVSs DR%U%!âW"R3HI!S YL+ŰgYcɦ!@(,}*Yv
g /; ht1B?
:س 0 ˧$NȍrS"ŪX.(0G&o!}.$|wlu~:dwɝ=8U>Oy(;0Aq{+.0RJ=xMp
,z dt/&-K9;['Iz{t[2cΟUFgo0ѵEiD/!47\?GB պ̜5(D9k>,n7_y/Ox.&
9]nOy5#*ϑlsv/cL$; HQۗ7L'=I "Q+C O?Ɍ=+{W^]I J4ƻ=3βdqʓ&a ߔU} WGx){Ńd1pT|"vm(49]kF͂NSnUdV8y,K@
jT9 @Y串>-ڛif]`5-2AA^@E3y\Jn*>>ꁭ% Fϲ}X3bsţQ?bT͍Ńjl%HE&|EJ4$HT4#UO.O1Ie` B;!6_c8yxx{-JM%\zG\@,z y(7{zljL~b%[
0BVxy5$<
hY*
&.:zѲ+bw7ZgO$oY /hJ Nboꍷנl~x w_ˆ?&TnM# Se̔nuhxڜrjDS=nݔF/Dp@3~y= Ǜ
K#eqMfԏ?vaO'ditcD]4%{͂g ۹ \2r1~ʹ;<3|CF*&L>'A̮$&NP%\JJT( KwveQʱ
j*"?Smո66}OG\zkm=z(5khB m2M
f;OUGFV$p
۵bɞG h7l:+'Sy 6v_|ۧ:nC @H= <ςE̛6 984G7APSD +N3B?ȒpXl?*\{y=h*]'OSgfg[F]"͘:a0
]n90 )0` 6 !K Gd̽'"GNEYtV78aW wy>-ݒ l >7j䖖
ߞam,n\@]4o)g'axnݐ z2#=oomz_A K$d (XWOtq 6hΏjSOi V( ؋X9I sCglF5
VfjCUUN;xk NUMW
&2%^I*ơ`qL"ZwrǖϹO]o?yGԷmB&Tg=(_Pb8GS 3fw9vWn#Jt5yi)tߠs!Njm$[/Qz442:V:ogZ@TFLMhTko/!MU*coR/ M)vG'4v4fȦ]Vε +Py.(jGa1:b#6-@m-Ю] k~wgfվױ>TƳ[b;FmlC m0F -%7C %[ +r2y$Գ1{^n7ך$TQ _2Q:Yyz;9ThDi(hkdzu.w][O_V3 hi78-y9r*&"IKdl[}x%~FHL W$~^P,S 1'{n;
(v)pWRA۞Nw"|^yߖTs 5/ $A"F%,xĞxKUKF?5"\td 3Z=Om o0)pHjYon ]5dB濳+X
]%4G<3HPPO'|( &CYx#RKE Q|@*$p' 3kU,}/ (t/e]] 6 nn"np
މ>m
AY @ZĹ67]Ul#* .2 /?"Q hMIVvnBSW% ; \Dv--=Y<" :1KB1+ BxJ$?5K*R)F焳VI 28|o?O R8"SR& V
#-DK tl>O{h helqz,E֝!V*ߙ`N,Zboǧ'e #>|W
AkuR+XS9v, Ȱ<
`o.5c30tpp[9Alxp?2y ;YOI9t5 b\έ
c㋆{Dcf*x;
vIu {\q|X`<!`6I055r{xyo[v V'4u-G
^Er01ý`f0Wo{FG:=?1]vr\yXyJv.z
~7K 'e8#]1(oJMb
BAżɅ=!n\qϔ?W,O8
J䱈r=WE#>XWҕl!by(<.kn|*Q-eTk 3H&X> 1[ O )o^
Kjr#>njy.syguփC-WQPÉvQF䦁 D險d. $葾w?tKpJt}/dke`{~,>#B4C 2!4
f]=c
N+ԑ<ϹsǏ>aw%b(+ұJ5 DaBf˳e!:
+*x%*2 *mT5㚫 ;Qv#E}X]ʶͷ y`gJϏ) tOq;,ԍ6E9KÒ&\zmhJ#R.TabN)gG_FDϥĪWqZweUT s# ط
ogFr( f[ e78P[ĶD 0VEQdd+2r'v$W
>s'hyW͋v\Bx3
d
f`EWu-e"ľVD:MlS >*¤8Mfl s=K3.\58el^Y C
?֨)GZQq5?V_\+SLpeGN&}6#VVdcYR"mT6UbCQ>3Tv C8 8ɘU/3&Kd
]'!fÄp DZLwˤ+Xg d3@!
+!`;Ga5ki&)}
ޢ
H {[a8IP`i`ַ}DI nɇ#KO,өMqq BPehtw #]y ٕ4( @sԙm~cӫ&B-}1% 4Ut+G Ӳy#R2شm$RE³mby7(A[:梪j1x4 B9֍:Q]ɵ٩wuvP F7
;Qmo$=IT\fc]v6RU?F o;X曏 C3\{.}/g1c2"`,X̲
#
pSsNGscۋ f pJ$SZ A'p[_$~ē$ l!P8xY?[߷-: ?Lh8OR$ `6"'ՃP3:Y0nVӺOux.^J,Jа lMVq!9*8V
Us3:Enl]! ⎪3
{^q
SI}捻blONTM $h-4{nL;#riå_Odg16??eN?
< 9Q+=F^iU-Kw9C*e6h2T{4:!YeujXy$(rYxt] #Fd1 T cl f0al4S?Ÿ8X
KJ 9uG dI;KsM.PO82qBo~{ hwXL5[[YsMhD3/;E (sE yL
Lݕ4
LRAR\L2w`Ԥ&płς5in3jl1CsǺjM|z!̅ r^ Rvq+37L}qcY1;ej_Cs ,H# }?i'GG ۪,Or"1Bnń^ ˚w@1Iwa18yu#>Xیi![ h&χj >9Y)$&Y<##@8dC7LUEe<Ҩ:S
C7xN~]u(ok!t9eSjHoJ *AU~4\Vy: 1hyP4< kYQH5ӖSm|rs|@ǺYS震
?DYx3$o 3BJ/gz`M(6 qpoY p$ ?7&K~dZ2A*Q& `PTCZK:hI~v\t^kD5\P .K֘>ސ %JChwL/7{iF~3LZ@٨m*\tC lQ
v)v ĦTHpކ9m,DX l9љA*kSK bwUqp\mD'+N ^bHnSFI9/tz" 5(C3#e q9
$- d
~zI>Ӎ?Tjr a_N3a {rU5 zӭA1;S-o p4 Y_Q
ݥt]ŦL;~Tp #o5ڬ>6=`xd R|̊ɱՈPLy
sRdiOo[̒lԗ1ɞ!Ȕ%ȹΡm\5˰r [r%%ku`]: IojUڏ8cpR%&);)Pu&>[Dq07݈kUK/GpܽZǮs~"8\rkRh}I
!-V/Rk4fY^lA7͑ר*:(:?~!)V.,;fWuH˥sbv=B3j9F7>l 7p.oyV
i5Ńb@8\:$A(0ZLVFxi/ K#` z.չREXOTA
!Ayן ӟţ흌3} Qӂn?6<;@gɲ
w=
F 4 ʥlJ:cvCcVXXE VM CP
8G `okDn# vCZ6`~
ht*k,YgD.G`2⬥`llNXXo-+}N $8R,m`RdcVO)SEgJOշ g$?pHjzF'S6f5g[g8$GůTUńa>s%=}#4%_` -JPp)Hq.@ |2Q/"U)&}O}j;
ԉ 7ThڧL1GgU{ ʻ w Cޛcq:& &%xwp V#~O ~k|. 쀳gCUeuH"%0= Q {Ҷ N^rC/mjy/ԵKp_4jrnޗqg;
jȴȀ7 GupȮ vZvz=Y>a&nt:[9>'Seq*e 3r0$β֩SZ92 +g$ xƺwKlAN*wpgo/fyAo#;kTs,'b9`E d`jEK$ W* rh jQVE wu-A$.O:pm;{ѷ!$ 9U2kE֤ mȦ? gbJRhH`Ḱ^7GfۚFVk4>\㇀?; RW1by=mg.mzh8j
XE%G z&iWM&puq &VW|%g։V`8̦,Q>C& ݢ~)Ш7)S"g8 TyFf ۩uk]7Us,r9BP9 : l{`cl7
\O5-I3 ge{ +:ǺT*Li$-6ڦ/l|$"r
K T0Zp,kn-hAtqs h_ ~Alhz@F]@>1Vƹ`\3N +,Ge1ǕFj6Yᰶ`MW1~Lh!}Y:w9 vءOӖ܌mhW:OI-a8בSday] ҈V!ȃlVǽ{aڍJv M&RQ2#/"ӏ+di֝|sov~4A {6&5-j8QMbNfjiv][pyǷN[Avp@])fA0(i'uЋU4g aOK9ÁEIySVaQhǟ XiI%$NjUszbI%z*D o![ Zҹ DLlˠ$8$xF:`M
FTGê AGI4%qN,*^`}p (X
+'F ^9 sC{5C(@u&eK}Jo}ѯ%˟1t e ʽs3kT/K" 髜8EB%{ÉuM v̯+ cA
fqsT+lo[_6
xg*
qҽ/fѨ%oyaQH>:c{f@0R2 ؛G+CAkB@k_?Fβc6TS -2*Gפ>a]fϝ>_]X ['qUn.ۅ\v4wiI5W~" 8I> s? vٔ
]
y2&)ؖP8!sSpٛD
m\ BZqn ohVe)>u$$̶STYA$9edw-y J ( F7X 9i:/Ք?8&VL d9_v;df Q DI69D%ԸNW?#|-`}!%W;"J^5iGHHCMql?x1ki0Nj]@{ UcXp,, yR/Zw uɯ^d\
F 43 @;c ZK+\ftk>nh]UiBF'euaA:+2 z;fEmMDYx~i:}jρ|C29A!fa WN2/% w Vnr@&0f[D$jRQ u+E
^JǦ3 s$%D^ WtQ~:TG&v 'L\dAܢ
̛TĦ8Ў2 .Dh,q:?ʻ êBln-#䫢~ܭeن:xR"0:dBݴ`mD$Q 6}_Dl_ /kEHPܳ]1:['l6Vqc31R1S!)CK3 PﹷajgTx!SEGZ6%EϕC0ƠP~V>tﱇӛma[q웤ue9 .&LkatYA]X^E@jqZ* ]*ڴ@!^VԊx9ddJQ=_ O'sڅt? ]b8^flٖ.m{[mT &V"~ x,L|2['fʻp-F]Jtg1]攪j"dOcA Fį0Ovk0UC7G1_ =nDi!59P2!O4o_ștT@;ʢ)9dv |[lj?b.u6R._W9Ix
wƎqy 'wUyEGJKdSm#9L(x'roP쉳h. IvZҚ#,}$q#?D8* sTbpĞԝۿ MP2i sgvlB+׃C^t$UR
:Q䳡IZu9jjI _U!7ا~eHVѢ [-LVSrvb\L`enp[ z7[jK_7+TDգ7sͰt?,45j$$qt'BP$ B(ʢLC933/h$wQ
u9n(- ѐ4 0_Z:{-HA0}Z
ilZs6WTO])_3հRvS
j8Stx}D>D|9'myj Ia*6 Y<U|"O̡uNiWP =ZAm4a9M\en-VKLn@G*2UnD'5d 0-M*z^D5H: @sX+jAm" q%u4Vւ oh@_qC~oYn~4hqoErٰ7;|GǕkSfq)DP1髽=3b! un@3 /
DT1gԿ
u=G.`v]WuT; #.o)&omK ?oK-TN[^] O[ѫ2D#diJn#j ,iK. @`;"<"#hs4Ub146Q\T 26[ j "&;6?*& $XD
c*I\ut\DtI]ǜ' FDV5N0zˡT]Ɵ)W{{ ٭ <}ݩ#CAx jt1Zn,a @~x=20 fYqunҔ0vԵBZT2Hqm@I曬oQ #vb6c_CЬ? 9]"_LσvJyoqG
U(w6?2F 6=髷13u\ Ч Zh)~ͿTuů"Ϣ@-n#0RJt #؝8Nf2XQLK֠>},؟&P-{v
uB` R`FSQWyʛ- U8g6> p$1ʊdo@`s9JƧ->WmԣKo@J@GFO^ f|Ifat~zn_\&IN\~n AzZoMv5"`r
q¡T~n2.aEh\S{FRzSh{L.s3Ce_,Sop6#Cqfy9 w$ )eѲ) ˗^R `sOqW{q7,ծ[R[(mB\S6xXڹ@7(ۇNat#??
L懆ǮA+X 2\^Ԗ
$7Z*0Жa6[ v:ҟ.TyBY"?_ȳ4&TPhH7֫Pt PzH{i%꾯|w z> QۓxRmXj(h 3YNnPPV#0k48Kwhx 8Wޟf6o FPn]>gw/5_%*e6|$328ajsi@|K 0 sSH%ZK`2X)uQr 6FZ^v-`XYLb\ɛ0zv,|m[d2xE DLU+'&JD1U+O#Yo;L^r?hp@˚5 trł, !h(m\iIran@.*\Xic{3* Q*G<cbGu
Cit AIVunǞ#Q;0M7A|*^1b3>NӶJbK_O{~£I=COۇ{jI\H[: $Z3fv Nzs%lmC +)3ߎ:"
ԏ.ĸЮJXfIRDjFqD~%y C[{|n Tq[tU"A@Y ԒEb&`7:ST\2ؾ `#-XNv ˕ .EWmݪUGcs](8H J(YCvMAvץI
/; ( G>( ^RG-ӱ8YnZ==n5
!-|2EG p|>mGJd+ )IEGRċc<}%Y19 yNFogݔr1/r5 GPqM Tu8&Үh5#+1՚ZwY&p1#iGa
kܱ/zJI v]{9$,m4rS$b߮i7ů)7| cg|oS2Mqǽ
p2/FJ(U4 /#H Ma`?5'L#X exCH0?zͫn kP chh 3/nI2${ߛY8=s}[<$*&;9p*N89CM1Eׁ֯LWc(7D]0oB 2K&ЀMn~&ӱ8ɨ@ hQ.Ll9dp|[
nD0`JV#*wng( @d~4P@Ovy#7d1D#Irm6T!Hz!$3jh ̈3Jg X"F\zu A]GgAH2v;H( &&p1] %] wOyZ6PZv>ӓ5$K :OƬ5r
?qFAr(I xeݿ;!;WKf ?Swig= Z.p bt)G=;Fh5N5 RL.}t3CUCZhn27e8WL0UK-y. nIS=i5ʫ;qgl'1ݏ$p:Ft⦵̜[uPǪS;\VNRak]*}AQJlI>3C> Ш "/K -rwsyj_,r+gmm\x,ɐۭ#
JB~mhYn +@jSOz^B[j95Cu: FT[Pf ? h7\./ c̰p>e0J]ZyfM]1d$XM
ƯE7h ygb"ޗԫFe< =o -H8M Xr)gP^ [wM o ;%m > [d";3= K>B)hYLVI#*r;IOwCG\vr]sԚƓJtc\E'( ^}$btpX@veE:-DѷSԣ0UhBwVEZLb7@[Q E3u^RwZoBpP1䯂.(C@ + )T)6cea+,+e/ґMO=6ep6i! !P)Fo?7+86jT_.8BL=ɫѲiL/R5 tXT$ɮL* ~^$j'^SƘMy!ӈՏ뜄[p"8$N«+/nK ]Z
ܻO{c DҮ
mOrH'7ՠ=7t:59$.F+O@UcM5ŖmbB+ #=
~kGm)AU g T)Q=7IGh'=OsMJ
`H juڽ4ڑiRQC`*~FYy0+-p !˱2{N:XVb| 3Iv%|p)}*̠Ps H?{?&ֻUJw ]VEQ a}>J;; ֦Dw QYP* *O4vt4GN$zVVSJM\Uݧp!|c!}$,U)ӌW$9 V) _Z
McgdgGruy` ~tGZh [p(9 Mu`$'7||Co/uČQPTB S,{ه-Ed1C%34t6n$VLn7\01tq[!p/RV\/zŢOM>W0 S0Bc'Yz %Z
OP 5س2ڨȷC58,a.ۣ-
G1*9PӀ]|- k4za۴Ms*6YȩGf[
lv"`̴6SrxM/E{vFuLm"pBtSىZi3U&(wb RkhAn eMGzt?O ܉У#~Py2Hx => Ws ÷W)K$m@ }סxx|J]>E S(q*-gzhIAjsWG6!r;`X2c UCdT'Gr p7 fn X8>$'rHN-u *oIɍ&kvZ,iwo8
eQW
Kh:Sj\6qj%I oJL?'zP=vӭ)a`KU/9DHXC$O*Ichg F@8 W稖O#:N㶦 $þHr~"0}gy8^*GCqz x.lQ:1_jtAq h 0d Ш
"b!2'#] `8&ZS8OGf,?Zɻ~H ^o^ [{eʼzPL=&|0LT%H̛W$
JN @ Ifq
|v&rmrTP T1Yښ\6!nz#x #X pMՒ>qc
lݥ [-C]"2Nf%J g~ c`KZ|O] Ln/Su{DЂO)WϣmmHIsBx
H7ٍS T68gsUG1a6#b#XY|7U!4CT!+YAieb䰼(ͨ59\YĚlT&}D\qfC+X
v8F Rx~H Tf!@C:?FOD N%zs sD;AQ#lH7ER qw"ڳY@ (? &~U_ RG.b1~@sIΊBA;BK7ěe_{ L!q]QCDu f}@8]]=a0M0+̖|-^$_ԐV HZKu|nO |}2W>d-Fp3v-zK@d0ih
R!1Ɗη(w@36 pNC KS/]\|: |\K}:KW~[G&:zydh/ ̟8}80ꂵSq4m@$]P@
$)i
>kU&%:FhPɵ* zNmdɦ ǓАZ:hjQ ͖y]^8pR) -
]4ƨ-͞ "ׯ8Va38[ 2572+oM
OB:y] uz?*ږOJXh"0 Jc2 x b5^WcM]"U 6zT1F p
{F Жd1_Mn =p)v\8<_(Q 7wlI
Z~2Wsyrh _zOW{Y/o f<~9I)U`^otɂ [T9*' rmAlG%7VlڤR4IgOa8}MCDǙ"I:v]y[,g[oCkNw:UM 8iHJijaw2W2fju/`f:vt. UޢD}f&U?;)0:EAY2nhV
|X
FH|,w(|\dC Iœ^0m"Έ-?9`\w 2h/iѭl#I21*_IsOa.@i?}E5 ao-DIpQ?40T@98^5?.WH*B$R `Ct Z(0r֔/DbvWZL27 Z58tRg}:q|A,*hĭSE),6g PZh9&?1 T-HrQ WlCF( ۙD&=A4MyU`ȹ#t.T~} f`ԛnP
?< DS [v|;gߊOF{! B]rTѭڶԓmK-AYeU $]LbvL27} qn:;"+֜
$ykGFL:#jC Jʾwqw 73La;4؏;)]_HMӚ[vL%A 1 / ٴzaKc@ԛa^(g0QЪ ssLA܇5Wz{vԑ(BtJx"P͖?ec(+ms MjJL).=<q^E~4Փc-7?ON~#0]
{/.2Rc/ed r{lmJ
s'cx3 mȚ Z.!72Is3}oo rtѴwׯ2ۃW'N
F K`37e ~c \6 C0&
uJ*|LS6b`Tcyܓ`VQΥ"f
~ WoƼ5v +*ɧyx;`(JLoUDjh}
AsDP+.{ō6Yt&߬Z
s(=D,/ 1FK͂9S`ҭA9F]T}.DZ8
=_%*+ t|(2Vmf{ڬn1Qm'5N3K
gG$ H0aUr_WHPy
\V3l~oJdڜRdfuo, 9 ̱͑iQjHy.ǃfRp3/s h 'k{e+`Wg>ʲh`"]` n/^3xL["
0&yVr pX>D>U: uɿBR:mᬐҗn*7Yҕ8oZjg~ĐE2-{ _BPPI`&Ao˒ jmq[{BZVE Mt VFlff>׆ T %f|C_-гpZ$K5y輻{Z_ O"' MDK !u`S8Iǐ4(6B%$IV.WAKtwzFғƫB'.ފ)6jguM8a=
8Ƈp;bR'cr$B xf~ٗ}dHס
[jͨ5vYl B M"^OxyfM_% L
@]IPVʭHiH6*|KWq!]w
tЍf]bW* BYHdD Z.U}|@i´"o\}x; <=OO46gh_kOzRj3ϡc~X |2ݻaE_ s RL%jh
x+-CHyGc[ w?D']kK-wWJ*2j6__.i\\f+mCOcBCCM(*z Y:Vk2 c-"Fx # WRz8v㎮(̦@ZObaQк~;(ECSC%%e@
c4]lf^a@u@؏6W@FWף7-XbFg맕@50a^q@ QJ'Qq\)?+ -L=> ,/Óty ZW=x]vFX);r]{2ńBn+:Ƕٔ ˞Nyvd\䃈)gnDe{ViLba`ë<> E.cr ĺ hrՐUgwܵq*/z#|Z9 3&rkDnP 3 l&{f+ x3k p.`