Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
projects:maint-2022 [2022/06/09 14:00] vipada |
projects:maint-2022 [2022/11/29 09:25] (current) vipada [Winter Break 2022 Data Center Upgrades (Dec 9th - )] |
||
---|---|---|---|
Line 1: | Line 1: | ||
====== 2022 Maintenance Schedule ====== | ====== 2022 Maintenance Schedule ====== | ||
- | ==== June 17th, 2022 - Jupterhub Reboot ==== | + | ==== Winter Break 2022 Data Center Upgrades (Dec 9th - )==== |
+ | |||
+ | === Aleph Rack Relocation (Dec 14th) === | ||
+ | |||
+ | The rack containing the Aleph cluster will be replaced with a deep GPU rack and moved to the seismic pads. | ||
+ | |||
+ | === Gitlab Upgrade (Dec 12th ) === | ||
+ | |||
+ | Gitlab servers will be down briefly in order to upgrade the latest update. This will include the main ICS gitlab server and ones set up for individual classes. | ||
+ | |||
+ | === Openlab Upgrade === | ||
+ | |||
+ | Openlab Downtime to be schedule in order to apply latest kernel and security packages. | ||
+ | |||
+ | === Kubernetes Updates === | ||
+ | |||
+ | Pending. | ||
+ | |||
+ | === Reinstall nebula-4 & nebula-6 === | ||
+ | |||
+ | Replace hard drives and reinstall hosts. | ||
+ | |||
+ | |||
+ | |||
+ | ==== September 20th ICS MySQL Server and all Dependent Services ==== | ||
+ | |||
+ | * Downtime Notice: ICS MySQL Server and all Dependent Services | ||
+ | * Date: September 20th | ||
+ | * Duration: 2100-2200 | ||
+ | |||
+ | The ICS Mysql Source MySQL server will be in read-only maintenance mode for a period of time on Tuesday evening beginning at 2100(9pm) on September 20th. in order to make a complete copy and reinitialize the MySQL replication server. During this time ICS services dependent on the main ICS MySQL respond slower than usual or may not respond at all. The replication runs regular backups of the ICS MySQL database and runs as a hot spare in case something catastrophic happens to the source MySQL server. | ||
+ | |||
+ | ==== June 27, 2022 - Soft2 Hardware Replacement ==== | ||
+ | |||
+ | * Downtime Notice: Replacing failed drive | ||
+ | * Date: June 27th | ||
+ | * Duration: 0900 -1200 | ||
+ | |||
+ | Users connected to soft2 will experience downtime and will need to reconnect to soft1. | ||
+ | |||
+ | ==== June 17th, 2022 - Jupyterhub Reboot ==== | ||
* Downtime Notice: Jupyterhu b | * Downtime Notice: Jupyterhu b | ||
Line 29: | Line 69: | ||
Users connected to soft2 will experience downtime if a reboot is required. | Users connected to soft2 will experience downtime if a reboot is required. | ||
+ | ==== June 13, 2022 - Openlab SLURM Downtime ==== | ||
+ | |||
+ | * Downtime Notice: SLURM downtime for Openlab | ||
+ | * Date: June 13th | ||
+ | * Duration: 0900-1200 | ||
+ | |||
+ | The latest version of SLURM is being setup on these nodes. During that time, SLURM will be in a state of flux and it is best if no jobs are running during that time. All running jobs will be cancelled prior to the start of the maintenance period. | ||
==== June 4, 2022 - SLURM Downtime ==== | ==== June 4, 2022 - SLURM Downtime ==== | ||
- | * Downtime Notice: SLURM downtime for Openlab, AVA nodes, and Galaxy. | + | * Downtime Notice: SLURM downtime for AVA nodes, and Galaxy. |
* Date: June 4th | * Date: June 4th | ||
* Duration: 0900-1200 | * Duration: 0900-1200 | ||
Line 38: | Line 85: | ||
The latest version of SLURM is being setup on these nodes. During that time, SLURM will be in a state of flux and it is best if no jobs are running during that time. All running jobs will be cancelled prior to the start of the maintenance period. | The latest version of SLURM is being setup on these nodes. During that time, SLURM will be in a state of flux and it is best if no jobs are running during that time. All running jobs will be cancelled prior to the start of the maintenance period. | ||
+ | NOTE: Openlab has been delayed to June 13. | ||
==== Gitlab Update ==== | ==== Gitlab Update ==== | ||