A power outage to Soda Hall which began around 12:30pm on June 21, 2017 took out many IRIS services.
At about 3:00pm, power was restored to Soda Hall and staff are bringing up network equipment now. The power conditioner in the main Soda machine room had problems recovering, and campus electricians required additional time to get it back online. Our IRIS staff then were able to begin bringing infrastructure online, including dhcp, fileservice, DNS, etc.
By 6:50pm, most IRIS services were restored.
cronus.cs, one of our DNS and NIS servers, remains down at this time. This may cause delays or timeouts for various machines and services.
Delivery is expected Monday for our new UPS which will be installed in the 290 Soda Hall server room. Some services will be down for short periods on Tuesday while they are moved off of room power and onto temporary power. Later in the week, there will be a second outage while those machines are moved onto the new UPS. Additionally, there may be a longer outage of our storage systems while some upgrades are done.
While I realize that this post is somewhat vague, a lot depends on exactly when the UPS is delivered and how long it takes to install it. I will be posting more refined notes to narrow down the scope of what services will be out (and when) as time goes on.
While we realize that there may be some inconveniences for some, please bear with us as we strive update our services and minimize outages for the future
IMAP/mail, home/project, Windows services (AD/WINS/printing), LDAP/NIS/DNS, DHCP and most other IDSG and IMG services will be affected. We will try to keep some basic network services running (DHCP, DNS/NIS), possibly in a reduced capacity.
While EECS-Secure, EECS-Guest and EECS-Open wireless LANS will be out of service during this time, the EECS and AirBears wireless LANS will remain operational during the outage.
The reason for this extended downtime is multi fold. The first is to repair the UPS that failed a couple of weeks back. The repaired unit will be placed back on line and extensive testing must be done to ensure it’s operation before we can depend on the UPS again. The second is to move data around which will allow us to remove from service a piece of software used to manage storage. This software is no longer under development and we need to remove our dependency on it. Lastly, some routine maintenance will be done which can only be done when systems are down. These are the kind of things that can only be done between semesters and we ask for you understanding during this disruption in service.
While the stated outage is from 10:00AM to 9:00PM, it may not take that long. This is a worst case scenario. If possible, services will be brought up sooner than 9:00 PM. [Read more…] about December 28th Shutdown
This afternoon, during a network maintenance operation, there was an issue with a pair of redundant fibers that lost link and then after the fiber links were restored, a configuration issue caused some delays in DNS and NIS. Service has been restored.