Header Search Widget

IRIS

Instructional & Research Information Systems

Router Maintenance

by

As a followup to the network disruption Friday afternoon, I’ll be retesting the primary Cory Hall 10Gb module, and will reconnect the secondary links which were disabled Friday.

I anticipate no service disruption, but because the line card is suspect, and there is potential for problems, this work is scheduled for very early in the morning.

Unfortunately some of the problems we initially diagnosed as part of the routing troubles turned out to be server misconfiguration.
[Read more…] about Router Maintenance

Network routing & DNS disruptions

by

We experienced several related network disruptions Friday afternoon. Beginning with reports at noon of DNS outages from Sutardja Dai Hall, there initially appeared to be problems with that building’s router failing to forward packets correctly. Resetting the links to the DNS service switches initially appeared to solve the issue, but additional connectivity problems between Cory and S-D were discovered later.

While following error messages generated by the primary 10Gb line card in the Cory Hall router, some wired subnets in Cory were temporarily isolated from the rest of the network and the Internet. This outage from 4:20-4:30pm occurred when the suspect line card failed to resume forwarding traffic after running diagnostics. Network staff were immediately aware of that disruption and quickly reestablished basic connectivity on a different port.

While the symptoms have been mitigated, the root cause of the outage has not been fully diagnosed and network is running without full redundancy. Network personnel are planning followup work and are actively monitoring this problem in the event that it reoccurs.
[Read more…] about Network routing & DNS disruptions

IRIS Website maintenance, 5pm tonight

by

A new version of the IRIS Roster and Network applications will be deployed tonight at 5pm. These applications will be unstable between 5:00 and 5:15pm while the code is upgraded and the server restarted.

This new version fixes the problems that were introduced on March 30 when we migrated our database to a new server. Some change we made at that time caused the version of PHP we were running to start crashing sporadically. We have spent the last two weeks updating our code to work with the latest version of PHP, and it is now stable again.

I apologize for the recent problems, and thank everyone for their patience during this troublesome upgrade.

Resolved as of 2009-04-16 17:04:00

IMAP disruption

by

The imap service was temporarily down due to a panic on the cluster node that it was running on.

The service failed over to the other cluster node and is back online.

The service outage was from approx 13:30 to 13:37.

April 2009 Server Patching

by

Microsoft will release their patches for the month on Tuesday, April 14th, 2009.

PRINT, RIS, WINTERM and WINSWW will automatically patch and reboot Wednesday, April 15th, at 3:00 am.

macserver.eecs and WINTERM will be down for software updates Wednesday, April 15th, from 6:00 a.m. – 7:00 a.m.

Resolved as of 2009-04-16 08:45:00