IRIS

Instructional & Research Information Systems

EECS

Resolved Incidents

cronus and rhea downtime – Tuesday October 22, 2019 06:45-07:15

|

cronus one of the departmental DNS, NIS and time servers will be down for a needed reboot to activate changes delivered by some RHEL patches from 6:45-7:00am.

rhea the other departmental DNS, NIS and time server will be down for a needed reboot to activate changes delivered by some RHEL patches from 7:00-7:15 am.

Though the total scheduled downtime is 6:45am to 7:15am, we expect actual downtime to be less.

[Read more…] about cronus and rhea downtime – Tuesday October 22, 2019 06:45-07:15

NetApp archive backups not working

|

When fileservice was restored after the PG&E outage last Friday, the part of the service that handles backups became non-functional. Staff are working to restore backup service as soon as possible.

Snapshots remain functional and available, providing easy access to file versions from the last 7 days. Older archive backups, from before October 9, also remain available. The broken archiving process means that backups after Oct 9 will not be available.

We make nightly copies of current fileserver data to our Disaster Recovery (DR) site at the San Diego Supercomputing Center (SDSC). This mirror of current data remains operational, and is not affected by the archive process failure.

UPDATE

[2019-10-22 09:31 | pathma ]

This has now been fixed. The archival gap apart from the PG&E shutdown is from Oct 11th evening to Oct 21st. The cause of the problem was a netapp OEM’d product, “snapprotect”, which is no longer supported since end of August, but was fully functional and was planned to be replaced by an alternative solution in the weeks after. After the power outage, the snapprotect “permanent” license failed to be accepted and a netapp website to correct this also failed to work. Netapp didn’t want to fix their website, so I accelerated the alternative solution to completion, and that is now working as of my testing this morning.

Resolved as of 2019-10-22 09:31:00

Potential Campus Power Outage

|

We have been alerted to possible PG&E power outages due to fire danger, and that campus power may be shutdown at some point over the next 2-3 days. If we receive notice of imminent shutdown, we will work to safely shutdown our NetApp fileserver and other critical infrastructure systems; this may occur on very short notice.

We will endeavor to update this News item as we receive any updates.

See also https://berkeley.statusdashboard.com/

We recommend you proceed with shutting down any non-essential machines in advance, e.g. shutting down workstations at the end of the work day.

[Read more…] about Potential Campus Power Outage

October 2019 Windows Server Patching

|

Microsoft will release their patches for the month on Tuesday, October 8th, 2019.

PRINT, WINTERM and WDS will automatically patch and reboot Wednesday, October 9th, at 3:00 am.

WINTERM may be unavailable till 10:00 am Wednesday, October 9th, depending on additional software updates.

cronus and rhea downtime – Tuesday September24, 2019 06:45-07:15

|

cronus one of the departmental DNS, NIS and time servers will be down for a needed reboot to activate changes delivered by some RHEL patches from 6:45-7:00am.

rhea the other departmental DNS, NIS and time server will be down for a needed reboot to activate changes delivered by some RHEL patches from 7:00-7:15 am.

Though the total scheduled downtime is 6:45am to 7:15am, we expect actual downtime to be less.

[Read more…] about cronus and rhea downtime – Tuesday September24, 2019 06:45-07:15