This morning, June 24th around 7:15 AM, we updated the firewall configuration for our Active Directory and Windows server infrastructure. Please contact us at help@eecs.berkeley.edu if you notice any possible issues.
Active Directory
Windows Active Directory
Sporadic Windows Authentication Errors
Since Thursday, March 16, we have received some reports of Windows authentication errors, usually experienced during login to Windows after a fresh reboot or at the lock screen. A common error indicated “The trust relationship between this workstation and the primary domain failed.” Temporarily disabling the network, when possible, allowed one to login as normal (using cached credentials).
We found some Active Directory replication issues that may be at fault, and are working to rebuild one of our domain controllers. If you encountered the above error after 3pm today, March 21, please feel free to notify help@eecs with any specifics.
[Read more…] about Sporadic Windows Authentication ErrorsUpdate to Domain Controller Group Policy
We are implementing an update to Group Policy that affects our Windows Domain Controllers this morning at 10am. No impact is expected on end users, but we are mindful that a similar change last week caused an unexpected problem with LDAP-auth (see https://iris.eecs.berkeley.edu/news/resolved-incidents/eecs-ldap-logins-not-working/).
This update improves the security profile of our Domain Controllers. In particular, we are removing explicitly-listed Null Session Named Pipes, as is best practice.
Power Failure in Soda Machine room 11:40am Dec 20
Contractors attempting to repair the UPS in our primary machine room tripped a breaker which disabled most IRIS services. Service has been mostly restored as of around 2:05pm.
The lists.eecs.berkeley.edu mailing list server is still being rebooted but should be back shortly.
The lists.eecs.berkeley.edu mailing list server is still being rebooted but should be back shortly.
Resolved as of 2017-12-20 14:07:00
Campus losing power, IRIS services shutting down
Due to a fire threatening our transformers, PG&E has advised campus we will be losing power.
IRIS is taking proactive steps to shut down as much equipment safely before we totally lose power.
See https://www.nixle.us/9HHZX for the warning from UCPD.
[Read more…] about Campus losing power, IRIS services shutting down
EECS Full Network and Service Outage, Thurs. 12/22/16 7:30AM
We will have a full system shutdown on Thursday, December 22nd at 7:30 AM to perform necessary fire and emergency power testing in our server rooms. The entire EECS network and all hosted resources will be offline during this maintenance.
This will affect networking in the following locations:
Wired and wireless networks offline:
* Soda Hall
* Cory Hall
* Sutardja Dai Hall
* Jacobs Hall
* BWRC
Wireless networks offline, wired remains online:
* Blum Hall
* Calvin Lab
Hosted resources such as the EECS website, file servers, etc. will be offline and globally inaccessible.
The facilities maintenance window is scheduled from 7:30 AM to 1 PM, but we anticipate the network and critical services should be back by 11AM if all goes well.
The intent is to perform these tests annually going forward; however we will learn from this year’s procedure and aim to keep more critical services online in the future.
If you have any questions about this maintenance, please contact help@eecs.berkeley.edu.
[Read more…] about EECS Full Network and Service Outage, Thurs. 12/22/16 7:30AM
UPS Installation/Various System Outages
Delivery is expected Monday for our new UPS which will be installed in the 290 Soda Hall server room. Some services will be down for short periods on Tuesday while they are moved off of room power and onto temporary power. Later in the week, there will be a second outage while those machines are moved onto the new UPS. Additionally, there may be a longer outage of our storage systems while some upgrades are done.
While I realize that this post is somewhat vague, a lot depends on exactly when the UPS is delivered and how long it takes to install it. I will be posting more refined notes to narrow down the scope of what services will be out (and when) as time goes on.
While we realize that there may be some inconveniences for some, please bear with us as we strive update our services and minimize outages for the future
December 28th Shutdown
IMAP/mail, home/project, Windows services (AD/WINS/printing), LDAP/NIS/DNS, DHCP and most other IDSG and IMG services will be affected. We will try to keep some basic network services running (DHCP, DNS/NIS), possibly in a reduced capacity.
While EECS-Secure, EECS-Guest and EECS-Open wireless LANS will be out of service during this time, the EECS and AirBears wireless LANS will remain operational during the outage.
The reason for this extended downtime is multi fold. The first is to repair the UPS that failed a couple of weeks back. The repaired unit will be placed back on line and extensive testing must be done to ensure it’s operation before we can depend on the UPS again. The second is to move data around which will allow us to remove from service a piece of software used to manage storage. This software is no longer under development and we need to remove our dependency on it. Lastly, some routine maintenance will be done which can only be done when systems are down. These are the kind of things that can only be done between semesters and we ask for you understanding during this disruption in service.
While the stated outage is from 10:00AM to 9:00PM, it may not take that long. This is a worst case scenario. If possible, services will be brought up sooner than 9:00 PM.
[Read more…] about December 28th Shutdown
Widespread service disruption due to UPS failure
Last evening about 21:26 there was a power failure in the main EECS server room in Soda Hall. The UPS held up some systems until about 22:00 at which time staff shut the room down completely. Many EECS services were disrupted as a result. The problem was found to be in the UPS which fried the high voltage output terminal block. The terminal block was bypassed and the UPS has been removed from service until further notice. Most EECS computing services have been restored as of 03:15 this morning with the exception of the IRIS web server, which was restored around 10:15am Sunday.
Thanks to the staff who came in early Sunday morning to deal with this issue.
Thanks to the staff who came in early Sunday morning to deal with this issue.
Resolved as of 2009-11-22 03:15:00