All Cory Hall networks are offline since 23:24 last night, due to an apparent electrical issue in the Cory network core.
As we have not received an immediate response from facilities services, network staff are preparing to go onsite to investigate.
Wired Networking
Wired network service
Network outage
A possible Cory switch failure occurred at about 1:25pm this afternoon, affecting at least some machines on the first floor and mezzanine of Cory Hall. Network staff are aware, and will investigate.
[Read more…] about Network outageNetwork Outage for Sutardja Dai, Blum, Calvin Halls
As of 2:21 pm, networking for Sutardja Dai, Blum, and Calvin Halls is offline. Staff are en route to campus for further investigation.
Update: network connectivity was fully restored at 6:00PM when certain hosts which were causing instability were removed from the network. We will follow up tomorrow with the sysadmins of these hosts to try and prevent future incidents.
Soda Hall Power Shutdown Tuesday 8/18 8am-8pm
On Tuesday, August 18th, Soda Hall building power will be shutdown from approximately 8am to 8pm for required facilities work. There will also be sporadic brief outages to various IRIS services between 9am and 2pm due to network maintenance.
Our primary datacenter and network core will receive backup generator support and we generally expect all services to remain online throughout the day. However, we are taking the opportunity to perform a number of network maintenance items which would have otherwise necessitated multiple outages later in the year.
As a result there will be multiple brief interruptions to various services including NetApp file servers, DHCP and DNS service, and the login.eecs and winterm terminal servers. We expect each individual interruption will last for less than five minutes, and this work will be performed between 9AM – 2PM. This post will be updated when all network maintenance is complete.
After network services are fully restored, sysadmins may need to reboot their systems, restart/remount nfs file systems, etc. to get fully back online.
[Read more…] about Soda Hall Power Shutdown Tuesday 8/18 8am-8pmJacobs Hall Network Outage 2/20/20
The Jacobs Hall network was unstable from approximately 11AM to 11:45AM due to a router malfunction. We restored service and will continue to monitor the router. Please email help@eecs.berkeley.edu if you continue to notice a problem.
Brief Network Border Interruption
Today between 1206 and 1212, EECS networks were isolated from the outside world due to an unanticipated routing protocol behavior during a reconfiguration related to our firewall replacement project. This has been corrected and there will be no further issues.
Intermittent Network Trouble at EECS Border
Staff are investigating intermittent disturbances in network traffic at or around the EECS border. We’ll provide updates here as we learn more.
Final Update 11/4 12:09:
This issue was caused by a DDoS or DDoS-style traffic which was overloading our firewall, which is near the end of its life. Using a number of active and passive mitigation techniques, we believe the impact of this traffic has been fully mitigated and there should be no further issues; the firewall has been stable since Friday morning. We are also accelerating the project already in the works to replace this firewall.
Potential Campus Power Outage
We have been alerted to possible PG&E power outages due to fire danger, and that campus power may be shutdown at some point over the next 2-3 days. If we receive notice of imminent shutdown, we will work to safely shutdown our NetApp fileserver and other critical infrastructure systems; this may occur on very short notice.
We will endeavor to update this News item as we receive any updates.
See also https://berkeley.statusdashboard.com/
We recommend you proceed with shutting down any non-essential machines in advance, e.g. shutting down workstations at the end of the work day.
[Read more…] about Potential Campus Power OutageScheduled Network Maintenance: Labor Day Weekend 8/31 – 9/2, 3-4AM
We will be performing firmware upgrades on the EECS core routers at 3AM on the mornings of Saturday 8/31, Sunday 9/1, and Monday 9/2 (Labor Day weekend). Each outage is expected to last under 20 minutes; however a full hour has been scheduled in case of unanticipated issues. Specific times and expected impact for each maintenance window is below.
These upgrades were completed successfully as of Monday 9/2 at 4AM.
[Read more…] about Scheduled Network Maintenance: Labor Day Weekend 8/31 – 9/2, 3-4AMBWRC Network Down
As of 10:38am, the network connection to BWRC (Berkeley Wireless Research Center) is down. Network staff are investigating, and we’ll post updates here as they become available.
[Read more…] about BWRC Network Down