We have had reports of wired network outages on the 6th floor of Soda Hall. Network staff are investigating.
[Read more…] about Wired Network Problems, Soda Hall 6th floor
Wired Networking
Wired network service
Network core maintenance
I will be replacing two 10Gbit line cards in the Soda Hall core router. I will replace one card today, and one tomorrow.
We’ve already replaced similar line cards in the EECS border and Cory Hall routers without incident. The Soda router reconfiguration is slightly more complex, but due to redundant connections and routing, no discernible connectivity disruption is expected.
The vendor confirmed that the current line cards contain faulty hardware and provided replacements. The IRIS network suffered several outages due to this bug, which typically only appears after 6-9 months of operation.
We’ve already replaced similar line cards in the EECS border and Cory Hall routers without incident. The Soda router reconfiguration is slightly more complex, but due to redundant connections and routing, no discernible connectivity disruption is expected.
The vendor confirmed that the current line cards contain faulty hardware and provided replacements. The IRIS network suffered several outages due to this bug, which typically only appears after 6-9 months of operation.
Resolved as of 2010-06-04 11:30:00
6th floor Soda switch replacment
Due to a power supply failure, I will be replacing one of the stacked switches which serves the 6th Floor of Soda Hall. The switch is currently operating only on an external redundant power supply.
The outage will definitely affect half of the connections on the 6th floor for about 20 minutes; if a full stack reboot is required (likely) the rest of the 6th floor connections, including wireless, will be briefly disrupted.
The outage will definitely affect half of the connections on the 6th floor for about 20 minutes; if a full stack reboot is required (likely) the rest of the 6th floor connections, including wireless, will be briefly disrupted.
Resolved as of 2010-04-29 07:40:00
Services Impacted by Cory Power Outage
As previously announced via email, Cory Hall is scheduled for a power outage on March 22nd:
> Cory Hall Occupants,
>
> In order to perform maintenance on the main Cory Hall power
> transformers, Campus Physical Plant has scheduled a building-wide power
> shutdown during spring break on Monday, 3-22-10. The power to the
> building will be shutdown from 8am-8pm.
>
> For safety reasons, building Access will be prohibited (cardkey system
> disabled) from 11:50pm Sunday, 3-21-10 to 8pm Monday, 3-22-10.
>
> In preparation for the shutdown, please be sure to power off and unplug
> all electrical equipment in your workspace prior to leaving for Spring
> Break. (Electrical equipment includes computers, monitors, heaters &
> fans. Unplug power strips!).
>
> Please also remember to remove food items from refrigerators prior to
> leaving for Spring Break.
>
> Finally, make sure all doors are locked and windows are closed.
This outage will affect various servers in Cory Hall, including the EECS Exchange servers FONTUS and OWA; some Instructional servers (see http://inst.eecs.berkeley.edu/notices.html#spring-break); and license service for Cadence and Synopsys licenses.
All Cory Hall networking will be down during the power outage.
Exchange service should be restored by late Monday evening, after power is restored. All remaining services should be back online by midday Tuesday.
HMMB BID center switch failure
The fiber optic connection that provides network access to the BID center in Hearst Memorial Mining lost link at 8pm.
This is affecting all traffic to the 169.229.63.0/25 subnet as well as all wireless networks near the BID center, including AirBears.
An inquiry was sent to IST at 11:30pm.
[Read more…] about HMMB BID center switch failure
Network Maintenance for Edge Router
Due to IPmc errors on 10G4x module and it requires to reboot this module on edge router in order to fix the issue.
The edge router is the device for all incoming/outgoing EECS network traffic to campus network. We will schedule network maintenance window between 8:00AM to 9:00AM on Jan 21(Thursday) and use this time for rebooting and troubleshooting the issue. If everything goes ok, you will not experience network outage.
If you have any concerns, please contact with help@eecs or networks@eecs
[Read more…] about Network Maintenance for Edge Router
Router changes
I will be disabling several 1Gbit Ethernet links between EECS and campus and Millennium and campus at 0830 on Friday. The traffic was previously migrated to 10Gbit links.
This is stage 2 of the EECS border upgrade project.
During the same maintenance window, I will be installing new line cards into the Soda Hall core router.
This is in preparation for upgrading the edge switches in Soda Hall.
No disruption is expected from either change.
(This work was completed without incident.)
This is stage 2 of the EECS border upgrade project.
During the same maintenance window, I will be installing new line cards into the Soda Hall core router.
This is in preparation for upgrading the edge switches in Soda Hall.
No disruption is expected from either change.
(This work was completed without incident.)
Resolved as of 2009-11-20 09:04:00
Emergency router reload 5pm
The main EECS border router is stuck in a state that prevents either viewing or saving its configuration.
While monitoring the route table during the transition, a command used to examine the hardware routing table status caused the router a fair bit of consternation, leaving it in a state where it is impossible to save or view the configuration.
I will be rebooting the router at 5pm. All external connectivity to EECS will be interrupted, hopefully for a very brief period.
While monitoring the route table during the transition, a command used to examine the hardware routing table status caused the router a fair bit of consternation, leaving it in a state where it is impossible to save or view the configuration.
I will be rebooting the router at 5pm. All external connectivity to EECS will be interrupted, hopefully for a very brief period.
Resolved as of 2009-11-09 17:10:00
EECS network border upgrade
On Monday morning at 7:00-7:45am, I will update the configuration on the EECS border routers to enable BGP peering with campus and bring new 10Gbps links into production.
Subsequently, I will enable direct connectivity between EECS and the Millennium research network at 10Gbps, allowing the research systems to use the 10Gbps uplinks as well.
I have spent considerable time testing the individual changes, and no discernible disruption of connectivity is planned. However given the complexity of the changes, I’m reserving a 45 minute maintenance window.
This work will affect all networks maintained by IRIS, including Soda, Cory, Sutardja Dai, BWRC, & BID, not including AirBears.
This upgrade has been funded in part by the RAD Lab and DETER projects.
Subsequently, I will enable direct connectivity between EECS and the Millennium research network at 10Gbps, allowing the research systems to use the 10Gbps uplinks as well.
I have spent considerable time testing the individual changes, and no discernible disruption of connectivity is planned. However given the complexity of the changes, I’m reserving a 45 minute maintenance window.
This work will affect all networks maintained by IRIS, including Soda, Cory, Sutardja Dai, BWRC, & BID, not including AirBears.
This upgrade has been funded in part by the RAD Lab and DETER projects.
Resolved as of 2009-11-09 17:10:00
BWRC Fiber Outage
There seems to be a problem with the Comcast fiber connection to BWRC. The circuit was scheduled to be back up by 07:00 but is not yet. IST has been notified.
[Read more…] about BWRC Fiber Outage