LDAP & Jabber outage this morning, May 15, 2013

The department’s primary LDAP server ldap.eecs stopped responding early this morning around 12:30am. This affected a few other services which rely on ldap.eecs; we had reports of problems accessing Repo, and jabber.eecs stopped accepting connections at some point.

ldap.eecs was restarted at 7:00am and this would have restored most affected services. However, the jabber server seemed to be hung and had to be restarted; this was not noticed until around 10:30am.

Our ldap servers are aging and there is a current project underway to upgrade them to more modern hardware and software. An announcement about the scope of this project will be made in the coming weeks.

We are also planning to implement better monitoring of our jabber server so that future outages will be detected much more quickly.

Resolved as of 2013-05-15 07:00:00