FIBs brought down the DFI website

A power surge yesterday knocked out power to the downtown Madison area. As I sat at my desk the lights went out followed shortly by the computers, air handlers and other powered systems. Having not much else to do I walked around the floor. A group of people were gathered outside the server room peering through the window.

What could possibly be so interesting? It was raining in our server room. Literally a spring-shower had developed over the server-racks.

I grabbed Garrett and Tim and we went to offer any help we could. The immediate concern was a stream of water pouring through one rack of servers. We needed something to collect water that was no more than 6" tall. The equipment room happened to hold two punch bowls that worked perfectly.

Garbage bags were split to use as tarps to cover machines.

Trash cans littered the floor capturing water.

A valve was finally located that stopped the water. It was an input line to the humidifier. An Illinois valve had failed. Instead of closing when the power went out, it stayed wide open.

Once things calmed down reports began to pour in:

The building across the street is on fire.

There's a car fire in the state law library

Smoke is pouring out from the parking ramp at DFI.

All the symptoms were cause by the power outage.