Today's heros are Keith and Darwin, our systems administrators and hardware architects. Yesterday, our main filesystem crashed hard. There were warning lights flashing behind every disk on the SAN and it looked pretty grim. Thankfully, Keith and Darwin were able to pinpoint the problem to two redundant laser modules for the fiber optic loops (it was amazing and unlucky that both failed). The laser modules have since been replaced and the filesystem is back up. We'll be starting up the project again shortly. Thanks for your patience.