The involuntary rebooting of servers last night around 17:30 GMT requires a more detailed explanation. Last night, during an update that was being performed in order to improve our storage system, all the servers went into "Kernel Panic", and rebooted themselves. The update operation continued to be performed simultaneously, though of the several thousand servers it took several hours for the less fortunate ones to finish rebooting. For 99% of you, the reboot was completed around 22:00 GMT.

The situation this morning is still problematic for certain servers:
  • For those that have the status "Running", but do not respond, a simple reboot via our web interface may fix the problem
  • For those of you that have a "Read-only" disk, a "FSCK" on the disk is necessary via either SSH or console
  • For the other cases, please send a mail to our support department, and we will take care of you this morning