fs-2 file server crashed

19.09.2011 - 09:30 - 20:30

fs-2 file server's RAID array lost at least two of its disks and the last disk went down 09.30, after which fs-2 stopped working. The server is now up and running a file system check, but it is probable that at least some of the files changed on disk after 09.00 are lost. File system check is still running.

Update: The file system check will probably not be finished before 13.00. Also, the file server is now configured to respond "permission denied" to all NFS file accesses, instead of just hanging (this reduces the impact on other services: now melkki and melkinpaasi work as they should for users whose home directory is not on fs-2 file server).

Update6: the file system is back online and everything is working as it should. Tape backups are not necessary.

19.09.2011 - 20:35 Jani Jaakkola
19.09.2011 - 10:12 Jani Jaakkola