This morning, around 7 AM, I received a call from the IT support team that the web server hard disk had failed and they were working to restore the server and the services.
By the time, i received the call, they had been working on it for a while. I also learned that there was an issue with the raid redundancy. Our goal was to get the server back online as soon as possible but also to ensure that the demo service desk site is fully functional. We were able to get the server back online around 7 PM EST today after restoring everything from our last full backup.
Over the next few days, i will be reviewing our disaster recovery policy to ensure that such outages don' last for few hours. The good news out of this is, we were able to test our procedures around restoring the server, web sites and the demo application. We were able to successully restore everything to the same state prior to the disk failure. My apologies to anyone trying to access our site and test the demo site.