Looks like network issues, we’re currently investigating …
{ Comments on this entry are closed }
Due to a combination of events, we lost our disk array in dogfrog3 at around 11:30pm.
We’re in the process of reinstalling the system, and cPanel, and will then start loading from backup.
It’s quite likely you may lose emails that had been sent but not received, as we will be restoring a 24-hour old backup, but we’ll do our best to recover everything we can.
We’ll update here as we continue to work on the problem.
Brian (0308)
–
Most accounts have been restored since 0800 this morning. Please let us know if you have any issues; there may be some residual things we need to take care of.
We have an email backup from around 8pm so will restore that in the next few hours. Mail received in the 3.5 hours between between 8pm and 11:30pm is unfortunately likely to have been lost.
–
We restored email to some accounts later this morning which may have caused some of you to get spurious “incorrect password” messages. This problem was corrected around 15:04 today – please do let us know if you have other issues.
Most people’s MySQL databases are from a 24 hour old backup. We do have access to more recent data; if that’s helpful a backup made at 8pm could be selectively restored for you. Please let us know if you need that.
The newer version of PHP (5.3) appeared to be causing trouble for some people, so we’ve reverted back to PHP 5.2.17.
A very few people use the “TTF” font library (sometimes used for CAPTCHA verification on contact pages etc). This will be added into the system over the next day.
Thanks for your patience and sincere apologies for the outage.
{ Comments on this entry are closed }