The SAN upgrade was completed by 01:30 BST - more quickly than expected and as of 02:30 all servers and services are fully online. Once again, please accept our apologies for the unscheduled maintenance window and trouble this causes.

We have resolved the problem with the SAN node, however services will continue to be unavailable for the next two to three hours as we are performing an emergency upgrade on the SAN.

Details
The logs for the failed node show no hardware issues. This is the same node which caused us to abort the previously scheduled SAN maintenance from two weeks ago.  That maintenance window was to enable us to install critical updates recommended by Lefthand.  We aborted the maintenance window due to the fact that this same node did not correctly release control of its HA IP address before the upgrade had started.  It is felt that tonight's problem may be related and after careful analysis of log files by both us and a senior Lefthand engineer, a reboot of the node was performed and has resulted in all volumes being brought back online without further issue.

Because of the problem with the HA IP address not being released, we could not risk rebooting the node without first shutting down all servers using the SAN.  As this obviously results in services being inaccessible and because this is our quietest time of the day, Lefthand strongly encouraged us to perform the upgrade tonight to rule out any further problems possibly related to older software versions. We expect to be completed at around 3am BST and will post a further update then.

Thank you for your patience. We are deeply sorry for this unexpected downtime, however we hope you can see we are taking the best and most appropriate actions given the circumstances.

23:08 BST - we are continuing to experience problems with one of our SAN nodes - engineers from Lefthand are trying to resolve the problem. Services may be inaccessible intermittently as we have to shut down volumes whilst performing emergency maintenance. We apologise for any inconvenience this is causing and assure you that we are working to resolve this problem as an urgent priority.

Our monitoring has alerted us to connectivity problems with some of our network which we are investigating as a matter of priority now. Mailbox servers are inaccessible. We will post an update shortly.

Update - most servers are back online - we are investigating issues with a SAN node which appears to have gone offline without explination.

Update #2 23:08 BST - we are continuing to experience problems with our SAN - engineers from Lefthand are trying to resolve the problem. Services may be inaccessible intermittently. We apologise for any inconvenience this is causing and assure you that we are working to resolve this problem as a priority.

We've uploaded a new version of the Zimbra Outlook Connector to the downloads section on Zimbra Admin.  This new version corrects the From address problem caused after updating Outlook to SP2.

On Sunday the 14th of June at 8AM (BST) we will be upgrading our Zimbra platform to the latest release.  This will involve a period of downtime of approximately 4 hours where Zimbra hosted customers will not be able to access their Zimbra email.

Maintenance Start: 08:00 (BST) 14th June 2009

Maintenance End: 12:00 (BST) 14th June 2009

For details of Zimbra changes, please refer to http://files.zimbra.com/website/docs/Zimbra%20NE%20Release%20Notes.pdf

During the maintenance window all incoming email will be queued, access to the Zimbra servers will be restricted and Zimbra customers will not be able to access their mailboxes.

On Thursday the 4th of June at 8PM (BST) we will be upgrading our SAN software.  This will involve us running in a degraded state at certain points during the upgrade.  No outage or downtime is expected, however there is increased risk during the maintenance window.

Maintenance Start: 20:00 (BST) 4th June 2009

Maintenance End: 22:00 (BST) 4th June 2009