I'm pleased to let you know that we finished our platform upgrade to Zimbra 6.0.9 at 19:40, one hour and twenty minutes ahead of schedule.
Mail queued during the Zimbra upgrade is in the process of being delivered.
On Sunday 21st November 2010 starting at 5pm GMT we will be performing an emergency upgrade of our Zimbra platform from 6.0.8 to 6.0.9. We expect the Zimbra upgrade to take approximately 3 hours, although the window is scheduled for 4 hours.
A vulnerability resulting in a buffer overflow has been discovered in the openssl package included in Zimbra 6.0.8 that has necessitated this upgrade. Please see http://openssl.org/news/secadv_20101116.txt for more information.
Maintenance Start: 17:00 (GMT) 21st November 2010
Maintenance End: 21:00 (GMT) 21st November 2010
Once we commence the Zimbra upgrade all incoming email will be queued, access to the Zimbra servers will be restricted and Zimbra customers will not be able to access their mailboxes.
Please read the following Zimbra release notes for information about Zimbra 6.0.9: http://files.zimbra.com/website/docs/Zimbra%20NE%20Release%20Notes%206.0.9.pdf
Please monitor http://twitter.com/itnet_noc or http://status.in-tuition.net for further details.
09:15 Our monitoring shows higher than normal load on one of the Zimbra mailbox servers, mbox3 - we are investigating the cause. This started at just after 9am this morning. We have received reports of slow response when using webmail.
10:45 UPDATE
We believe we have resolved the issues causing problems with mbox3 - webmail is now working (since 10:30) although response times are likely to be a little slower whilst usage settles down. We are monitoring the server closely and will post a further update once we are satisfied that the issue is fully resolved.
13:30 UPDATE
Shortly after 10:30 GMT server load on mbox3 returned to normal and has stayed there since. Changes were applied to mysql and Zimbra (memory settings, cache configuration, and connection values) at 10:30 and we believe these changes resolved the problem however we're still investigating.
Please accept our apologies for this mornings trouble.
18:40 GMT : We're currently investigating an issue with our smtp cluster used for outgoing mail. Some emails have been queued on the cluster delaying their delivery. Any queued emails will be delivered shortly and we'll be looking into the exact cause.
19:00 GMT: All queued emails have now been delivered. This issue affected some local emails - remote emails were unaffected. The exact cause is still unknown at this time.
