[AusNOG] Zettagrid Sydney Offline

[Tim Raphael]

Good Morning / Afternoon Everyone,

We had an outage this morning affecting 35% of compute customers in our
Sydney availability zone. One cluster of hosts was affected and VMs
required rebooting. No data was lost however with the number of hosts
affected we needed to use a staged reboot.
 The root cause is being investigated however it relates to storage path
affinity and storage controllers in a specific SAN not failing cleanly,
therefore VMs didn't automatically migrating to an alternate storage path.
 At this point in time, all customers VMs should be available, if not,
please contact support at zettagrid.com or call on 1300 597 656.

A Post-Incident Review will be available next week for all customers who
request it by emailing support at zettagrid.com.

As mentioned all updates are posted to our status page:
http://status.zettagrid.com/incidents/fg08ll8yylfw

Regards,


Zettagrid Operations Team




On Wed, Jun 24, 2015 at 9:11 AM, James Cunningham <jjazza26 at gmail.com>
wrote:

> Hi All,
>
> Does anyone have any information on the massive outage that Zettagrid are
> having in Sydney at the moment? No answer from their support phone number,
> and emails are going unanswered.
>
> Apparantly all of their VMs in their Sydney data centre are offline
> because of hardware failure on their SAN.
>
> http://status.zettagrid.com/
>
> We have about 20 customer servers there, and they are all offline, and our
> helpdesk can't handle all the screaming customers we have at the moment.
>
> So much for redundancy....
>
> James
>
>
> _______________________________________________
> AusNOG mailing list
> AusNOG at lists.ausnog.net
> http://lists.ausnog.net/mailman/listinfo/ausnog
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20150624/72e2bc90/attachment.html>