[AusNOG] Equinix SY1 gone dark?

Fri Mar 15 07:17:58 EST 2019

I believe there was scheduled maintenance at SY1 yesterday for the STS and UPS systems and I believe that the power was disrupted during that maintenance window.

This is why it’s always good to have dual fed equipment and send notices during the scheduled maintenance windows.

We’ve never had any issues during the scheduled maintenance windows, but I guess that’s why they are classed as ‘hazardous’

As for the POI redundancy, certainly something to think about. I don’t think consumers care where their internet comes from as long as it works. Look at the melt down yesterday with Facebook being offline! People called 000! Seriously?!

Jared

[https://app.frontapp.com/api/1/noauth/companies/servers_australia_pty_ltd/seen/msg_2h3w4np/0/5b9895de.gif]
Thu, 14 Mar at 6:53 pm, <markzzzsmith at gmail.com<mailto:markzzzsmith at gmail.com>> wrote:

On Thu., 14 Mar. 2019, 18:02 Nathan Brookfield, <Nathan.Brookfield at simtronic.com.au<mailto:Nathan.Brookfield at simtronic.com.au>> wrote:

Same same, take a month or two to rebuild…. At least with nodes, half of the Infrastructure is moved out into the field.

Do NBN offer POI redundancy yet, meaning they can switch AVCs to another POI?

I've seen how angry numbers of 10s of 1000s of customers can get after an outage of a day or two. I expect within less than a week they'll have switched to another provider, which in an NBN world, because subs are connected to the same POI regardless of the RSP, means a mobile broadband provider. If it is good enough and cheap enough, they won't come back.

Kindest Regards,

Nathan Brookfield (VK2NAB)

Chief Executive Officer

Simtronic Technologies Pty Ltd

Local: (02) 4749 4949 | Fax: (02) 4749 4950 | Direct: (02) 4749 4951

Web: http://www.simtronic.com.au<http://www.simtronic.com.au/> | E-mail: nathan.brookfield at simtronic.com.au<mailto:nathan.brookfield at simtronic.com.au>

[X]

CONFIDENTIALITY & PRIVILEGE NOTICE

The information contained in this email and any attached files is strictly private and confidential. The intended recipient of this email may only use, reproduce, disclose or distribute the information contained in this email and any attached files with Simtronic Technologies Pty Ltd’s permission. If you are not the intended recipient, you are strictly prohibited from using, reproducing, adapting, disclosing or distributing the information contained in this email and any attached files or taking any action in reliance on it. If you have received this email in error, please email the sender by replying to this message, promptly delete and destroy any copies of this email and any attachments.

It is your responsibility to scan this communication and any files attached for computer viruses and other defects and recommend that you subject these to your virus checking procedures prior to use. Simtronic Technologies Pty Ltd does NOT accept liability for any loss or damage (whether direct, indirect, consequential, economic or other) however caused, whether by negligence or otherwise, which may result directly or indirectly from this communication or any files attached.

From: AusNOG <ausnog-bounces at lists.ausnog.net<mailto:ausnog-bounces at lists.ausnog.net>> On Behalf Of Mark Smith
Sent: Thursday, March 14, 2019 6:00 PM
To: Shah Hardik <shah.hardik at techflow.com.au<mailto:shah.hardik at techflow.com.au>>
Cc: <ausnog at lists.ausnog.net<mailto:ausnog at lists.ausnog.net>> <ausnog at lists.ausnog.net<mailto:ausnog at lists.ausnog.net>>
Subject: Re: [AusNOG] Equinix SY1 gone dark?

A building is a SPOF, and they fail easily enough like Warrnambool did (and other exchanges have caught on fire too in the last 15 or so years, like Glenunga and Kangaroo Island.)

What happens if an NBN POI catches on fire and burns down?

On Thu., 14 Mar. 2019, 17:45 Shah Hardik, <shah.hardik at techflow.com.au<mailto:shah.hardik at techflow.com.au>> wrote:

That’s unfortunately reasonably common in the scheme of things… either at the DC operator level or simply on the PDU level where the PDUs fail or simply the circuit trips due to unexpected surge…

Evenly distributing the load across PDUs and understanding the finer details of circuit breakers in individual PDUs are typically a start to avoid unnecessary “outages”.

However something like https://www.techflowit.com.au/products/apc-ap4421-rack-automatic-transfer-switch-230v10a-c14-in-12-c13-out-1030477 is a must in our opinion when customers are operating single PSU devices in their infra!

Best regards,

Shah Hardik

From: AusNOG <ausnog-bounces at lists.ausnog.net<mailto:ausnog-bounces at lists.ausnog.net>> On Behalf Of Chris Ford
Sent: Thursday, 14 March 2019 5:35 PM
To: ausnog at lists.ausnog.net<mailto:ausnog at lists.ausnog.net>
Subject: Re: [AusNOG] Equinix SY1 gone dark?

There’s a lesson in that

From: AusNOG <ausnog-bounces at lists.ausnog.net<mailto:ausnog-bounces at lists.ausnog.net>> On Behalf Of Damien Gardner Jnr

Failed STS according to the incident report that came out 20 mins ago.   One hopes that means that only customers without A+B to all devices dropped?

On Thu, 14 Mar 2019 at 17:11, Nathan Brookfield <Nathan.Brookfield at simtronic.com.au<mailto:Nathan.Brookfield at simtronic.com.au>> wrote:

Someone is looking over the rest of us today, sorry to hear that guys.

We’re in a private cage and have racks across the DC so maybe everything in one specific disty board but they’re separated A+B and to different UPS’s so that’s scary.

On 14 Mar 2019, at 17:01, Matthew Martin <matthew at mmit.com.au<mailto:matthew at mmit.com.au>> wrote:

We lost our cage in SY1 also FYI at the same time, power just came back

-------- Original message --------

From: Nathan Brookfield <Nathan.Brookfield at simtronic.com.au<mailto:Nathan.Brookfield at simtronic.com.au>>

Date: 14/3/19 16:32 (GMT+10:00)

To: Matthew VK3EVL <hitman at itglowz.com<mailto:hitman at itglowz.com>>

Cc: ausnog at lists.ausnog.net<mailto:ausnog at lists.ausnog.net>

Subject: Re: [AusNOG] Equinix SY1 gone dark?

Just you bud.

Nathan Brookfield
Chief Executive Officer

Simtronic Technologies Pty Ltd
http://www.simtronic.com.au<http://www.simtronic.com.au/>

On 14 Mar 2019, at 16:19, Matthew VK3EVL <hitman at itglowz.com<mailto:hitman at itglowz.com>> wrote:

Hi All,

Hearing reports (and lost our cage) in SY1.

Apparently nobody answering the phone at Equinix. Is it just me or have others seen it too?

Cheers
Matthew

_______________________________________________
AusNOG mailing list
AusNOG at lists.ausnog.net<mailto:AusNOG at lists.ausnog.net>
http://lists.ausnog.net/mailman/listinfo/ausnog
_______________________________________________
AusNOG mailing list
AusNOG at lists.ausnog.net<mailto:AusNOG at lists.ausnog.net>
http://lists.ausnog.net/mailman/listinfo/ausnog

_______________________________________________
AusNOG mailing list
AusNOG at lists.ausnog.net<mailto:AusNOG at lists.ausnog.net>
http://lists.ausnog.net/mailman/listinfo/ausnog

--

Damien Gardner Jnr
VK2TDG. Dip EE. GradIEAust
rendrag at rendrag.net<mailto:rendrag at rendrag.net> -  http://www.rendrag.net/
--
We rode on the winds of the rising storm,
 We ran to the sounds of thunder.
We danced among the lightning bolts,
 and tore the world asunder

_______________________________________________
AusNOG mailing list
AusNOG at lists.ausnog.net<mailto:AusNOG at lists.ausnog.net>
http://lists.ausnog.net/mailman/listinfo/ausnog
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20190314/a6e44965/attachment.html>