[AusNOG] Equinix SY1 gone dark?

Fri Mar 15 15:39:09 EST 2019

Hi

"
This is why it’s always good to have dual fed equipment and send notices
during the scheduled maintenance windows.
"

Different event. I had a power supply trip one of the circuits in my rack.
Strangely it affected a server in the same rack - dual power supplied Dell
server . for some reason it stopped talking on the network 2 x 2 ported 10G
nics. cross connected into 2 vswitches.  the strangest thing, reboot the
box and it came back no problem ... Dell and Dell/Vmware can't really
explain it. I wouldn't expect it to happen but ..

On Fri, 15 Mar 2019 at 07:19, Jared Hirst <
jared.hirst at serversaustralia.com.au> wrote:

> I believe there was scheduled maintenance at SY1 yesterday for the STS and
> UPS systems and I believe that the power was disrupted during that
> maintenance window.
>
> This is why it’s always good to have dual fed equipment and send notices
> during the scheduled maintenance windows.
>
> We’ve never had any issues during the scheduled maintenance windows, but I
> guess that’s why they are classed as ‘hazardous’
>
> As for the POI redundancy, certainly something to think about. I don’t
> think consumers care where their internet comes from as long as it works.
> Look at the melt down yesterday with Facebook being offline! People called
> 000! Seriously?!
>
> Jared
>
>
> Thu, 14 Mar at 6:53 pm, <markzzzsmith at gmail.com> wrote:
>
>
>
> On Thu., 14 Mar. 2019, 18:02 Nathan Brookfield, <
> Nathan.Brookfield at simtronic.com.au> wrote:
>
> Same same, take a month or two to rebuild…. At least with nodes, half of
> the Infrastructure is moved out into the field.
>
> Do NBN offer POI redundancy yet, meaning they can switch AVCs to another
> POI?
>
> I've seen how angry numbers of 10s of 1000s of customers can get after an
> outage of a day or two. I expect within less than a week they'll have
> switched to another provider, which in an NBN world, because subs are
> connected to the same POI regardless of the RSP, means a mobile broadband
> provider. If it is good enough and cheap enough, they won't come back.
>
>
>
>
>
>
> Kindest Regards,
>
> Nathan Brookfield (VK2NAB)
>
>
>
> Chief Executive Officer
>
> Simtronic Technologies Pty Ltd
>
>
>
> *Local:* (02) 4749 4949 *|* *Fax:* (02) 4749 4950 *|* *Direct:* (02) 4749
> 4951
>
> *Web*: http://www.simtronic.com.au *|* *E-mail*:
> nathan.brookfield at simtronic.com.au
>
>
>
>
> CONFIDENTIALITY & PRIVILEGE NOTICE
>
> The information contained in this email and any attached files is strictly
> private and confidential. The intended recipient of this email may only
> use, reproduce, disclose or distribute the information contained in this
> email and any attached files with Simtronic Technologies Pty Ltd’s
> permission. If you are not the intended recipient, you are strictly
> prohibited from using, reproducing, adapting, disclosing or distributing
> the information contained in this email and any attached files or taking
> any action in reliance on it. If you have received this email in error,
> please email the sender by replying to this message, promptly delete and
> destroy any copies of this email and any attachments.
>
> It is your responsibility to scan this communication and any files
> attached for computer viruses and other defects and recommend that you
> subject these to your virus checking procedures prior to use. Simtronic
> Technologies Pty Ltd does NOT accept liability for any loss or damage
> (whether direct, indirect, consequential, economic or other) however
> caused, whether by negligence or otherwise, which may result directly or
> indirectly from this communication or any files attached.
>
>
>
> *From:* AusNOG <ausnog-bounces at lists.ausnog.net> *On Behalf Of *Mark Smith
> *Sent:* Thursday, March 14, 2019 6:00 PM
> *To:* Shah Hardik <shah.hardik at techflow.com.au>
> *Cc:* <ausnog at lists.ausnog.net> <ausnog at lists.ausnog.net>
> *Subject:* Re: [AusNOG] Equinix SY1 gone dark?
>
>
>
> A building is a SPOF, and they fail easily enough like Warrnambool did
> (and other exchanges have caught on fire too in the last 15 or so years,
> like Glenunga and Kangaroo Island.)
>
>
>
> What happens if an NBN POI catches on fire and burns down?
>
>
>
>
>
>
>
> On Thu., 14 Mar. 2019, 17:45 Shah Hardik, <shah.hardik at techflow.com.au>
> wrote:
>
> That’s unfortunately reasonably common in the scheme of things… either at
> the DC operator level or simply on the PDU level where the PDUs fail or
> simply the circuit trips due to unexpected surge…
>
>
>
> Evenly distributing the load across PDUs and understanding the finer
> details of circuit breakers in individual PDUs are typically a start to
> avoid unnecessary “outages”.
>
>
>
> However something like
> https://www.techflowit.com.au/products/apc-ap4421-rack-automatic-transfer-switch-230v10a-c14-in-12-c13-out-1030477
> is a must in our opinion when customers are operating single PSU devices in
> their infra!
>
>
>
> Best regards,
>
> Shah Hardik
>
> *From:* AusNOG <ausnog-bounces at lists.ausnog.net> *On Behalf Of *Chris Ford
> *Sent:* Thursday, 14 March 2019 5:35 PM
> *To:* ausnog at lists.ausnog.net
> *Subject:* Re: [AusNOG] Equinix SY1 gone dark?
>
>
>
> There’s a lesson in that
>
>
>
> *From:* AusNOG <ausnog-bounces at lists.ausnog.net> *On Behalf Of *Damien
> Gardner Jnr
>
> Failed STS according to the incident report that came out 20 mins ago.
>  One hopes that means that only customers without A+B to all devices
> dropped?
>
>
>
> On Thu, 14 Mar 2019 at 17:11, Nathan Brookfield <
> Nathan.Brookfield at simtronic.com.au> wrote:
>
> Someone is looking over the rest of us today, sorry to hear that guys.
>
>
>
> We’re in a private cage and have racks across the DC so maybe everything
> in one specific disty board but they’re separated A+B and to different
> UPS’s so that’s scary.
>
>
>
>
> On 14 Mar 2019, at 17:01, Matthew Martin <matthew at mmit.com.au> wrote:
>
> We lost our cage in SY1 also FYI at the same time, power just came back
>
>
>
>
>
> -------- Original message --------
>
> From: Nathan Brookfield <Nathan.Brookfield at simtronic.com.au>
>
> Date: 14/3/19 16:32 (GMT+10:00)
>
> To: Matthew VK3EVL <hitman at itglowz.com>
>
> Cc: ausnog at lists.ausnog.net
>
> Subject: Re: [AusNOG] Equinix SY1 gone dark?
>
>
>
> Just you bud.
>
> Nathan Brookfield
> Chief Executive Officer
>
> Simtronic Technologies Pty Ltd
> http://www.simtronic.com.au
>
> On 14 Mar 2019, at 16:19, Matthew VK3EVL <hitman at itglowz.com> wrote:
>
> Hi All,
>
> Hearing reports (and lost our cage) in SY1.
>
> Apparently nobody answering the phone at Equinix. Is it just me or have
> others seen it too?
>
> Cheers
> Matthew
>
> _______________________________________________
> AusNOG mailing list
> AusNOG at lists.ausnog.net
> http://lists.ausnog.net/mailman/listinfo/ausnog
> _______________________________________________
> AusNOG mailing list
> AusNOG at lists.ausnog.net
> http://lists.ausnog.net/mailman/listinfo/ausnog
>
> _______________________________________________
> AusNOG mailing list
> AusNOG at lists.ausnog.net
> http://lists.ausnog.net/mailman/listinfo/ausnog
>
>
>
>
> --
>
> Damien Gardner Jnr
> VK2TDG. Dip EE. GradIEAust
> rendrag at rendrag.net -  http://www.rendrag.net/
> --
> We rode on the winds of the rising storm,
>  We ran to the sounds of thunder.
> We danced among the lightning bolts,
>  and tore the world asunder
>
> [image:
> https://t.sidekickopen05.com/s2t/o/5/f18dQhb0S7ks8dDMPbW2n0x6l2B9gXrN7sKj6v5dbl2W3M2smn4Wzv6bW7fKgKv2zlZNzW7J09B51k1H6H0?si=5046652182331392&amp;pi=1960f7ab-200b-4198-8532-6bc9809f601f]
>
> _______________________________________________
> AusNOG mailing list
> AusNOG at lists.ausnog.net
> http://lists.ausnog.net/mailman/listinfo/ausnog
>
> _______________________________________________
> AusNOG mailing list
> AusNOG at lists.ausnog.net
> http://lists.ausnog.net/mailman/listinfo/ausnog
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20190315/2583cc05/attachment.html>