[AusNOG] [Caution: Message contains Redirect URL content] Re: AAPT Brisbane Outage - 26/05/2019

Mon May 27 08:40:07 EST 2019

Anyone seeing their services down again? Heard the issue has re-occurred.

From: AusNOG <ausnog-bounces at lists.ausnog.net> On Behalf Of Mark Holmes
Sent: Monday, 27 May 2019 5:53 AM
To: ausnog at lists.ausnog.net
Subject: [EXTERNAL] Re: [AusNOG] [Caution: Message contains Redirect URL content] Re: AAPT Brisbane Outage - 26/05/2019

You spoke too soon, issues have continued overnight. We still have multiple services down.

27-May-2019 05:42:47
Service migration has completed. Should your service still be experiencing issues, please power-cycle CPE and retest the service. If the service is not restored, please contact the CHD.

27-May-2019 02:15:43
All IP Nodes restored after reset during cut over to AC mains, IP Tier 2 continuing to restore rest of the services.

27-May-2019 01:41:51
Fops cut over from Geni to AC Mains, multiple IP Core nodes are rebooting with customer impact, FOPS investigating.

26-May-2019 23:39:46
The restoration works are still continuing and services are progressively restoring. Estimated total restoration time is 2-3 hours. Next update in 2 hours.

26-May-2019 21:06:08
The restoration works are continuing and services are progressively restoring. Estimated total restoration time is 3-4 hours. Next update in 2 hours.

Mark

From: AusNOG <ausnog-bounces at lists.ausnog.net<mailto:ausnog-bounces at lists.ausnog.net>> On Behalf Of Nathan Brookfield
Sent: Sunday, 26 May 2019 11:27 PM
To: Mark Tees <marktees at gmail.com<mailto:marktees at gmail.com>>
Cc: ausnog at lists.ausnog.net<mailto:ausnog at lists.ausnog.net>
Subject: Re: [AusNOG] [Caution: Message contains Redirect URL content] Re: AAPT Brisbane Outage - 26/05/2019

Very grateful it was a Sunday that’s for sure...,

Update at 2106 was full restoration in 3-4 hours, as long as that’s before morning, happy days :)
Nathan Brookfield
Chief Executive Officer

Simtronic Technologies Pty Ltd
http://www.simtronic.com.au<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.simtronic.com.au&d=DwMGaQ&c=bokVvpls5SyWiBVBQnPYjg&r=9SiL5VPRcj2qC-fAxe1a_nigdgg7UVgjgKpqOsAzcpI&m=Fae2UAxM0p4sOoVwGwMIGRqB5TnApXva24euEaPoy8Q&s=BihOVr3QyuIVM5WnVrKNYnLYNZnua8I7-hxvY2QLZr8&e=>

On 26 May 2019, at 23:00, Mark Tees <marktees at gmail.com<mailto:marktees at gmail.com>> wrote:
Sounds like a power surge took out a bunch of stuff.

On Sun, 26 May 2019 at 20:52, Warren Bold | Polyfone Telecom Pty Ltd <WBold at polyfone.com.au<mailto:WBold at polyfone.com.au>> wrote:

The Frontier notes for those who can't see it.

<pastedImage.png>

Kind regards

Warren Bold

________________________________
From: AusNOG <ausnog-bounces at lists.ausnog.net<mailto:ausnog-bounces at lists.ausnog.net>> on behalf of Saxton, Joseph (SYD-FED) <Joseph.Saxton at interpublic.com<mailto:Joseph.Saxton at interpublic.com>>
Sent: Sunday, 26 May 2019 8:49:07 PM
To: Andrew Mathieson (CompleteTel); Nathan Brookfield
Cc: ausnog at lists.ausnog.net<mailto:ausnog at lists.ausnog.net>
Subject: Re: [AusNOG] [Caution: Message contains Redirect URL content] Re: AAPT Brisbane Outage - 26/05/2019

Apparently 95% of customers have been restored.

From: AusNOG <ausnog-bounces at lists.ausnog.net<mailto:ausnog-bounces at lists.ausnog.net>> On Behalf Of Andrew Mathieson (CompleteTel)
Sent: Sunday, 26 May 2019 1:43 PM
To: Nathan Brookfield <Nathan.Brookfield at simtronic.com.au<mailto:Nathan.Brookfield at simtronic.com.au>>
Cc: ausnog at lists.ausnog.net<mailto:ausnog at lists.ausnog.net>
Subject: [EXTERNAL] Re: [AusNOG] [Caution: Message contains Redirect URL content] Re: AAPT Brisbane Outage - 26/05/2019

I’ve just checked our clients are still down.

Anyone heard anymore from AAPT when we are likely to see services restored.

Regards

Andrew

Sent from my iPhone

On 26 May 2019, at 12:28 pm, Nathan Brookfield <Nathan.Brookfield at simtronic.com.au<mailto:Nathan.Brookfield at simtronic.com.au>> wrote:

Still seeing a heap of ADSL down and a few Ethernets :(

On 26 May 2019, at 12:20, Warren Bold | Polyfone Telecom Pty Ltd <WBold at polyfone.com.au<mailto:WBold at polyfone.com.au>> wrote:

Seeing some restore now.

Kind regards

Warren Bold

Senior Network Engineer

________________________________

From: AusNOG <ausnog-bounces at lists.ausnog.net<mailto:ausnog-bounces at lists.ausnog.net>> on behalf of Steven Waite <steven.waite at comtel.com.au<mailto:steven.waite at comtel.com.au>>
Sent: Sunday, May 26, 2019 11:08:08 AM
To: Simon Attwell
Cc: ausnog at lists.ausnog.net<mailto:ausnog at lists.ausnog.net>
Subject: Re: [AusNOG] [Caution: Message contains Redirect URL content] Re: AAPT Brisbane Outage - 26/05/2019

Anyone got an ETA?

Thanks Steve

Sent from my mobile device

On 26 May 2019, at 9:50 am, Simon Attwell <simon at attwell.net<mailto:simon at attwell.net>> wrote:

Yep, TPG FTTB Services out in Brisbane too.

- Simon

On Sun, 26 May 2019 at 09:30, Graham Maltby <graham at maltby.id.au<mailto:graham at maltby.id.au>> wrote:

Yep :(

Many dozens of services in QLD, both Layer-2 and Layer-3; NBN and DSL.

------ Original Message ------

From: "Radek Tkaczyk" <radek at tkaczyk.id.au<mailto:radek at tkaczyk.id.au>>

To: "ausnog at lists.ausnog.net<mailto:ausnog at lists.ausnog.net>" <ausnog at lists.ausnog.net<mailto:ausnog at lists.ausnog.net>>

Sent: 26/05/2019 09:00:53

Subject: [AusNOG] AAPT Brisbane Outage - 26/05/2019

Hi Guys,

Did anyone else notice an AAPT outage about 30 minutes ago in Brisbane?

We have hundreds of services down, NBN, EoC MBE, fibre,etc.

I’m assuming it’s a rather wide scale since it all went pop at around the same time.

Thanks

Radek

_______________________________________________
AusNOG mailing list
AusNOG at lists.ausnog.net<mailto:AusNOG at lists.ausnog.net>
http://lists.ausnog.net/mailman/listinfo/ausnog<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.ausnog.net_mailman_listinfo_ausnog&d=DwMGaQ&c=Ftw_YSVcGmqQBvrGwAZugGylNRkk-uER0-5bY94tjsc&r=srheiojgNn4Jg0keeQ9hj6cyp8zgHx0m-eTRLdD3nnw&m=uh29ZjEgd0TLkOrVCWEpWsNoDmx0z1QTiJKc0UBPlkY&s=MEGH7oC08dZu6WqzWgIlMuTZ4KIOgdmOVpW5Y9EsmDI&e=>

--

--

Simon Attwell

Senior Systems and Network Engineer

Attwell's Technical Services Pty Ltd

Mobile: 0409 756 819

Email: simon at attwell.net<mailto:simon at attwell.net>

_______________________________________________
AusNOG mailing list
AusNOG at lists.ausnog.net<mailto:AusNOG at lists.ausnog.net>
http://lists.ausnog.net/mailman/listinfo/ausnog<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.ausnog.net_mailman_listinfo_ausnog&d=DwMGaQ&c=Ftw_YSVcGmqQBvrGwAZugGylNRkk-uER0-5bY94tjsc&r=srheiojgNn4Jg0keeQ9hj6cyp8zgHx0m-eTRLdD3nnw&m=uh29ZjEgd0TLkOrVCWEpWsNoDmx0z1QTiJKc0UBPlkY&s=MEGH7oC08dZu6WqzWgIlMuTZ4KIOgdmOVpW5Y9EsmDI&e=>

_______________________________________________
AusNOG mailing list
AusNOG at lists.ausnog.net<mailto:AusNOG at lists.ausnog.net>
http://lists.ausnog.net/mailman/listinfo/ausnog<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.ausnog.net_mailman_listinfo_ausnog&d=DwMGaQ&c=Ftw_YSVcGmqQBvrGwAZugGylNRkk-uER0-5bY94tjsc&r=srheiojgNn4Jg0keeQ9hj6cyp8zgHx0m-eTRLdD3nnw&m=uh29ZjEgd0TLkOrVCWEpWsNoDmx0z1QTiJKc0UBPlkY&s=MEGH7oC08dZu6WqzWgIlMuTZ4KIOgdmOVpW5Y9EsmDI&e=>

________________________________

Message protected by MailGuard: e-mail anti-virus, anti-spam and content filtering.
http://www.mailguard.com.au<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.mailguard.com.au&d=DwMGaQ&c=Ftw_YSVcGmqQBvrGwAZugGylNRkk-uER0-5bY94tjsc&r=srheiojgNn4Jg0keeQ9hj6cyp8zgHx0m-eTRLdD3nnw&m=uh29ZjEgd0TLkOrVCWEpWsNoDmx0z1QTiJKc0UBPlkY&s=ndPIt_-I6r4AzvR34n-l7PFockG3DszcIpdbiNWbcjo&e=>

_______________________________________________
AusNOG mailing list
AusNOG at lists.ausnog.net<mailto:AusNOG at lists.ausnog.net>
http://lists.ausnog.net/mailman/listinfo/ausnog<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.ausnog.net_mailman_listinfo_ausnog&d=DwMGaQ&c=Ftw_YSVcGmqQBvrGwAZugGylNRkk-uER0-5bY94tjsc&r=srheiojgNn4Jg0keeQ9hj6cyp8zgHx0m-eTRLdD3nnw&m=uh29ZjEgd0TLkOrVCWEpWsNoDmx0z1QTiJKc0UBPlkY&s=MEGH7oC08dZu6WqzWgIlMuTZ4KIOgdmOVpW5Y9EsmDI&e=>

________________________________

Message protected by MailGuard: e-mail anti-virus, anti-spam and content filtering.
http://www.mailguard.com.au<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.mailguard.com.au&d=DwMGaQ&c=Ftw_YSVcGmqQBvrGwAZugGylNRkk-uER0-5bY94tjsc&r=srheiojgNn4Jg0keeQ9hj6cyp8zgHx0m-eTRLdD3nnw&m=uh29ZjEgd0TLkOrVCWEpWsNoDmx0z1QTiJKc0UBPlkY&s=ndPIt_-I6r4AzvR34n-l7PFockG3DszcIpdbiNWbcjo&e=>

This message contains information which may be confidential and privileged. Unless you are the intended recipient (or authorized to receive this message for the intended recipient), you may not use, copy, disseminate or disclose to anyone the message or any information contained in the message. If you have received the message in error, please advise the sender by reply e-mail, and delete the message. Thank you very much.
_______________________________________________
AusNOG mailing list
AusNOG at lists.ausnog.net<mailto:AusNOG at lists.ausnog.net>
http://lists.ausnog.net/mailman/listinfo/ausnog<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.ausnog.net_mailman_listinfo_ausnog&d=DwMGaQ&c=bokVvpls5SyWiBVBQnPYjg&r=9SiL5VPRcj2qC-fAxe1a_nigdgg7UVgjgKpqOsAzcpI&m=Fae2UAxM0p4sOoVwGwMIGRqB5TnApXva24euEaPoy8Q&s=MIIM-wi0HVR_BXFZCK3g1GHcDg_4LypGAGEF8tGu8DQ&e=>

--
Regards,

Mark L. Tees
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20190526/043cb785/attachment.html>