[AusNOG] AAPT NWB down

Wed Mar 11 15:15:01 EST 2020

Beat me to it. Not just you, Exactly the same symptoms as last time.

Tim Sandy
Senior Network Engineer
at Centorrino Technologies
m0402 234 342
640-642 Sydney Road, Coburg VIC 3058

Disclaimer
This email message is confidential and may be privileged. Unauthorised use, copying or distribution of any part of this email including attachments is 
prohibited. If you are not the intended recipient, please forward the email to operations at ct.com.au and delete the original. 
Any advice contained in this email is of a general nature only and has been prepared without considering your relevant personal circumstances. To the 
extent permitted by law, we exclude (and where the law does not permit exclusion, limit to the extent permitted by law) all liability for any direct, 
indirect and consequential losses, damages and expenses incurred in any way (including but not limited to that arising from negligence), connected with any use or 
access to or any reliance on information contained in this email or any attachments. 
Centorrino Technologies Pty Ltd (ABN: 83 606 931 524). All Rights Reserved.  
From: AusNOG <ausnog-bounces at lists.ausnog.net> On Behalf Of Steve Dimitrio
Sent: Wednesday, 11 March 2020 3:12 PM
To: ausnog at lists.ausnog.net
Subject: Re: [AusNOG] AAPT NWB down

Down again!

From: AusNOG <ausnog-bounces at lists.ausnog.net<mailto:ausnog-bounces at lists.ausnog.net>> On Behalf Of Tim Sandy
Sent: Wednesday, 4 March 2020 4:39 PM
To: Matthew Enger <m.enger at xi.com.au<mailto:m.enger at xi.com.au>>
Cc: ausnog at lists.ausnog.net<mailto:ausnog at lists.ausnog.net>
Subject: Re: [AusNOG] AAPT NWB down

Same here. I'm far to familiar with AAPT's hold music.

On Wed, 4 Mar 2020 at 16:38, Matthew Enger <m.enger at xi.com.au<mailto:m.enger at xi.com.au>> wrote:
And we are down again…

[cid:image001.png at 01D5F7B7.D5068DB0]

MATTHEW ENGER | Managing Director
T 1300 789 299 D 03 9909 3104 M 0406 532 792
m.enger at xi.com.au<mailto:m.enger at xi.com.au> | www.xi.com.au<https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.xi.com.au%2F&data=02%7C01%7Ctsandy%40ct.com.au%7Ca32b8b3adc5a455319d708d7c572a61b%7Cfb10aef933c54fbd9dfb58640fe04367%7C0%7C0%7C637194968516642900&sdata=WrZqbCpcEywwgXH1axgh7YapLQ3SQ8k8iqLYeCyzEcg%3D&reserved=0>

This message is confidential. It may also be privileged or otherwise protected by work product immunity or other legal rules. If you have received it by mistake, please let us know by e-mail reply and delete it from your system; you may not copy this message or disclose its contents to anyone. Please send us by fax any message containing deadlines as incoming e-mails are not screened for response deadlines. The integrity and security of this message cannot be guaranteed on the Internet.
From: AusNOG <ausnog-bounces at lists.ausnog.net<mailto:ausnog-bounces at lists.ausnog.net>> on behalf of Tim Sandy <timsandy at gmail.com<mailto:timsandy at gmail.com>>
Date: Wednesday, 4 March 2020 at 3:10 pm
To: Craig Askings <craig at askings.com.au<mailto:craig at askings.com.au>>
Cc: "ausnog at lists.ausnog.net<mailto:ausnog at lists.ausnog.net>" <ausnog at lists.ausnog.net<mailto:ausnog at lists.ausnog.net>>
Subject: Re: [AusNOG] AAPT NWB down

We're back too (Y)

On Wed, 4 Mar 2020 at 15:08, Craig Askings <craig at askings.com.au<mailto:craig at askings.com.au>> wrote:
Same here

On 4 Mar 2020, at 1:39 pm, Nathan Brookfield <Nathan.Brookfield at simtronic.com.au<mailto:Nathan.Brookfield at simtronic.com.au>> wrote:

Finally just got an email, they’re on the ball I tell you.
Kindest Regards,

Nathan Brookfield (VK2NAB)
Simtronic Technologies Pty Ltd

Local: (02) 4749 4949<tel:(02)%204749%204949> | Fax: (02) 4749 4950<tel:(02)%204749%204950> | Direct: (02) 4749 4951<tel:(02)%204749%204951>
Web: http://www.simtronic.com.au<https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.simtronic.com.au%2F&data=02%7C01%7Ctsandy%40ct.com.au%7Ca32b8b3adc5a455319d708d7c572a61b%7Cfb10aef933c54fbd9dfb58640fe04367%7C0%7C0%7C637194968516642900&sdata=9B7BU1ceS8LQ8diJf3%2B2wRneyXh0FqKOcSL2K28srQ0%3D&reserved=0> | E-mail: nathan.brookfield at simtronic.com.au<mailto:nathan.brookfield at simtronic.com.au>

CONFIDENTIALITY & PRIVILEGE NOTICE

The information contained in this email and any attached files is strictly private and confidential. The intended recipient of this email may only use, reproduce, disclose or distribute the information contained in this email and any attached files with Simtronic Technologies Pty Ltd’s permission. If you are not the intended recipient, you are strictly prohibited from using, reproducing, adapting, disclosing or distributing the information contained in this email and any attached files or taking any action in reliance on it. If you have received this email in error, please email the sender by replying to this message, promptly delete and destroy any copies of this email and any attachments.

It is your responsibility to scan this communication and any files attached for computer viruses and other defects and recommend that you subject these to your virus checking procedures prior to use. Simtronic Technologies Pty Ltd does NOT accept liability for any loss or damage (whether direct, indirect, consequential, economic or other) however caused, whether by negligence or otherwise, which may result directly or indirectly from this communication or any files attached.

On 4 Mar 2020, at 14:37, Matthew Enger <m.enger at xi.com.au<mailto:m.enger at xi.com.au>> wrote:
I just had a call back from level 3, they are aware of the issue and the fault on frontier NOC-86373 is the one to monitor.

<Xi-logo_150e8883-7539-4b86-a491-22175ba1f55d.gif>
MATTHEW ENGER | Managing Director
T 1300 789 299 D 03 9909 3104 M 0406 532 792
m.enger at xi.com.au<mailto:m.enger at xi.com.au> | www.xi.com.au<https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.xi.com.au%2F&data=02%7C01%7Ctsandy%40ct.com.au%7Ca32b8b3adc5a455319d708d7c572a61b%7Cfb10aef933c54fbd9dfb58640fe04367%7C0%7C0%7C637194968516652860&sdata=r3ZiaX0kZiUTOkQu1bLdJn8Lnix%2F5x35KvKZZhJk6u0%3D&reserved=0>

This message is confidential. It may also be privileged or otherwise protected by work product immunity or other legal rules. If you have received it by mistake, please let us know by e-mail reply and delete it from your system; you may not copy this message or disclose its contents to anyone. Please send us by fax any message containing deadlines as incoming e-mails are not screened for response deadlines. The integrity and security of this message cannot be guaranteed on the Internet.
From: AusNOG <ausnog-bounces at lists.ausnog.net<mailto:ausnog-bounces at lists.ausnog.net>> on behalf of Tim Sandy <timsandy at gmail.com<mailto:timsandy at gmail.com>>
Date: Wednesday, 4 March 2020 at 2:35 pm
To: Craig Askings <craig at askings.com.au<mailto:craig at askings.com.au>>
Cc: "ausnog at lists.ausnog.net<mailto:ausnog at lists.ausnog.net>" <ausnog at lists.ausnog.net<mailto:ausnog at lists.ausnog.net>>
Subject: Re: [AusNOG] AAPT NWB down

Nothing in netflow. In past I've seen it route that way because of reasons, and was picked up as a false positive by DDoS protection, but that doesn't appear to be happening either.
As Glenn said, it's showing in Frontier now so they at least seem to be aware of it.

On Wed, 4 Mar 2020 at 14:24, Craig Askings <craig at askings.com.au<mailto:craig at askings.com.au>> wrote:
Do you have your LNS within a VRF? If you have a netflow collector, see if you are getting AAPT LAC traffic via one of your transit links.

On 4 Mar 2020, at 1:19 pm, Matthew Enger <m.enger at xi.com.au<mailto:m.enger at xi.com.au>> wrote:

Hi Tim,

We are seeing the same. Opened faults and called all levels no one is picking up at aapt.

I am seeing same as you.

<Xi-logo_150e8883-7539-4b86-a491-22175ba1f55d.gif>
MATTHEW ENGER | Managing Director
T 1300 789 299 D 03 9909 3104 M 0406 532 792
m.enger at xi.com.au<mailto:m.enger at xi.com.au> | www.xi.com.au<https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.xi.com.au%2F&data=02%7C01%7Ctsandy%40ct.com.au%7Ca32b8b3adc5a455319d708d7c572a61b%7Cfb10aef933c54fbd9dfb58640fe04367%7C0%7C0%7C637194968516652860&sdata=r3ZiaX0kZiUTOkQu1bLdJn8Lnix%2F5x35KvKZZhJk6u0%3D&reserved=0>

This message is confidential. It may also be privileged or otherwise protected by work product immunity or other legal rules. If you have received it by mistake, please let us know by e-mail reply and delete it from your system; you may not copy this message or disclose its contents to anyone. Please send us by fax any message containing deadlines as incoming e-mails are not screened for response deadlines. The integrity and security of this message cannot be guaranteed on the Internet.
From: AusNOG <ausnog-bounces at lists.ausnog.net<mailto:ausnog-bounces at lists.ausnog.net>> on behalf of Tim Sandy <timsandy at gmail.com<mailto:timsandy at gmail.com>>
Date: Wednesday, 4 March 2020 at 2:16 pm
To: "ausnog at lists.ausnog.net<mailto:ausnog at lists.ausnog.net>" <ausnog at lists.ausnog.net<mailto:ausnog at lists.ausnog.net>>
Subject: [AusNOG] AAPT NWB down

Hi All,
I've had all of my VPDN tunnels to my AAPT NWB core go down and not come back, around 12:50 today.
Peering still up and LAC addresses still received, but no tunnels.

I've been on hold with support for over 40 minutes waiting to talk to someone, and can't get onto my AM either.
There's a big spike on down detector - https://downdetector.com.au/status/aapt/melbourne/<https://aus01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdowndetector.com.au%2Fstatus%2Faapt%2Fmelbourne%2F&data=02%7C01%7Ctsandy%40ct.com.au%7Ca32b8b3adc5a455319d708d7c572a61b%7Cfb10aef933c54fbd9dfb58640fe04367%7C0%7C0%7C637194968516652860&sdata=BKOXlK3FHSdHUOluv6toVA9cvN8yyju%2FINhC22MRijM%3D&reserved=0> - So I'm thinking it's not just me.

Anyone else seeing issues?
Cheers,
Tim

Message protected by MailGuard: e-mail anti-virus, anti-spam and content filtering.
http://www.mailguard.com.au/mg<https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.mailguard.com.au%2Fmg&data=02%7C01%7Ctsandy%40ct.com.au%7Ca32b8b3adc5a455319d708d7c572a61b%7Cfb10aef933c54fbd9dfb58640fe04367%7C0%7C0%7C637194968516662817&sdata=SS085s97dumYzL6Vej75Xhm9nKsZO6d3DtItx1%2BXIvY%3D&reserved=0>

Report this message as spam<https://aus01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fconsole.mailguard.com.au%2Fras%2F1XEUx6qPQ7%2F4j4XIBv2zYnUs6PQaZ4mxg%2F2.9&data=02%7C01%7Ctsandy%40ct.com.au%7Ca32b8b3adc5a455319d708d7c572a61b%7Cfb10aef933c54fbd9dfb58640fe04367%7C0%7C0%7C637194968516662817&sdata=uZtwejyYWd%2BfPeASGDpEkCdxZuvg4it1uxs6O%2FgAwQ8%3D&reserved=0>

_______________________________________________
AusNOG mailing list
AusNOG at lists.ausnog.net<mailto:AusNOG at lists.ausnog.net>
http://lists.ausnog.net/mailman/listinfo/ausnog<https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.ausnog.net%2Fmailman%2Flistinfo%2Fausnog&data=02%7C01%7Ctsandy%40ct.com.au%7Ca32b8b3adc5a455319d708d7c572a61b%7Cfb10aef933c54fbd9dfb58640fe04367%7C0%7C0%7C637194968516672771&sdata=zPRBjoBdSWNT42eYm8jIrFgvjnM6IMTuatCcCuHuHlQ%3D&reserved=0>

_______________________________________________
AusNOG mailing list
AusNOG at lists.ausnog.net<mailto:AusNOG at lists.ausnog.net>
http://lists.ausnog.net/mailman/listinfo/ausnog<https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.ausnog.net%2Fmailman%2Flistinfo%2Fausnog&data=02%7C01%7Ctsandy%40ct.com.au%7Ca32b8b3adc5a455319d708d7c572a61b%7Cfb10aef933c54fbd9dfb58640fe04367%7C0%7C0%7C637194968516672771&sdata=zPRBjoBdSWNT42eYm8jIrFgvjnM6IMTuatCcCuHuHlQ%3D&reserved=0>

Message protected by MailGuard: e-mail anti-virus, anti-spam and content filtering.
http://www.mailguard.com.au/mg<https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.mailguard.com.au%2Fmg&data=02%7C01%7Ctsandy%40ct.com.au%7Ca32b8b3adc5a455319d708d7c572a61b%7Cfb10aef933c54fbd9dfb58640fe04367%7C0%7C0%7C637194968516672771&sdata=yMYsPObWouZ9eIadYB0fx4AoayzMXGiJsPVxqIzCpS0%3D&reserved=0>

Report this message as spam<https://aus01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fconsole.mailguard.com.au%2Fras%2F1XEURrRAdU%2F72MNKEvyLgsM0VPj5oOpTb%2F0.4&data=02%7C01%7Ctsandy%40ct.com.au%7Ca32b8b3adc5a455319d708d7c572a61b%7Cfb10aef933c54fbd9dfb58640fe04367%7C0%7C0%7C637194968516682727&sdata=am1fFzlmZ05PuxHLVTZc4iMZutAphvL9JWEixqaUOp4%3D&reserved=0>

_______________________________________________
AusNOG mailing list
AusNOG at lists.ausnog.net<mailto:AusNOG at lists.ausnog.net>
http://lists.ausnog.net/mailman/listinfo/ausnog<https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.ausnog.net%2Fmailman%2Flistinfo%2Fausnog&data=02%7C01%7Ctsandy%40ct.com.au%7Ca32b8b3adc5a455319d708d7c572a61b%7Cfb10aef933c54fbd9dfb58640fe04367%7C0%7C0%7C637194968516682727&sdata=TneRp1lntYT%2BUcz80WEQ1PIdEHqqMTUgZLCps9BE73c%3D&reserved=0>
<Xi-logo_150e8883-7539-4b86-a491-22175ba1f55d.gif>

_______________________________________________
AusNOG mailing list
AusNOG at lists.ausnog.net<mailto:AusNOG at lists.ausnog.net>
http://lists.ausnog.net/mailman/listinfo/ausnog<https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.ausnog.net%2Fmailman%2Flistinfo%2Fausnog&data=02%7C01%7Ctsandy%40ct.com.au%7Ca32b8b3adc5a455319d708d7c572a61b%7Cfb10aef933c54fbd9dfb58640fe04367%7C0%7C0%7C637194968516682727&sdata=TneRp1lntYT%2BUcz80WEQ1PIdEHqqMTUgZLCps9BE73c%3D&reserved=0>

Message protected by MailGuard: e-mail anti-virus, anti-spam and content filtering.
http://www.mailguard.com.au/mg<https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.mailguard.com.au%2Fmg&data=02%7C01%7Ctsandy%40ct.com.au%7Ca32b8b3adc5a455319d708d7c572a61b%7Cfb10aef933c54fbd9dfb58640fe04367%7C0%7C0%7C637194968516692683&sdata=p%2Fq03ZmFG7mdRhEj7IeBBEuDwMOb1cZGSJ0llmUvF5c%3D&reserved=0>

Report this message as spam<https://aus01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fconsole.mailguard.com.au%2Fras%2F1XEVuH211P%2F2uwlwAoRL3GJcd23jEI1P8%2F0.6&data=02%7C01%7Ctsandy%40ct.com.au%7Ca32b8b3adc5a455319d708d7c572a61b%7Cfb10aef933c54fbd9dfb58640fe04367%7C0%7C0%7C637194968516692683&sdata=Q%2BbBW%2BC0RTRSZZqi97IEMjDNsg8LTWkTHHJNaUfot4I%3D&reserved=0>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20200311/2f33eb88/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 7676 bytes
Desc: image001.png
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20200311/2f33eb88/attachment-0010.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image652387.png
Type: image/png
Size: 2137 bytes
Desc: image652387.png
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20200311/2f33eb88/attachment-0011.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image761175.png
Type: image/png
Size: 1547 bytes
Desc: image761175.png
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20200311/2f33eb88/attachment-0012.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image060077.png
Type: image/png
Size: 1200 bytes
Desc: image060077.png
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20200311/2f33eb88/attachment-0013.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image173775.png
Type: image/png
Size: 1216 bytes
Desc: image173775.png
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20200311/2f33eb88/attachment-0014.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image957821.png
Type: image/png
Size: 234 bytes
Desc: image957821.png
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20200311/2f33eb88/attachment-0015.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image667429.png
Type: image/png
Size: 843 bytes
Desc: image667429.png
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20200311/2f33eb88/attachment-0016.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image736123.png
Type: image/png
Size: 2467 bytes
Desc: image736123.png
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20200311/2f33eb88/attachment-0017.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image796504.png
Type: image/png
Size: 120 bytes
Desc: image796504.png
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20200311/2f33eb88/attachment-0018.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image684325.png
Type: image/png
Size: 26627 bytes
Desc: image684325.png
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20200311/2f33eb88/attachment-0019.png>