<div dir="ltr">Those who believe it's a BGP issue might want to review <a href="https://www.cidr-report.org/cgi-bin/plota?file=%2fvar%2fdata%2fbgp%2fas2.0%2fbgp%2dactive%2etxt&descr=Active%20BGP%20entries%20%28FIB%29&ylabel=Active%20BGP%20entries%20%28FIB%29&with=step">https://www.cidr-report.org/cgi-bin/plota?file=%2fvar%2fdata%2fbgp%2fas2.0%2fbgp%2dactive%2etxt&descr=Active%20BGP%20entries%20%28FIB%29&ylabel=Active%20BGP%20entries%20%28FIB%29&with=step</a><div><br></div><div>This shows a global table getting dangerously close to a 1024K boundary found in some router FIBs.</div><div><br></div><div>John</div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, 8 Nov 2023 at 11:57, Christopher Hawker <<a href="mailto:chris@thesysadmin.dev">chris@thesysadmin.dev</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex"><div class="msg-2595479409526793073">




<div dir="ltr">
<div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
They weren't appearing earlier so I'd say it's new. Smells like BGP has shat itself.</div>
<div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<div><span><br>
</span></div>
<div>
<div><span><span>- ​CH</span><br>
</span></div>
</div>
</div>
<div id="m_-2595479409526793073appendonsend"></div>
<hr style="display:inline-block;width:98%">
<div id="m_-2595479409526793073divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> AusNOG <<a href="mailto:ausnog-bounces@lists.ausnog.net" target="_blank">ausnog-bounces@lists.ausnog.net</a>> on behalf of Tim Malone <<a href="mailto:tdmalone@gmail.com" target="_blank">tdmalone@gmail.com</a>><br>
<b>Sent:</b> Wednesday, November 8, 2023 12:16 PM<br>
<b>To:</b> Nick Jenkin <<a href="mailto:njenkin@gmail.com" target="_blank">njenkin@gmail.com</a>><br>
<b>Cc:</b> <a href="mailto:ausnog@lists.ausnog.net" target="_blank">ausnog@lists.ausnog.net</a> <<a href="mailto:ausnog@lists.ausnog.net" target="_blank">ausnog@lists.ausnog.net</a>><br>
<b>Subject:</b> Re: [AusNOG] Optus downtime chat + affecting SMS verification to Telstra?</font>
<div> </div>
</div>
<div>
<div dir="ltr">Cloudflare is also reporting BGP origin hijack warnings:<br>
<a href="https://radar.cloudflare.com/as7474?dateRange=2d" target="_blank">https://radar.cloudflare.com/as7474?dateRange=2d</a>
<div>(unsure if related though)<br>
<br>
</div>
</div>
<br>
<div>
<div dir="ltr">On Wed, 8 Nov 2023 at 11:10, Nick Jenkin <<a href="mailto:njenkin@gmail.com" target="_blank">njenkin@gmail.com</a>> wrote:<br>
</div>
<blockquote style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">
<div dir="ltr">Just a few announcements... <a href="https://radar.cloudflare.com/traffic/as4804?dateRange=2d" target="_blank">https://radar.cloudflare.com/traffic/as4804?dateRange=2d</a></div>
<br>
<div>
<div dir="ltr">On Wed, 8 Nov 2023 at 11:06, Ben Buxton <<a href="mailto:bb.ausnog@bb.cactii.net" target="_blank">bb.ausnog@bb.cactii.net</a>> wrote:<br>
</div>
<blockquote style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">
<div dir="ltr">
<div dir="ltr"><br>
</div>
<br>
<div>
<div dir="ltr">On Wed, 8 Nov 2023 at 10:14, DaZZa <<a href="mailto:dazzagibbs@gmail.com" target="_blank">dazzagibbs@gmail.com</a>> wrote:<br>
</div>
<blockquote style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">
Yeah, I'd be willing to bet that it's a change which wasn't thoroughly<br>
tested before being rolled out, and which had an inadequate backout<br>
plan.<br>
</blockquote>
<div><br>
</div>
<div>Also, "Our on-site technician is actively prioritising establishing a console connection.".</div>
<div><br>
</div>
<div>I mean come on, it's nearly 2024 and a [major] telco does not have remote console access? Whilst I'm</div>
<div>looking forward to enthusiastically reading the PM, I'll have to book a physio appointment in advance due to </div>
<div>neck strain from all the head shaking it'll likely induce.</div>
<div><br>
</div>
<div>BB</div>
<div><br>
</div>
<div> </div>
<blockquote style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">
<br>
Interestingly, my Optus mobile actually had a valid connection for a<br>
short time - wasn't able to actually DO anything, but was connected to<br>
the OPtus network - but it's now gone to "SOS" mode.<br>
<br>
D<br>
<br>
On Wed, 8 Nov 2023 at 10:01, John Edwards <<a href="mailto:jaedwards@gmail.com" target="_blank">jaedwards@gmail.com</a>> wrote:<br>
><br>
> The 4am Wednesday morning outage start looks suspiciously like a firmware upgrade window.<br>
><br>
> I note that Optus devices where I am are showing "SoS" which indicates the tower is unable to reach the location register, which presumably is on a private network and indicative of a pretty major fault rather than just IP.<br>
><br>
> John<br>
><br>
><br>
> On Wed, 8 Nov 2023 at 09:10, DaZZa <<a href="mailto:dazzagibbs@gmail.com" target="_blank">dazzagibbs@gmail.com</a>> wrote:<br>
>><br>
>> The Optus hamster finally died of old age.<br>
>><br>
>> I would suggest your SMS issues would be caused by whoever is issuing<br>
>> the SMS using Optus - not so much by the Telstra end receiving it.<br>
>><br>
>> Anecdotally, Optus enterprise/wholesale appears to be still functional<br>
>> - at least my link appears to be working fine - and my BGP<br>
>> advertisements are still being seen overseas - seems to be only NBN<br>
>> and mobile based services which are busted<br>
>><br>
>> D<br>
>><br>
>> On Wed, 8 Nov 2023 at 09:27, <<a href="mailto:francisfides@mailup.net" target="_blank">francisfides@mailup.net</a>> wrote:<br>
>> ><br>
>> > Morning all,<br>
>> > Hope the chaos isn't too hard on your work/family.<br>
>> > I have had trouble with a couple of SMS verifications coming through to me, my Telstra number. Is this related?<br>
>> ><br>
>> > Any general banter around the downtime would be fine too - looks like it all began at 4.07am AEDT?<br>
>> ><br>
>> > Cheers<br>
>> ><br>
>> > --<br>
>> ><br>
>> >   <a href="mailto:francisfides@mailup.net" target="_blank">francisfides@mailup.net</a><br>
>> > _______________________________________________<br>
>> > AusNOG mailing list<br>
>> > <a href="mailto:AusNOG@lists.ausnog.net" target="_blank">AusNOG@lists.ausnog.net</a><br>
>> > <a href="https://lists.ausnog.net/mailman/listinfo/ausnog" rel="noreferrer" target="_blank">
https://lists.ausnog.net/mailman/listinfo/ausnog</a><br>
>><br>
>><br>
>><br>
>> --<br>
>> veg·e·tar·i·an:<br>
>> Ancient tribal slang for the village idiot who can't hunt, fish or ride<br>
>> _______________________________________________<br>
>> AusNOG mailing list<br>
>> <a href="mailto:AusNOG@lists.ausnog.net" target="_blank">AusNOG@lists.ausnog.net</a><br>
>> <a href="https://lists.ausnog.net/mailman/listinfo/ausnog" rel="noreferrer" target="_blank">
https://lists.ausnog.net/mailman/listinfo/ausnog</a><br>
<br>
<br>
<br>
-- <br>
veg·e·tar·i·an:<br>
Ancient tribal slang for the village idiot who can't hunt, fish or ride<br>
_______________________________________________<br>
AusNOG mailing list<br>
<a href="mailto:AusNOG@lists.ausnog.net" target="_blank">AusNOG@lists.ausnog.net</a><br>
<a href="https://lists.ausnog.net/mailman/listinfo/ausnog" rel="noreferrer" target="_blank">https://lists.ausnog.net/mailman/listinfo/ausnog</a><br>
</blockquote>
</div>
</div>
_______________________________________________<br>
AusNOG mailing list<br>
<a href="mailto:AusNOG@lists.ausnog.net" target="_blank">AusNOG@lists.ausnog.net</a><br>
<a href="https://lists.ausnog.net/mailman/listinfo/ausnog" rel="noreferrer" target="_blank">https://lists.ausnog.net/mailman/listinfo/ausnog</a><br>
</blockquote>
</div>
_______________________________________________<br>
AusNOG mailing list<br>
<a href="mailto:AusNOG@lists.ausnog.net" target="_blank">AusNOG@lists.ausnog.net</a><br>
<a href="https://lists.ausnog.net/mailman/listinfo/ausnog" rel="noreferrer" target="_blank">https://lists.ausnog.net/mailman/listinfo/ausnog</a><br>
</blockquote>
</div>
</div>
</div>

_______________________________________________<br>
AusNOG mailing list<br>
<a href="mailto:AusNOG@lists.ausnog.net" target="_blank">AusNOG@lists.ausnog.net</a><br>
<a href="https://lists.ausnog.net/mailman/listinfo/ausnog" rel="noreferrer" target="_blank">https://lists.ausnog.net/mailman/listinfo/ausnog</a><br>
</div></blockquote></div>