<div dir="ltr"><br><div>Well, it is possible for a 4G HSS (HLR in the 3G world) to go down. That report however makes me think it might have been an MME... Given it was national, however, I'm thinking HSS. Though with millions of devices disconnecting and re-registering the traffic load cascades phenomenally and all sorts of fault behaviour will appear.</div><div><br></div><div>Given the person in the interview didn't identify the "node", it still isn't clear exactly what went wrong at all. <a href="http://servicestatus.telstra.com/">http://servicestatus.telstra.com/</a> doesn't really give enough clues at all.</div><div><br></div><div>In the old 3G networks the RNC couldn't be set up in a redundant configuration, so if you didn't have enough, or one failed, you couldn't redirect traffic from all the connected base stations. Now you can with MMEs, and that would be consistent with this description.</div><div><br></div><div>But - it sounds more like a call server issue (CSCF) if it is affecting some fixed networks. Also it is national. Call servers you deploy more centrally.</div><div><br></div><div>Then again, the spokesperson also says "one of the nodes used to manage voice and data traffic between devices and the network started to malfunction" - so again I'm thinking MME...</div><div><br></div><div><br></div><div>Narelle Clark</div><div><br></div><div><br></div><div>PS - 000 is a mapping rather than something embedded in the system. You condition your network for that sort of local feature. Personally I'd always go for 112 on a mobile.</div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Feb 9, 2016 at 5:18 PM, Joe Saxton <span dir="ltr"><<a href="mailto:Joe.Saxton@workforce.com.au" target="_blank">Joe.Saxton@workforce.com.au</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div lang="EN-AU" link="blue" vlink="purple"><div><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">It no doubt this would have been human error. With all the redundant systems in place, you just wonder an outage like this and this long more likely human error. <u></u><u></u></span></p><span class=""><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> AusNOG [mailto:<a href="mailto:ausnog-bounces@lists.ausnog.net" target="_blank">ausnog-bounces@lists.ausnog.net</a>] <b>On Behalf Of </b>Cameron Murray<br><b>Sent:</b> Tuesday, 9 February 2016 4:45 PM<br><b>To:</b> James Gray <<a href="mailto:james@gray.net.au" target="_blank">james@gray.net.au</a>><br><b>Cc:</b> <a href="mailto:ausnog@lists.ausnog.net" target="_blank">ausnog@lists.ausnog.net</a><br><b>Subject:</b> Re: [AusNOG] Telstra mobile down "nationwide"<u></u><u></u></span></p><p class="MsoNormal"><u></u> <u></u></p></span><div><p class="MsoNormal"><a href="http://www.9news.com.au/technology/2016/02/09/13/11/reports-of-telstra-mobile-services-outage" target="_blank">http://www.9news.com.au/technology/2016/02/09/13/11/reports-of-telstra-mobile-services-outage</a><u></u><u></u></p><div><div class="h5"><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">Keep backing up the bus...<u></u><u></u></p></div></div></div></div><div><div class="h5"><div><p class="MsoNormal"><u></u> <u></u></p><div><p class="MsoNormal">On Tue, Feb 9, 2016 at 2:54 PM, James Gray <<a href="mailto:james@gray.net.au" target="_blank">james@gray.net.au</a>> wrote:<u></u><u></u></p><blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm"><div><p class="MsoNormal" style="margin-bottom:12.0pt">In addition to the traditional swiss-army knife known as "telnet", getting "curl" to dump just the HTTP headers is also a handy one to keep up your sleeve:<u></u><u></u></p><div><p class="MsoNormal">0:><b>curl -I <a href="http://triplezero.com.au" target="_blank">http://triplezero.com.au</a></b><u></u><u></u></p></div><div><p class="MsoNormal">HTTP/1.1 200 OK<u></u><u></u></p></div><div><p class="MsoNormal">Connection: close<u></u><u></u></p></div><div><p class="MsoNormal">Date: Tue, 09 Feb 2016 04:45:18 GMT<u></u><u></u></p></div><div><p class="MsoNormal">Server: Microsoft-IIS/6.0<u></u><u></u></p></div><div><p class="MsoNormal">X-Powered-By: <a href="http://ASP.NET" target="_blank">ASP.NET</a><u></u><u></u></p></div><div><p class="MsoNormal">Content-Type: text/html; charset=UTF-8<u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal" style="margin-bottom:12.0pt">Also telnet wont work with SSL sites (ie, https), but if you have openssl installed, you can do this instead:<u></u><u></u></p><div><p class="MsoNormal">0:><b>openssl s_client -quiet -connect <a href="http://www.google.com:443" target="_blank">www.google.com:443</a></b><u></u><u></u></p></div></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">The openssl method also works on other SSL-enabled service like POP3S and IMAPS etc. I have it aliased in my shell config:<br><b>alias stelnet="openssl s_client -quiet -connect"</b><u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">...then all I need to do is: "stelnet host:port"<u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">Just good to have tucked away in case you need to break out the command-line hammer.<u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">Cheers,<u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">James<u></u><u></u></p></div></div><div><div><div><p class="MsoNormal"><u></u> <u></u></p><div><p class="MsoNormal">On 9 February 2016 at 15:15, Ross Wheeler <<a href="mailto:ausnog@rossw.net" target="_blank">ausnog@rossw.net</a>> wrote:<u></u><u></u></p><blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm"><p class="MsoNormal" style="margin-bottom:12.0pt"><br><br>On Tue, 9 Feb 2016, Shane Chrisp wrote:<u></u><u></u></p><blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm"><p class="MsoNormal">Yep, that was just my fat fingers. I am trying to get to the <a href="http://triplezero.com.au" target="_blank">triplezero.com.au</a> but no go.<u></u><u></u></p></blockquote><p class="MsoNormal"><u></u> <u></u></p><blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm"><p class="MsoNormal">traceroute to <a href="http://www.triplezero.gov.au" target="_blank">www.triplezero.gov.au</a> (115.178.104.72), 30 hops max, 60 byte <u></u><u></u></p></blockquote><p class="MsoNormal">...<u></u><u></u></p><blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm"><p class="MsoNormal">11 <a href="http://bundle-ether2.civ.core2.canberra.telstra.net" target="_blank">bundle-ether2.civ.core2.canberra.telstra.net</a> (203.50.6.82) 71.834 ms 71.845 ms 70.450 ms<br>12 <a href="http://Bundle-Ethernet1.civ-edge901.canberra.telstra.net" target="_blank">Bundle-Ethernet1.civ-edge901.canberra.telstra.net</a> (203.50.8.35) 69.126 ms 69.138 ms 69.042 ms<br>13 <a href="http://telstr1248.lnk.telstra.net" target="_blank">telstr1248.lnk.telstra.net</a> (165.228.21.206) 68.991 ms 68.981 ms 68.926 ms<br>14 * * *<br>15 * * *<br>16 * * *<u></u><u></u></p></blockquote><p class="MsoNormal"><br><br>Traceroute is only one tool in a toolbox, and frequently not as helpful as you might hope.<br><br> 5 <a href="http://bundle-ether2.chw-edge902.sydney.telstra.net" target="_blank">bundle-ether2.chw-edge902.sydney.telstra.net</a> (203.50.11.105) 2.002 ms<br> 6 <a href="http://bundle-ether2.dkn-core1.canberra.telstra.net" target="_blank">bundle-ether2.dkn-core1.canberra.telstra.net</a> (203.50.6.129) 8.918 ms<br> 7 <a href="http://bundle-ether2.civ.core2.canberra.telstra.net" target="_blank">bundle-ether2.civ.core2.canberra.telstra.net</a> (203.50.6.82) 9.334 ms<br> 8 <a href="http://Bundle-Ethernet1.civ-edge901.canberra.telstra.net" target="_blank">Bundle-Ethernet1.civ-edge901.canberra.telstra.net</a> (203.50.8.35) 7.822 ms<br> 9 <a href="http://telstr1248.lnk.telstra.net" target="_blank">telstr1248.lnk.telstra.net</a> (165.228.21.206) 9.189 ms<br>10 *<br>11 *<br><br>Yes, it appear to not be reachable....<br><br>However using another tool it clearly IS working....<br><br># telnet <a href="http://triplezero.gov.au" target="_blank">triplezero.gov.au</a> 80<br>Trying 2403:d500::48...<br>telnet: connect to address 2403:d500::48: No route to host<br>Trying 115.178.104.72...<br>Connected to <a href="http://triplezero.gov.au" target="_blank">triplezero.gov.au</a>.<br>Escape character is '^]'.<br>GET / http/1.0<br><br>HTTP/1.1 403 Forbidden<br>Cache-Control: no-cache<br><br><br><br>There's also a hint there....<u></u><u></u></p><div><div><p class="MsoNormal"><br>_______________________________________________<br>AusNOG mailing list<br><a href="mailto:AusNOG@lists.ausnog.net" target="_blank">AusNOG@lists.ausnog.net</a><br><a href="http://lists.ausnog.net/mailman/listinfo/ausnog" target="_blank">http://lists.ausnog.net/mailman/listinfo/ausnog</a><u></u><u></u></p></div></div></blockquote></div><p class="MsoNormal"><u></u> <u></u></p></div></div></div><p class="MsoNormal" style="margin-bottom:12.0pt"><br>_______________________________________________<br>AusNOG mailing list<br><a href="mailto:AusNOG@lists.ausnog.net" target="_blank">AusNOG@lists.ausnog.net</a><br><a href="http://lists.ausnog.net/mailman/listinfo/ausnog" target="_blank">http://lists.ausnog.net/mailman/listinfo/ausnog</a><u></u><u></u></p></blockquote></div><p class="MsoNormal"><u></u> <u></u></p></div></div></div></div>
<p><img></p><span class="">
<p>
</p><p>
</p><hr>
<p></p>
<p></p>
<div><strong><font size="1" face="Arial">Note:</font></strong></div>
<div><font size="1" face="Arial">This message is for the named person's use
only. It may contain confidential, proprietary or legally privileged
information. No confidentiality or privilege is waived or lost by any
mistransmission. If you receive this message in error, please
immediately delete it and all copies of it from your system, destroy any hard
copies of it and notify the sender. You must not, directly or indirectly,
use, disclose, distribute, print, or copy any part of this message if you are
not the intended recipient. <strong><font color="#ff8000"><font color="#400080"><font color="#ff0000">Workforce International Pty Ltd</font>
</font></font></strong>and any of its subsidiaries each reserve the right to
monitor all e-mail communications through its networks. Any views expressed in
this message are those of the individual sender, except where the message states
otherwise and the sender is authorised to state them to be the views of any such
entity.</font></div>
<div><font face="Arial"></font> </div><font face="Arial">
<hr>
</font>
<p></p><p></p></span></div><br>_______________________________________________<br>
AusNOG mailing list<br>
<a href="mailto:AusNOG@lists.ausnog.net">AusNOG@lists.ausnog.net</a><br>
<a href="http://lists.ausnog.net/mailman/listinfo/ausnog" rel="noreferrer" target="_blank">http://lists.ausnog.net/mailman/listinfo/ausnog</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><br><br>Narelle<br><a href="mailto:narellec@gmail.com" target="_blank">narellec@gmail.com</a></div>
</div>