<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;
color:black;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Times New Roman",serif;
color:black;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";
color:black;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Times New Roman",serif;
color:black;}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:#1F497D;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;
color:black;}
span.EmailStyle23
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body bgcolor="white" lang="EN-AU" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Apparently customers were still being routed through the faulty node, essentially the equivalent of having
a dead server in a load-balanced cluster (which results in a percentage of connections not establishing). So it sounds like the faulty MME was bought back into service (accidentally). I’m not an expect, this is just the explanation offered to me by a Telstra
employee familiar with the situation…</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext"> Shane Short [mailto:shane@short.id.au]
<br>
<b>Sent:</b> Wednesday, 10 February 2016 2:37 PM<br>
<b>To:</b> Clay Quinn <cquinn@mrv.com><br>
<b>Cc:</b> ausnog@lists.ausnog.net<br>
<b>Subject:</b> Re: [AusNOG] Telstra mobile down "nationwide"<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">So from what I've been reading apparently an engineer restarted an MME without migrating the customers manually to another MME, which I assume then booted a heap of them off the network? Apparently the registration storm from that then
overloaded the remaining MME's which then caused all of the things to break?<br>
<br>
I hear they're blaming the engineer because he didn't migrate customers over to another MME, but what if they had an actual failure in the MME? It sounds like the network isn't designed to handle the resulting authentication (over)load and completely falls
over-- so as much as the engineer triggered the fault, I'm not sure it's entirely his fault that it then went to complete shit?<br>
<br>
(I'll admit I'm very green on the UTRAN/E-UTRA stuff, but it's something I have immense curiosity about, if someone can correct me, or point me in the right direction if I'm wrong here, I'd be much appreciative)<br>
<br>
-Shane<br>
<br>
Clay Quinn wrote:<br>
<br>
<o:p></o:p></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Can confirm it was indeed an MME failure…</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Cheers</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Clay
</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> AusNOG [<a href="mailto:ausnog-bounces@lists.ausnog.net">mailto:ausnog-bounces@lists.ausnog.net</a>]
<b>On Behalf Of </b>Narelle<br>
<b>Sent:</b> Tuesday, 9 February 2016 6:23 PM<br>
<b>To:</b> Joe Saxton <a href="mailto:Joe.Saxton@workforce.com.au"><Joe.Saxton@workforce.com.au></a><br>
<b>Cc:</b> <a href="mailto:ausnog@lists.ausnog.net">ausnog@lists.ausnog.net</a><br>
<b>Subject:</b> Re: [AusNOG] Telstra mobile down "nationwide"</span><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<p class="MsoNormal">Well, it is possible for a 4G HSS (HLR in the 3G world) to go down. That report however makes me think it might have been an MME... Given it was national, however, I'm thinking HSS. Though with millions of devices disconnecting and re-registering
the traffic load cascades phenomenally and all sorts of fault behaviour will appear.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Given the person in the interview didn't identify the "node", it still isn't clear exactly what went wrong at all.
<a href="http://servicestatus.telstra.com/">http://servicestatus.telstra.com/</a> doesn't really give enough clues at all.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">In the old 3G networks the RNC couldn't be set up in a redundant configuration, so if you didn't have enough, or one failed, you couldn't redirect traffic from all the connected base stations. Now you can with MMEs, and that would be consistent
with this description.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">But - it sounds more like a call server issue (CSCF) if it is affecting some fixed networks. Also it is national. Call servers you deploy more centrally.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Then again, the spokesperson also says "one of the nodes used to manage voice and data traffic between devices and the network started to malfunction" - so again I'm thinking MME...<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Narelle Clark<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">PS - 000 is a mapping rather than something embedded in the system. You condition your network for that sort of local feature. Personally I'd always go for 112 on a mobile.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<p class="MsoNormal">On Tue, Feb 9, 2016 at 5:18 PM, Joe Saxton <<a href="mailto:Joe.Saxton@workforce.com.au" target="_blank">Joe.Saxton@workforce.com.au</a>> wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">It no doubt this would have been human error. With all the redundant systems in place, you just wonder
an outage like this and this long more likely human error. </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> AusNOG
[mailto:<a href="mailto:ausnog-bounces@lists.ausnog.net" target="_blank">ausnog-bounces@lists.ausnog.net</a>]
<b>On Behalf Of </b>Cameron Murray<br>
<b>Sent:</b> Tuesday, 9 February 2016 4:45 PM<br>
<b>To:</b> James Gray <<a href="mailto:james@gray.net.au" target="_blank">james@gray.net.au</a>><br>
<b>Cc:</b> <a href="mailto:ausnog@lists.ausnog.net" target="_blank">ausnog@lists.ausnog.net</a><br>
<b>Subject:</b> Re: [AusNOG] Telstra mobile down "nationwide"</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><a href="http://www.9news.com.au/technology/2016/02/09/13/11/reports-of-telstra-mobile-services-outage" target="_blank">http://www.9news.com.au/technology/2016/02/09/13/11/reports-of-telstra-mobile-services-outage</a><o:p></o:p></p>
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Keep backing up the bus...<o:p></o:p></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">On Tue, Feb 9, 2016 at 2:54 PM, James Gray <<a href="mailto:james@gray.net.au" target="_blank">james@gray.net.au</a>> wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt">In addition to the traditional swiss-army knife known as "telnet", getting "curl" to dump just the HTTP headers is also a handy one to keep up your sleeve:<o:p></o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">0:><b>curl -I
<a href="http://triplezero.com.au" target="_blank">http://triplezero.com.au</a></b><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">HTTP/1.1 200 OK<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Connection: close<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Date: Tue, 09 Feb 2016 04:45:18 GMT<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Server: Microsoft-IIS/6.0<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">X-Powered-By:
<a href="http://ASP.NET" target="_blank">ASP.NET</a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Content-Type: text/html; charset=UTF-8<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt">Also telnet wont work with SSL sites (ie, https), but if you have openssl installed, you can do this instead:<o:p></o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">0:><b>openssl s_client -quiet -connect
<a href="http://www.google.com:443" target="_blank">www.google.com:443</a></b><o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">The openssl method also works on other SSL-enabled service like POP3S and IMAPS etc. I have it aliased in my shell config:<br>
<b>alias stelnet="openssl s_client -quiet -connect"</b><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">...then all I need to do is: "stelnet host:port"<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Just good to have tucked away in case you need to break out the command-line hammer.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Cheers,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">James<o:p></o:p></p>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">On 9 February 2016 at 15:15, Ross Wheeler <<a href="mailto:ausnog@rossw.net" target="_blank">ausnog@rossw.net</a>> wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt"><br>
<br>
On Tue, 9 Feb 2016, Shane Chrisp wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Yep, that was just my fat fingers. I am trying to get to the
<a href="http://triplezero.com.au" target="_blank">triplezero.com.au</a> but no go.<o:p></o:p></p>
</blockquote>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">traceroute to
<a href="http://www.triplezero.gov.au" target="_blank">www.triplezero.gov.au</a> (115.178.104.72), 30 hops max, 60 byte
<o:p></o:p></p>
</blockquote>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">...<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">11
<a href="http://bundle-ether2.civ.core2.canberra.telstra.net" target="_blank">bundle-ether2.civ.core2.canberra.telstra.net</a> (203.50.6.82) 71.834 ms 71.845 ms 70.450 ms<br>
12 <a href="http://Bundle-Ethernet1.civ-edge901.canberra.telstra.net" target="_blank">
Bundle-Ethernet1.civ-edge901.canberra.telstra.net</a> (203.50.8.35) 69.126 ms 69.138 ms 69.042 ms<br>
13 <a href="http://telstr1248.lnk.telstra.net" target="_blank">telstr1248.lnk.telstra.net</a> (165.228.21.206) 68.991 ms 68.981 ms 68.926 ms<br>
14 * * *<br>
15 * * *<br>
16 * * *<o:p></o:p></p>
</blockquote>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><br>
<br>
Traceroute is only one tool in a toolbox, and frequently not as helpful as you might hope.<br>
<br>
5 <a href="http://bundle-ether2.chw-edge902.sydney.telstra.net" target="_blank">
bundle-ether2.chw-edge902.sydney.telstra.net</a> (203.50.11.105) 2.002 ms<br>
6 <a href="http://bundle-ether2.dkn-core1.canberra.telstra.net" target="_blank">
bundle-ether2.dkn-core1.canberra.telstra.net</a> (203.50.6.129) 8.918 ms<br>
7 <a href="http://bundle-ether2.civ.core2.canberra.telstra.net" target="_blank">
bundle-ether2.civ.core2.canberra.telstra.net</a> (203.50.6.82) 9.334 ms<br>
8 <a href="http://Bundle-Ethernet1.civ-edge901.canberra.telstra.net" target="_blank">
Bundle-Ethernet1.civ-edge901.canberra.telstra.net</a> (203.50.8.35) 7.822 ms<br>
9 <a href="http://telstr1248.lnk.telstra.net" target="_blank">telstr1248.lnk.telstra.net</a> (165.228.21.206) 9.189 ms<br>
10 *<br>
11 *<br>
<br>
Yes, it appear to not be reachable....<br>
<br>
However using another tool it clearly IS working....<br>
<br>
# telnet <a href="http://triplezero.gov.au" target="_blank">triplezero.gov.au</a> 80<br>
Trying 2403:d500::48...<br>
telnet: connect to address 2403:d500::48: No route to host<br>
Trying 115.178.104.72...<br>
Connected to <a href="http://triplezero.gov.au" target="_blank">triplezero.gov.au</a>.<br>
Escape character is '^]'.<br>
GET / http/1.0<br>
<br>
HTTP/1.1 403 Forbidden<br>
Cache-Control: no-cache<br>
<br>
<br>
<br>
There's also a hint there....<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><br>
_______________________________________________<br>
AusNOG mailing list<br>
<a href="mailto:AusNOG@lists.ausnog.net" target="_blank">AusNOG@lists.ausnog.net</a><br>
<a href="http://lists.ausnog.net/mailman/listinfo/ausnog" target="_blank">http://lists.ausnog.net/mailman/listinfo/ausnog</a><o:p></o:p></p>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
</div>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt"><br>
_______________________________________________<br>
AusNOG mailing list<br>
<a href="mailto:AusNOG@lists.ausnog.net" target="_blank">AusNOG@lists.ausnog.net</a><br>
<a href="http://lists.ausnog.net/mailman/listinfo/ausnog" target="_blank">http://lists.ausnog.net/mailman/listinfo/ausnog</a><o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
</div>
</div>
</div>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="4" width="100%" align="center">
</div>
<div>
<p class="MsoNormal"><strong><span style="font-size:7.5pt;font-family:"Arial",sans-serif">Note:</span></strong><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Arial",sans-serif">This message is for the named person's use only. It may contain confidential, proprietary or legally privileged information. No confidentiality or privilege is waived or lost
by any mistransmission. If you receive this message in error, please immediately delete it and all copies of it from your system, destroy any hard copies of it and notify the sender. You must not, directly or indirectly, use, disclose, distribute, print,
or copy any part of this message if you are not the intended recipient. </span><strong><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:red">Workforce International Pty Ltd</span></strong><strong><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#400080">
</span></strong><span style="font-size:7.5pt;font-family:"Arial",sans-serif">and any of its subsidiaries each reserve the right to monitor all e-mail communications through its networks. Any views expressed in this message are those of the individual sender,
except where the message states otherwise and the sender is authorised to state them to be the views of any such entity.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div class="MsoNormal" align="center" style="text-align:center"><span style="font-family:"Arial",sans-serif">
<hr size="4" width="100%" align="center">
</span></div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
_______________________________________________<br>
AusNOG mailing list<br>
<a href="mailto:AusNOG@lists.ausnog.net">AusNOG@lists.ausnog.net</a><br>
<a href="http://lists.ausnog.net/mailman/listinfo/ausnog" target="_blank">http://lists.ausnog.net/mailman/listinfo/ausnog</a><o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<o:p></o:p></p>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<p class="MsoNormal">-- <o:p></o:p></p>
<div>
<p class="MsoNormal"><br>
<br>
Narelle<br>
<a href="mailto:narellec@gmail.com" target="_blank">narellec@gmail.com</a><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><a href="http://www.mrv.com/blog"><span style="text-decoration:none"><img border="0" id="_x0000_i1027" src="http://www.mrv.com/images/Blog_Banner.jpg" alt="E-Banner"></span></a><br>
<o:p></o:p></p>
<div>
<p style="mso-line-height-alt:8.0pt;background:white"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#B8B9C8">MRV Communications is a global supplier of packet and optical solutions that power the world’s largest networks. Our products combine
innovative hardware with intelligent software to make networks smarter, faster and more efficient.<o:p></o:p></span></p>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<p style="line-height:8.0pt;background:white"><span style="font-size:8.0pt;font-family:"Arial",sans-serif;color:#B8B9C8">The contents of this message, together with any attachments, are intended only for the use of the person(s) to whom they are addressed and
may contain confidential and/or privileged information. If you are not the intended recipient, immediately advise the sender, delete this message and any attachments and note that any distribution, or copying of this message, or any attachment, is prohibited.<o:p></o:p></span></p>
</div>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>AusNOG mailing list<o:p></o:p></pre>
<pre><a href="mailto:AusNOG@lists.ausnog.net">AusNOG@lists.ausnog.net</a><o:p></o:p></pre>
<pre><a href="http://lists.ausnog.net/mailman/listinfo/ausnog">http://lists.ausnog.net/mailman/listinfo/ausnog</a><o:p></o:p></pre>
</blockquote>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<a href="http://www.mrv.com/blog"><img src="http://www.mrv.com/images/Blog_Banner.jpg" alt="E-Banner"></a><br>
<br>
<div style="background-color:#FFFFFF; padding:.8em; ">
<p style="font-size:10pt;color:#b8b9c8; line-height:8pt; font-family:
'arial','times roman',serif;">
MRV Communications is a global supplier of packet and optical solutions that power the world’s largest networks. Our products combine innovative hardware with intelligent software to make networks smarter, faster and more efficient.</p>
</div>
<br>
<div style="background-color:#FFFFFF; padding:.8em; ">
<p style="font-size:8pt;color:#b8b9c8; line-height:8pt; font-family:
'arial','times roman',serif;">
The contents of this message, together with any attachments, are intended only for the use of the person(s) to whom they are addressed and may contain confidential and/or privileged information. If you are not the intended recipient, immediately advise the
sender, delete this message and any attachments and note that any distribution, or copying of this message, or any attachment, is prohibited.</p>
</div>
</body>
</html>