<span id="mailbox-conversation">I spoke to the NOC around 9:40 and they said they were sending it/had just sent it, but got it same time as you. I assumed that because they were having issues it didn't send properly.<div><br></div>
<div>Andrew</div></span><div class="mailbox_signature">-- <br>Andrew Yager, Managing Director   MACS (Snr) CP BCompSc MCP<br>Real World Technology Solutions Pty Ltd - IT people you can trust<br>ph: 1300 798 718 or (02) 9037 0500<br>fax: (02) 9037 0591<br>http://www.rwts.com.au/</div>
<br><br><div class="gmail_quote"><p>On Sun, Aug 24, 2014 at 9:49 AM, Travers Stark <span dir="ltr"><<a href="mailto:travers@starkie.net" target="_blank">travers@starkie.net</a>></span> wrote:<br></p><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;"><div class="WordSection1">
<p class="MsoNormal"><span style='font-size:8.0pt;font-family:"Verdana","sans-serif";color:#1F497D'>Out of interest, what time did everyone get the outage email?. Ours only came through at 22:30 but from what I can see the issue started at about 21:30 AEST<p></p></span></p>
<p class="MsoNormal"><span style='font-size:8.0pt;font-family:"Verdana","sans-serif";color:#1F497D'><p> </p></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span lang="EN-US" style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> AusNOG [mailto:ausnog-bounces@lists.ausnog.net]
<b>On Behalf Of </b>Andrew Yager<br><b>Sent:</b> Saturday, 23 August 2014 11:14 PM<br><b>To:</b> Tony Wicks<br><b>Cc:</b> ausnog@lists.ausnog.net<br><b>Subject:</b> Re: [AusNOG] Vocus international service outage<p></p></span></p>
<p class="MsoNormal"></p>
<p> </p>
<div>
<p class="MsoNormal">I still can't ping Level 3 via our interconnect IP address…</p>
<p></p>
<div>
<p class="MsoNormal"></p>
<p> </p>
</div>
<div>
<p class="MsoNormal">Andrew</p>
<p></p>
</div>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"></p>
<p> </p>
<div>
<p class="MsoNormal">On 23 August 2014 23:11, Tony Wicks <<a href="mailto:tony@wicks.co.nz">tony@wicks.co.nz</a>> wrote:</p>
<p></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ" style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>It seems to have just recovered.</span><span lang="EN-NZ"><p></p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ" style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><span lang="EN-NZ"><p></p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US" style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>From:</span></b><span lang="EN-US" style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>
 Andrew Yager [mailto:<a href="mailto:andrew@rwts.com.au">andrew@rwts.com.au</a>]
<br><b>Sent:</b> Sunday, 24 August 2014 1:08 a.m.<br><b>To:</b> Tony Wicks<br><b>Cc:</b> Jared Hirst; <a href="mailto:ausnog@lists.ausnog.net">
ausnog@lists.ausnog.net</a></span><span lang="EN-NZ"><p></p></span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-NZ"><br><b>Subject:</b> Re: [AusNOG] Vocus international service outage<p></p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ"> <p></p></span></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ">Does anyone know if the tainted routes from Vocus are tagged in any useful way? I'd love to turn Vocus back on, but add our routes to no-export their US transit
 and drop the US routes from them (keeping domestic Optus and Telstra).<p></p></span></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ"> <p></p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ">Having the peer shut I can't look to see if there are any defining markers…<p></p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ"> <p></p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ">Andrew<p></p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ"> <p></p></span></p>
</div>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt"><span lang="EN-NZ"> <p></p></span></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ">On 23 August 2014 22:59, Tony Wicks <<a href="mailto:tony@wicks.co.nz">tony@wicks.co.nz</a>> wrote:<p></p></span></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ" style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>I have seen the peers drop down into the 300k’s then back up to the current 503k.</span><span lang="EN-NZ"><p></p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ" style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><span lang="EN-NZ"><p></p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ" style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>icore1-w.inet.0: 386612</span><span lang="EN-NZ"><p></p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ" style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><span lang="EN-NZ"><p></p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US" style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>From:</span></b><span lang="EN-US" style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>
 AusNOG [mailto:<a href="mailto:ausnog-bounces@lists.ausnog.net">ausnog-bounces@lists.ausnog.net</a>]
<b>On Behalf Of </b>Jared Hirst<br><b>Sent:</b> Sunday, 24 August 2014 12:54 a.m.<br><b>To:</b> Matt Perkins<br><b>Cc:</b> <a href="mailto:ausnog@lists.ausnog.net">ausnog@lists.ausnog.net</a></span><span lang="EN-NZ"><p></p></span></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ"><br><b>Subject:</b> Re: [AusNOG] Vocus international service outage<p></p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ"> <p></p></span></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ" style='font-family:"Trebuchet MS","sans-serif";color:black'>It does seem to be similar, as the link is flapping in and out and there is no actual loss in routes.</span><span lang="EN-NZ"><p></p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt"><span lang="EN-NZ"> <p></p></span></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ">On Sat, Aug 23, 2014 at 10:50 PM, Matt Perkins <<a href="mailto:matt@spectrum.com.au">matt@spectrum.com.au</a>> wrote:<p></p></span></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ">Something is afoot. This is the second Transit provider via NZ that we have had to drop tonight. They were in the path of a DDOS. Perhaps Vocus are also. Someone
 seems to be a target in NZ. I think. <br><span style="color:#888888"><br>
Matt</span><p></p></span></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ"><br><br><br>
On 23/08/2014 10:44 pm, Matt Taylor wrote:<p></p></span></p>
</div>
</div>
</div>
<div>
<div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ">Can also confirm this, we (Digital Pacific) have now shutdown our Vocus transit..<br><br>
Regards,<br>
Matt T.<br><br>
On 23/08/2014 22:43, Mark Dignam wrote:<p></p></span></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ" style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>I can confirm, they have _<i>not</i>_ routed around the issue which is… annoying.
</span><span lang="EN-NZ"><p></p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ" style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><span lang="EN-NZ"><p></p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ" style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oh well, just have to leave that particular BGP neighbour off until I get a “resolved”
 email.</span><span lang="EN-NZ"><p></p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ" style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><span lang="EN-NZ"><p></p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ" style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Dig.</span><span lang="EN-NZ"><p></p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ" style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><span lang="EN-NZ"><p></p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US" style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span lang="EN-US" style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> AusNOG
 [<a href="mailto:ausnog-bounces@lists.ausnog.net">mailto:ausnog-bounces@lists.ausnog.net</a>]
<b>On Behalf Of </b>Jared Hirst<br><b>Sent:</b> Saturday, 23 August 2014 8:35 PM<br><b>To:</b> Andrew Cox<br><b>Cc:</b> <a href="mailto:Ausnog@ausnog.net">Ausnog@ausnog.net</a><br><b>Subject:</b> Re: [AusNOG] Vocus international service outage</span><span lang="EN-NZ"><p></p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ"> <p></p></span></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ">Yeah we are seeing this! Everything running via them is flapping, they claim to have 'routed around it' but that's not the case. Very frustrating as it's been
 an hour and no one there seems to know whats going on....<p></p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt"><span lang="EN-NZ"> <p></p></span></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ">On Sat, Aug 23, 2014 at 10:29 PM, Andrew Cox <<a href="mailto:andrew.cox@bigair.net.au">andrew.cox@bigair.net.au</a>> wrote:<p></p></span></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ">Hey All,<br><br>
Just saw the dashboards light up with connectivity issues internationally for Vocus services and thought I'd make others aware.<br><br>
Vocus outage report is saying: "core network link between 59 Doody Street, Alexandria and 55 South Market Street, San Jose has failed" which hopefully isn't a Southern Cross fault!<br><br>
Anyone else seeing this or have more info?<p></p></span></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ"> <p></p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ">Cheers,<p></p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt"><span lang="EN-NZ">Andrew<p></p></span></p>
</div>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt"><span lang="EN-NZ"><br>
_______________________________________________<br>
AusNOG mailing list<br><a href="mailto:AusNOG@lists.ausnog.net">AusNOG@lists.ausnog.net</a><br><a href="http://lists.ausnog.net/mailman/listinfo/ausnog">http://lists.ausnog.net/mailman/listinfo/ausnog</a><p></p></span></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ"><br><br clear="all"><p></p></span></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ"> <p></p></span></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ">--
<p></p></span></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ"> <p></p></span></p>
</div>
</div>
</div>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt"><span lang="EN-NZ"> <p></p></span></p>
<pre><span lang="EN-NZ">_______________________________________________<p></p></span></pre>
<pre><span lang="EN-NZ">AusNOG mailing list<p></p></span></pre>
<pre><span lang="EN-NZ"><a href="mailto:AusNOG@lists.ausnog.net">AusNOG@lists.ausnog.net</a><p></p></span></pre>
<pre><span lang="EN-NZ"><a href="http://lists.ausnog.net/mailman/listinfo/ausnog">http://lists.ausnog.net/mailman/listinfo/ausnog</a><p></p></span></pre>
</blockquote>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt"><span lang="EN-NZ"> <p></p></span></p>
<pre><span lang="EN-NZ">_______________________________________________<p></p></span></pre>
<pre><span lang="EN-NZ">AusNOG mailing list<p></p></span></pre>
<pre><span lang="EN-NZ"><a href="mailto:AusNOG@lists.ausnog.net">AusNOG@lists.ausnog.net</a><p></p></span></pre>
<pre><span lang="EN-NZ"><a href="http://lists.ausnog.net/mailman/listinfo/ausnog">http://lists.ausnog.net/mailman/listinfo/ausnog</a><p></p></span></pre>
</blockquote>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ"> <p></p></span></p>
</div>
</div>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt"><span lang="EN-NZ"><br>
_______________________________________________<br>
AusNOG mailing list<br><a href="mailto:AusNOG@lists.ausnog.net">AusNOG@lists.ausnog.net</a><br><a href="http://lists.ausnog.net/mailman/listinfo/ausnog">http://lists.ausnog.net/mailman/listinfo/ausnog</a><p></p></span></p>
</blockquote>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ"><br><br clear="all"><p></p></span></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ"> <p></p></span></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ">--
<p></p></span></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ"> <p></p></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt"><span lang="EN-NZ"><br>
_______________________________________________<br>
AusNOG mailing list<br><a href="mailto:AusNOG@lists.ausnog.net">AusNOG@lists.ausnog.net</a><br><a href="http://lists.ausnog.net/mailman/listinfo/ausnog">http://lists.ausnog.net/mailman/listinfo/ausnog</a><p></p></span></p>
</blockquote>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ"><br><br clear="all"><p></p></span></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ"> <p></p></span></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-NZ">--
<br><b>Andrew Yager, Managing Director</b>   <i>MACS (Snr) CP BCompSc MCP</i><br>
Real World Technology Solutions Pty Ltd - IT people you can trust<br>
ph: <a href="tel:1300%20798%20718">1300 798 718</a> or <a href="tel:%2802%29%209037%200500">
(02) 9037 0500</a><br>
fax: <a href="tel:%2802%29%209037%200591">(02) 9037 0591</a><br><a href="http://www.rwts.com.au/">http://www.rwts.com.au/</a><p></p></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><br><br clear="all"></p>
<p></p>
<div>
<p class="MsoNormal"></p>
<p> </p>
</div>
<p class="MsoNormal">-- <br><b>Andrew Yager, Managing Director</b>   <i>MACS (Snr) CP BCompSc MCP</i><br>
Real World Technology Solutions Pty Ltd - IT people you can trust<br>
ph: 1300 798 718 or (02) 9037 0500<br>
fax: (02) 9037 0591<br><a href="http://www.rwts.com.au/">http://www.rwts.com.au/</a></p>
<p></p>
</div>
</div></blockquote></div><br>