[AusNOG] NSW-IX - Doody Street - Flap?

Matt Perkins matt at spectrum.com.au
Fri Apr 1 10:29:08 EST 2016


This looks a lot like what I was seeing last week when things transited 
Vocus on the IX. I set the community that stopped sending Vocus our 
prefixes and it solved everything. (Then again we do have a Several 
direct peers with Vocus which are the payed varirty so we assuemed it 
was some sort of filter to point traffic down the money path)


Matt

On 1/04/2016 10:19 AM, Glenn Slaven wrote:
> Hi Joe,
>
> unfortunately I'm only in a position to provide outgoing traceroutes, 
> we're just running VMs on AWS.
>
> Here's an few sample traces running tcptraceroute -w 1 202.4.235.221 
> 80 -f 5 -m 11
>
> Selected device eth0, address 10.0.0.128, port 52199 for outgoing packets
> Tracing the path to 202.4.235.221 on TCP port 80 (http), 11 hops max
>   5as4826.nsw.ix.asn.au <http://as4826.nsw.ix.asn.au>  (218.100.52.6)  2.097 ms  3.388 ms  2.011 ms
>   6bundle-100.cor03.syd03.nsw.VOCUS.net.au 
> <http://bundle-100.cor03.syd03.nsw.VOCUS.net.au>  (114.31.192.44)  1.566 ms  1.668 ms  1.461 ms
>   7ten-1-2-0.bdr03.syd03.nsw.VOCUS.net.au 
> <http://ten-1-2-0.bdr03.syd03.nsw.VOCUS.net.au>  (114.31.192.53)  1.192 ms  1.194 ms  1.159 ms
>   8  180.189.25.210  1.442 ms  1.461 ms  1.421 ms
>   9vl2.rack42-core1.syd1.anchor.net.au 
> <http://vl2.rack42-core1.syd1.anchor.net.au>  (110.173.158.46)  1.802 ms  1.768 ms  1.778 ms
> 10www.booktopia.com.au <http://www.booktopia.com.au>  (202.4.235.221) [open]  1.532 ms  1.528 ms  1.540 ms
> Thu Mar 31 18:46:13 UTC 2016
> Selected device eth0, address 10.0.0.128, port 35794 for outgoing packets
> Tracing the path to 202.4.235.221 on TCP port 80 (http), 11 hops max
>   5as4826.nsw.ix.asn.au <http://as4826.nsw.ix.asn.au>  (218.100.52.6)  1.989 ms  1.966 ms  2.022 ms
>   6bundle-100.cor03.syd03.nsw.VOCUS.net.au 
> <http://bundle-100.cor03.syd03.nsw.VOCUS.net.au>  (114.31.192.44)  1.539 ms  1.831 ms  1.548 ms
>   7ten-2-1-0.bdr03.syd03.nsw.VOCUS.net.au 
> <http://ten-2-1-0.bdr03.syd03.nsw.VOCUS.net.au>  (114.31.192.43)  1.191 ms  1.199 ms  1.253 ms
>   8  180.189.25.210  1.496 ms  1.438 ms  1.487 ms
>   9vl2.rack42-core1.syd1.anchor.net.au 
> <http://vl2.rack42-core1.syd1.anchor.net.au>  (110.173.158.46)  1.868 ms  1.816 ms  2.468 ms
> 10www.booktopia.com.au <http://www.booktopia.com.au>  (202.4.235.221) [open]  1.572 ms  1.568 ms^C
> root at ip-10-0-0-128:/tmp# while true; do tcptraceroute -w 1 202.4.235.221 80 -f 4 -m 11; date; done
> Selected device eth0, address 10.0.0.128, port 41762 for outgoing packets
> Tracing the path to 202.4.235.221 on TCP port 80 (http), 11 hops max
>   4  52.95.36.17  15.028 ms  1.349 ms  1.369 ms
>   5  * * *
>   6  * * *
>   7  * * *
>   8  * * *
>   9  * * *
> 10  * * *
> 11  * * *
> Destination not reached
> Thu Mar 31 18:46:40 UTC 2016
> Selected device eth0, address 10.0.0.128, port 35944 for outgoing packets
> Tracing the path to 202.4.235.221 on TCP port 80 (http), 11 hops max
>   4  52.95.36.129  1.435 ms  1.276 ms  1.262 ms
>   5as4826.nsw.ix.asn.au <http://as4826.nsw.ix.asn.au>  (218.100.52.6)  1.995 ms  1.890 ms  4.014 ms
>   6bundle-100.cor03.syd03.nsw.VOCUS.net.au 
> <http://bundle-100.cor03.syd03.nsw.VOCUS.net.au>  (114.31.192.44)  1.755 ms  1.771 ms  1.658 ms
>   7ten-2-1-0.bdr03.syd03.nsw.VOCUS.net.au 
> <http://ten-2-1-0.bdr03.syd03.nsw.VOCUS.net.au>  (114.31.192.43)  1.185 ms  1.303 ms  1.168 ms
>   8  180.189.25.210  1.589 ms  1.428 ms  1.423 ms
>   9vl2.rack42-core1.syd1.anchor.net.au 
> <http://vl2.rack42-core1.syd1.anchor.net.au>  (110.173.158.46)  1.822 ms  1.827 ms  2.440 ms
> 10www.booktopia.com.au <http://www.booktopia.com.au>  (202.4.235.221) [open]  1.540 ms  1.585 ms  1.609 ms
> Thu Mar 31 18:46:42 UTC 2016
> Selected device eth0, address 10.0.0.128, port 57310 for outgoing packets
> Tracing the path to 202.4.235.221 on TCP port 80 (http), 11 hops max
>   4  52.95.36.65  1.306 ms  1.294 ms  1.299 ms
>   5  * * *
>   6  * * *
>   7  * * *
>   8  * * *
>   9  * * *
> 10  * * *
> 11  * * *
> Destination not reached
>
> On 1 April 2016 at 09:53, Joe Wooller <joe at waia.asn.au 
> <mailto:joe at waia.asn.au>> wrote:
>
>     Hi Glenn,
>
>     If you are still having issues please send me as much information
>     as you can so I can figure out what is going on and if it is
>     related to the issues started to experience over the last couple
>     of days.
>
>     Can you provide trace routes/pings etc from both directions.
>     Can you ping the peers address from your peering address.
>     Do you get ARP ok?
>
>     Thanks
>     Joe
>
>>     On 31 Mar 2016, at 11:33 PM, Glenn Slaven <glenn at section.io
>>     <mailto:glenn at section.io>> wrote:
>>
>>     Not sure if this is related, but from around 9:20pm ADST we've
>>     been getting connection timeouts between our Sydney AWS nodes and
>>     various origin servers (we run http reverse proxies).  The issue
>>     isn't happening from other AWS locations that we tried and is not
>>     happening for all origins.  This is still happening.
>>
>>     Glenn
>>
>>     On 31 March 2016 at 21:44, Joe Wooller <joe at waia.asn.au
>>     <mailto:joe at waia.asn.au>> wrote:
>>
>>         Hasn’t been a good day….
>>         We are on it, services appear to be back to normal and an
>>         Incident Report will be sent to the notification list tomorrow.
>>         So sorry for the inconvenience all. I will ensure we fix all
>>         the things!
>>         If you have any questions feel free to email or call me.
>>
>>         Joe
>>
>>>         On 31 Mar 2016, at 6:41 PM, Daniel Watson
>>>         <daniel at hostlink.com.au <mailto:daniel at hostlink.com.au>> wrote:
>>>
>>>         Thanks for all the responses Guys :D
>>>
>>>         Must of missed the email :D
>>>
>>>         Daniel
>>>
>>>         On Thu, Mar 31, 2016 at 9:37 PM, Joseph Goldman
>>>         <joe at apcs.com.au <mailto:joe at apcs.com.au>> wrote:
>>>
>>>             Outage notice sent not too long ago:
>>>
>>>             Please be advised that we are seeing continued issues on NSW-IX.
>>>
>>>             The cause of the issue has been identified as a switching platform software issue.
>>>             Engineers are actively working with the vendor to troubleshoot.
>>>
>>>             Updated will be provided as the situation progresses.
>>>
>>>
>>>
>>>
>>>
>>>             On 31/03/16 21:34, Daniel Watson wrote:
>>>>             Good Evening,
>>>>
>>>>             I was wondering if anyone else experienced a BGP flap
>>>>             on NSW-IX around 9:20PM ADST This evening?
>>>>
>>>>             We saw our BGP to the route servers flap as well as all
>>>>             Bilat peering sessions
>>>>
>>>>             Any further information regarding this would be
>>>>             appreciated to try and rule out an isolated issue.
>>>>
>>>>             -- 
>>>>             Regards,
>>>>
>>>>             Daniel Watson.
>>>>             Owner/Senior Network Engineer | HostLink
>>>>             W: www.HostLink.com.au <http://www.hostlink.com.au/> E:
>>>>             daniel at hostlink.com.au <mailto:daniel at hostlink.com.au>
>>>>             P: 1300 430 738 | Direct: 03 9081 0511
>>>>
>>>>
>>>>
>>>>             _______________________________________________
>>>>             AusNOG mailing list
>>>>             AusNOG at lists.ausnog.net <mailto:AusNOG at lists.ausnog.net>
>>>>             http://lists.ausnog.net/mailman/listinfo/ausnog
>>>
>>>
>>>             _______________________________________________
>>>             AusNOG mailing list
>>>             AusNOG at lists.ausnog.net <mailto:AusNOG at lists.ausnog.net>
>>>             http://lists.ausnog.net/mailman/listinfo/ausnog
>>>
>>>
>>>
>>>
>>>         -- 
>>>         Regards,
>>>
>>>         Daniel Watson.
>>>         Owner/Senior Network Engineer | HostLink
>>>         W: www.HostLink.com.au <http://www.hostlink.com.au/> E:
>>>         daniel at hostlink.com.au <mailto:daniel at hostlink.com.au>
>>>         P: 1300 430 738 | Direct: 03 9081 0511
>>>
>>>         _______________________________________________
>>>         AusNOG mailing list
>>>         AusNOG at lists.ausnog.net <mailto:AusNOG at lists.ausnog.net>
>>>         http://lists.ausnog.net/mailman/listinfo/ausnog
>>
>>
>>         _______________________________________________
>>         AusNOG mailing list
>>         AusNOG at lists.ausnog.net <mailto:AusNOG at lists.ausnog.net>
>>         http://lists.ausnog.net/mailman/listinfo/ausnog
>>
>>
>>
>>
>>     -- 
>>     *Glenn Slaven*
>>     Principal Engineer
>>
>>     Ph: (+612) 9119 0444 <tel:%28%2B612%29%209119%200444>
>>     M: +61433 826 255 <tel:%2B61433%20826%20255>
>>     web: www.section.io <http://www.section.io/>
>>     blog: www.section.io/blog/ <http://www.section.io/blog/>
>>     Follow us on LinkedIn <https://www.linkedin.com/company/9417319>
>>     Follow us on Twitter <https://twitter.com/section_io>
>>     _______________________________________________
>>     AusNOG mailing list
>>     AusNOG at lists.ausnog.net <mailto:AusNOG at lists.ausnog.net>
>>     http://lists.ausnog.net/mailman/listinfo/ausnog
>
>
>
>
> -- 
> *Glenn Slaven*
> Principal Engineer
>
> Ph: (+612) 9119 0444
> M: +61433 826 255
> web: www.section.io <http://www.section.io/>
> blog: www.section.io/blog/ <http://www.section.io/blog/>
> Follow us on LinkedIn <https://www.linkedin.com/company/9417319>
> Follow us on Twitter <https://twitter.com/section_io>
>
>
> _______________________________________________
> AusNOG mailing list
> AusNOG at lists.ausnog.net
> http://lists.ausnog.net/mailman/listinfo/ausnog


-- 
/* Matt Perkins
         Direct 1300 137 379        Spectrum Networks Ptd. Ltd.
         Office 1300 133 299        matt at spectrum.com.au
                                    Level 6, 350 George Street Sydney 2000
         Spectrum Networks is a member of the Communications Alliance & TIO
*/

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20160401/36549139/attachment-0001.html>


More information about the AusNOG mailing list