[AusNOG] NSW-IX - Doody Street - Flap?
Matt Perkins
matt at spectrum.com.au
Fri Apr 1 10:29:08 EST 2016
This looks a lot like what I was seeing last week when things transited
Vocus on the IX. I set the community that stopped sending Vocus our
prefixes and it solved everything. (Then again we do have a Several
direct peers with Vocus which are the payed varirty so we assuemed it
was some sort of filter to point traffic down the money path)
Matt
On 1/04/2016 10:19 AM, Glenn Slaven wrote:
> Hi Joe,
>
> unfortunately I'm only in a position to provide outgoing traceroutes,
> we're just running VMs on AWS.
>
> Here's an few sample traces running tcptraceroute -w 1 202.4.235.221
> 80 -f 5 -m 11
>
> Selected device eth0, address 10.0.0.128, port 52199 for outgoing packets
> Tracing the path to 202.4.235.221 on TCP port 80 (http), 11 hops max
> 5as4826.nsw.ix.asn.au <http://as4826.nsw.ix.asn.au> (218.100.52.6) 2.097 ms 3.388 ms 2.011 ms
> 6bundle-100.cor03.syd03.nsw.VOCUS.net.au
> <http://bundle-100.cor03.syd03.nsw.VOCUS.net.au> (114.31.192.44) 1.566 ms 1.668 ms 1.461 ms
> 7ten-1-2-0.bdr03.syd03.nsw.VOCUS.net.au
> <http://ten-1-2-0.bdr03.syd03.nsw.VOCUS.net.au> (114.31.192.53) 1.192 ms 1.194 ms 1.159 ms
> 8 180.189.25.210 1.442 ms 1.461 ms 1.421 ms
> 9vl2.rack42-core1.syd1.anchor.net.au
> <http://vl2.rack42-core1.syd1.anchor.net.au> (110.173.158.46) 1.802 ms 1.768 ms 1.778 ms
> 10www.booktopia.com.au <http://www.booktopia.com.au> (202.4.235.221) [open] 1.532 ms 1.528 ms 1.540 ms
> Thu Mar 31 18:46:13 UTC 2016
> Selected device eth0, address 10.0.0.128, port 35794 for outgoing packets
> Tracing the path to 202.4.235.221 on TCP port 80 (http), 11 hops max
> 5as4826.nsw.ix.asn.au <http://as4826.nsw.ix.asn.au> (218.100.52.6) 1.989 ms 1.966 ms 2.022 ms
> 6bundle-100.cor03.syd03.nsw.VOCUS.net.au
> <http://bundle-100.cor03.syd03.nsw.VOCUS.net.au> (114.31.192.44) 1.539 ms 1.831 ms 1.548 ms
> 7ten-2-1-0.bdr03.syd03.nsw.VOCUS.net.au
> <http://ten-2-1-0.bdr03.syd03.nsw.VOCUS.net.au> (114.31.192.43) 1.191 ms 1.199 ms 1.253 ms
> 8 180.189.25.210 1.496 ms 1.438 ms 1.487 ms
> 9vl2.rack42-core1.syd1.anchor.net.au
> <http://vl2.rack42-core1.syd1.anchor.net.au> (110.173.158.46) 1.868 ms 1.816 ms 2.468 ms
> 10www.booktopia.com.au <http://www.booktopia.com.au> (202.4.235.221) [open] 1.572 ms 1.568 ms^C
> root at ip-10-0-0-128:/tmp# while true; do tcptraceroute -w 1 202.4.235.221 80 -f 4 -m 11; date; done
> Selected device eth0, address 10.0.0.128, port 41762 for outgoing packets
> Tracing the path to 202.4.235.221 on TCP port 80 (http), 11 hops max
> 4 52.95.36.17 15.028 ms 1.349 ms 1.369 ms
> 5 * * *
> 6 * * *
> 7 * * *
> 8 * * *
> 9 * * *
> 10 * * *
> 11 * * *
> Destination not reached
> Thu Mar 31 18:46:40 UTC 2016
> Selected device eth0, address 10.0.0.128, port 35944 for outgoing packets
> Tracing the path to 202.4.235.221 on TCP port 80 (http), 11 hops max
> 4 52.95.36.129 1.435 ms 1.276 ms 1.262 ms
> 5as4826.nsw.ix.asn.au <http://as4826.nsw.ix.asn.au> (218.100.52.6) 1.995 ms 1.890 ms 4.014 ms
> 6bundle-100.cor03.syd03.nsw.VOCUS.net.au
> <http://bundle-100.cor03.syd03.nsw.VOCUS.net.au> (114.31.192.44) 1.755 ms 1.771 ms 1.658 ms
> 7ten-2-1-0.bdr03.syd03.nsw.VOCUS.net.au
> <http://ten-2-1-0.bdr03.syd03.nsw.VOCUS.net.au> (114.31.192.43) 1.185 ms 1.303 ms 1.168 ms
> 8 180.189.25.210 1.589 ms 1.428 ms 1.423 ms
> 9vl2.rack42-core1.syd1.anchor.net.au
> <http://vl2.rack42-core1.syd1.anchor.net.au> (110.173.158.46) 1.822 ms 1.827 ms 2.440 ms
> 10www.booktopia.com.au <http://www.booktopia.com.au> (202.4.235.221) [open] 1.540 ms 1.585 ms 1.609 ms
> Thu Mar 31 18:46:42 UTC 2016
> Selected device eth0, address 10.0.0.128, port 57310 for outgoing packets
> Tracing the path to 202.4.235.221 on TCP port 80 (http), 11 hops max
> 4 52.95.36.65 1.306 ms 1.294 ms 1.299 ms
> 5 * * *
> 6 * * *
> 7 * * *
> 8 * * *
> 9 * * *
> 10 * * *
> 11 * * *
> Destination not reached
>
> On 1 April 2016 at 09:53, Joe Wooller <joe at waia.asn.au
> <mailto:joe at waia.asn.au>> wrote:
>
> Hi Glenn,
>
> If you are still having issues please send me as much information
> as you can so I can figure out what is going on and if it is
> related to the issues started to experience over the last couple
> of days.
>
> Can you provide trace routes/pings etc from both directions.
> Can you ping the peers address from your peering address.
> Do you get ARP ok?
>
> Thanks
> Joe
>
>> On 31 Mar 2016, at 11:33 PM, Glenn Slaven <glenn at section.io
>> <mailto:glenn at section.io>> wrote:
>>
>> Not sure if this is related, but from around 9:20pm ADST we've
>> been getting connection timeouts between our Sydney AWS nodes and
>> various origin servers (we run http reverse proxies). The issue
>> isn't happening from other AWS locations that we tried and is not
>> happening for all origins. This is still happening.
>>
>> Glenn
>>
>> On 31 March 2016 at 21:44, Joe Wooller <joe at waia.asn.au
>> <mailto:joe at waia.asn.au>> wrote:
>>
>> Hasn’t been a good day….
>> We are on it, services appear to be back to normal and an
>> Incident Report will be sent to the notification list tomorrow.
>> So sorry for the inconvenience all. I will ensure we fix all
>> the things!
>> If you have any questions feel free to email or call me.
>>
>> Joe
>>
>>> On 31 Mar 2016, at 6:41 PM, Daniel Watson
>>> <daniel at hostlink.com.au <mailto:daniel at hostlink.com.au>> wrote:
>>>
>>> Thanks for all the responses Guys :D
>>>
>>> Must of missed the email :D
>>>
>>> Daniel
>>>
>>> On Thu, Mar 31, 2016 at 9:37 PM, Joseph Goldman
>>> <joe at apcs.com.au <mailto:joe at apcs.com.au>> wrote:
>>>
>>> Outage notice sent not too long ago:
>>>
>>> Please be advised that we are seeing continued issues on NSW-IX.
>>>
>>> The cause of the issue has been identified as a switching platform software issue.
>>> Engineers are actively working with the vendor to troubleshoot.
>>>
>>> Updated will be provided as the situation progresses.
>>>
>>>
>>>
>>>
>>>
>>> On 31/03/16 21:34, Daniel Watson wrote:
>>>> Good Evening,
>>>>
>>>> I was wondering if anyone else experienced a BGP flap
>>>> on NSW-IX around 9:20PM ADST This evening?
>>>>
>>>> We saw our BGP to the route servers flap as well as all
>>>> Bilat peering sessions
>>>>
>>>> Any further information regarding this would be
>>>> appreciated to try and rule out an isolated issue.
>>>>
>>>> --
>>>> Regards,
>>>>
>>>> Daniel Watson.
>>>> Owner/Senior Network Engineer | HostLink
>>>> W: www.HostLink.com.au <http://www.hostlink.com.au/> E:
>>>> daniel at hostlink.com.au <mailto:daniel at hostlink.com.au>
>>>> P: 1300 430 738 | Direct: 03 9081 0511
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> AusNOG mailing list
>>>> AusNOG at lists.ausnog.net <mailto:AusNOG at lists.ausnog.net>
>>>> http://lists.ausnog.net/mailman/listinfo/ausnog
>>>
>>>
>>> _______________________________________________
>>> AusNOG mailing list
>>> AusNOG at lists.ausnog.net <mailto:AusNOG at lists.ausnog.net>
>>> http://lists.ausnog.net/mailman/listinfo/ausnog
>>>
>>>
>>>
>>>
>>> --
>>> Regards,
>>>
>>> Daniel Watson.
>>> Owner/Senior Network Engineer | HostLink
>>> W: www.HostLink.com.au <http://www.hostlink.com.au/> E:
>>> daniel at hostlink.com.au <mailto:daniel at hostlink.com.au>
>>> P: 1300 430 738 | Direct: 03 9081 0511
>>>
>>> _______________________________________________
>>> AusNOG mailing list
>>> AusNOG at lists.ausnog.net <mailto:AusNOG at lists.ausnog.net>
>>> http://lists.ausnog.net/mailman/listinfo/ausnog
>>
>>
>> _______________________________________________
>> AusNOG mailing list
>> AusNOG at lists.ausnog.net <mailto:AusNOG at lists.ausnog.net>
>> http://lists.ausnog.net/mailman/listinfo/ausnog
>>
>>
>>
>>
>> --
>> *Glenn Slaven*
>> Principal Engineer
>>
>> Ph: (+612) 9119 0444 <tel:%28%2B612%29%209119%200444>
>> M: +61433 826 255 <tel:%2B61433%20826%20255>
>> web: www.section.io <http://www.section.io/>
>> blog: www.section.io/blog/ <http://www.section.io/blog/>
>> Follow us on LinkedIn <https://www.linkedin.com/company/9417319>
>> Follow us on Twitter <https://twitter.com/section_io>
>> _______________________________________________
>> AusNOG mailing list
>> AusNOG at lists.ausnog.net <mailto:AusNOG at lists.ausnog.net>
>> http://lists.ausnog.net/mailman/listinfo/ausnog
>
>
>
>
> --
> *Glenn Slaven*
> Principal Engineer
>
> Ph: (+612) 9119 0444
> M: +61433 826 255
> web: www.section.io <http://www.section.io/>
> blog: www.section.io/blog/ <http://www.section.io/blog/>
> Follow us on LinkedIn <https://www.linkedin.com/company/9417319>
> Follow us on Twitter <https://twitter.com/section_io>
>
>
> _______________________________________________
> AusNOG mailing list
> AusNOG at lists.ausnog.net
> http://lists.ausnog.net/mailman/listinfo/ausnog
--
/* Matt Perkins
Direct 1300 137 379 Spectrum Networks Ptd. Ltd.
Office 1300 133 299 matt at spectrum.com.au
Level 6, 350 George Street Sydney 2000
Spectrum Networks is a member of the Communications Alliance & TIO
*/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20160401/36549139/attachment-0001.html>
More information about the AusNOG
mailing list