[AusNOG] NSW-IX - Doody Street - Flap?

Glenn Slaven glenn at section.io
Fri Apr 1 10:19:41 EST 2016


Hi Joe,

unfortunately I'm only in a position to provide outgoing traceroutes, we're
just running VMs on AWS.

Here's an few sample traces running tcptraceroute -w 1 202.4.235.221 80 -f
5 -m 11

Selected device eth0, address 10.0.0.128, port 52199 for outgoing packets

Tracing the path to 202.4.235.221 on TCP port 80 (http), 11 hops max

 5  as4826.nsw.ix.asn.au (218.100.52.6)  2.097 ms  3.388 ms  2.011 ms

 6  bundle-100.cor03.syd03.nsw.VOCUS.net.au (114.31.192.44)  1.566 ms
1.668 ms  1.461 ms

 7  ten-1-2-0.bdr03.syd03.nsw.VOCUS.net.au (114.31.192.53)  1.192 ms
1.194 ms  1.159 ms

 8  180.189.25.210  1.442 ms  1.461 ms  1.421 ms

 9  vl2.rack42-core1.syd1.anchor.net.au (110.173.158.46)  1.802 ms
1.768 ms  1.778 ms

10  www.booktopia.com.au (202.4.235.221) [open]  1.532 ms  1.528 ms  1.540 ms

Thu Mar 31 18:46:13 UTC 2016

Selected device eth0, address 10.0.0.128, port 35794 for outgoing packets

Tracing the path to 202.4.235.221 on TCP port 80 (http), 11 hops max

 5  as4826.nsw.ix.asn.au (218.100.52.6)  1.989 ms  1.966 ms  2.022 ms

 6  bundle-100.cor03.syd03.nsw.VOCUS.net.au (114.31.192.44)  1.539 ms
1.831 ms  1.548 ms

 7  ten-2-1-0.bdr03.syd03.nsw.VOCUS.net.au (114.31.192.43)  1.191 ms
1.199 ms  1.253 ms

 8  180.189.25.210  1.496 ms  1.438 ms  1.487 ms

 9  vl2.rack42-core1.syd1.anchor.net.au (110.173.158.46)  1.868 ms
1.816 ms  2.468 ms

10  www.booktopia.com.au (202.4.235.221) [open]  1.572 ms  1.568 ms^C

root at ip-10-0-0-128:/tmp# while true; do tcptraceroute -w 1
202.4.235.221 80 -f 4 -m 11; date; done

Selected device eth0, address 10.0.0.128, port 41762 for outgoing packets

Tracing the path to 202.4.235.221 on TCP port 80 (http), 11 hops max

 4  52.95.36.17  15.028 ms  1.349 ms  1.369 ms

 5  * * *

 6  * * *

 7  * * *

 8  * * *

 9  * * *

10  * * *

11  * * *

Destination not reached

Thu Mar 31 18:46:40 UTC 2016

Selected device eth0, address 10.0.0.128, port 35944 for outgoing packets

Tracing the path to 202.4.235.221 on TCP port 80 (http), 11 hops max

 4  52.95.36.129  1.435 ms  1.276 ms  1.262 ms

 5  as4826.nsw.ix.asn.au (218.100.52.6)  1.995 ms  1.890 ms  4.014 ms

 6  bundle-100.cor03.syd03.nsw.VOCUS.net.au (114.31.192.44)  1.755 ms
1.771 ms  1.658 ms

 7  ten-2-1-0.bdr03.syd03.nsw.VOCUS.net.au (114.31.192.43)  1.185 ms
1.303 ms  1.168 ms

 8  180.189.25.210  1.589 ms  1.428 ms  1.423 ms

 9  vl2.rack42-core1.syd1.anchor.net.au (110.173.158.46)  1.822 ms
1.827 ms  2.440 ms

10  www.booktopia.com.au (202.4.235.221) [open]  1.540 ms  1.585 ms  1.609 ms

Thu Mar 31 18:46:42 UTC 2016

Selected device eth0, address 10.0.0.128, port 57310 for outgoing packets

Tracing the path to 202.4.235.221 on TCP port 80 (http), 11 hops max

 4  52.95.36.65  1.306 ms  1.294 ms  1.299 ms

 5  * * *

 6  * * *

 7  * * *

 8  * * *

 9  * * *

10  * * *

11  * * *

Destination not reached


On 1 April 2016 at 09:53, Joe Wooller <joe at waia.asn.au> wrote:

> Hi Glenn,
>
> If you are still having issues please send me as much information as you
> can so I can figure out what is going on and if it is related to the issues
> started to experience over the last couple of days.
>
> Can you provide trace routes/pings etc from both directions.
> Can you ping the peers address from your peering address.
> Do you get ARP ok?
>
> Thanks
> Joe
>
> On 31 Mar 2016, at 11:33 PM, Glenn Slaven <glenn at section.io> wrote:
>
> Not sure if this is related, but from around 9:20pm ADST we've been
> getting connection timeouts between our Sydney AWS nodes and various origin
> servers (we run http reverse proxies).  The issue isn't happening from
> other AWS locations that we tried and is not happening for all origins.
> This is still happening.
>
> Glenn
>
> On 31 March 2016 at 21:44, Joe Wooller <joe at waia.asn.au> wrote:
>
>> Hasn’t been a good day….
>> We are on it, services appear to be back to normal and an Incident Report
>> will be sent to the notification list tomorrow.
>> So sorry for the inconvenience all. I will ensure we fix all the things!
>> If you have any questions feel free to email or call me.
>>
>> Joe
>>
>> On 31 Mar 2016, at 6:41 PM, Daniel Watson <daniel at hostlink.com.au> wrote:
>>
>> Thanks for all the responses Guys :D
>>
>> Must of missed the email :D
>>
>> Daniel
>>
>> On Thu, Mar 31, 2016 at 9:37 PM, Joseph Goldman <joe at apcs.com.au> wrote:
>>
>>> Outage notice sent not too long ago:
>>>
>>> Please be advised that we are seeing continued issues on NSW-IX.
>>>
>>> The cause of the issue has been identified as a switching platform software issue.
>>> Engineers are actively working with the vendor to troubleshoot.
>>>
>>> Updated will be provided as the situation progresses.
>>>
>>>
>>>
>>>
>>>
>>>
>>> On 31/03/16 21:34, Daniel Watson wrote:
>>>
>>> Good Evening,
>>>
>>> I was wondering if anyone else experienced a BGP flap on NSW-IX around
>>> 9:20PM ADST This evening?
>>>
>>> We saw our BGP to the route servers flap as well as all Bilat peering
>>> sessions
>>>
>>> Any further information regarding this would be appreciated to try and
>>> rule out an isolated issue.
>>>
>>> --
>>> Regards,
>>>
>>> Daniel Watson.
>>> Owner/Senior Network Engineer | HostLink
>>> W: www.HostLink.com.au <http://www.hostlink.com.au/> E:
>>> <daniel at hostlink.com.au>daniel at hostlink.com.au
>>> P: 1300 430 738 | Direct: 03 9081 0511
>>>
>>>
>>>
>>> _______________________________________________
>>> AusNOG mailing listAusNOG at lists.ausnog.nethttp://lists.ausnog.net/mailman/listinfo/ausnog
>>>
>>>
>>>
>>> _______________________________________________
>>> AusNOG mailing list
>>> AusNOG at lists.ausnog.net
>>> http://lists.ausnog.net/mailman/listinfo/ausnog
>>>
>>>
>>
>>
>> --
>> Regards,
>>
>> Daniel Watson.
>> Owner/Senior Network Engineer | HostLink
>> W: www.HostLink.com.au <http://www.hostlink.com.au/> E:
>> daniel at hostlink.com.au
>> P: 1300 430 738 | Direct: 03 9081 0511
>>
>> _______________________________________________
>> AusNOG mailing list
>> AusNOG at lists.ausnog.net
>> http://lists.ausnog.net/mailman/listinfo/ausnog
>>
>>
>>
>> _______________________________________________
>> AusNOG mailing list
>> AusNOG at lists.ausnog.net
>> http://lists.ausnog.net/mailman/listinfo/ausnog
>>
>>
>
>
> --
> *Glenn Slaven*
> Principal Engineer
>
> Ph: (+612) 9119 0444
> M: +61433 826 255
> web: www.section.io
> blog: www.section.io/blog/
> Follow us on LinkedIn <https://www.linkedin.com/company/9417319>
> Follow us on Twitter <https://twitter.com/section_io>
> _______________________________________________
> AusNOG mailing list
> AusNOG at lists.ausnog.net
> http://lists.ausnog.net/mailman/listinfo/ausnog
>
>
>


-- 
*Glenn Slaven*
Principal Engineer

Ph: (+612) 9119 0444
M: +61433 826 255
web: www.section.io
blog: www.section.io/blog/
Follow us on LinkedIn <https://www.linkedin.com/company/9417319>
Follow us on Twitter <https://twitter.com/section_io>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20160401/682a5de9/attachment.html>


More information about the AusNOG mailing list