[AusNOG] PIpe VIC IX

[Shaun McGuane]

We just flapped also.

Chris,

They initially thought it was just a routing problem and sent that out to customers.

I really don't think they know themselves yet ... I assume we should get a full report tomorrow.

Regards



-----Original Message-----
From: ausnog-bounces at lists.ausnog.net [mailto:ausnog-bounces at lists.ausnog.net] On Behalf Of Chris Ricks
Sent: 22 May 2013 23:14
To: ausnog at lists.ausnog.net
Subject: Re: [AusNOG] PIpe VIC IX

Has anyone got anything beyond "376 Flinders Street had a power issue"
back from Pipe as yet? Although we don't have any direct dealings with Pipe for transit or peering, this is the second time in as many months that we've seen something happen at Pipe VIC IX that has impacted connectivity between our upstreams and other parties.

The fact that it looks like attempting to resolve a transit outage caused an IX outage is several different types of concerning.

- Chris

On 22/05/2013 11:00 PM, Shaun McGuane wrote:
> Matt,
>
> They had a power outage at flinders lane so we are informed at around 
> 7pm. Additionally when they sorted that out they did something else which dropped a lot of customers around 9:30ish.
>
> It appears that now it's all outsourced to Manilla and anyone that 
> actually knows anything has jumped ship leaving it in the capable hands of our TPG friends.  I don't feel good about these business decisions they have been making.
>
> Proof is in the pudding with no official notification since 7:45pm and that notification was BS anyway.
>
> Regards
> Shaun
>
> -----Original Message-----
> From: ausnog-bounces at lists.ausnog.net 
> [mailto:ausnog-bounces at lists.ausnog.net] On Behalf Of Matthew Gordon
> Sent: 22 May 2013 22:55
> To: ausnog at ausnog.net
> Subject: Re: [AusNOG] PIpe VIC IX
>
> Us here too - although it took a call to their NOC. 
>
> I can't say much for their support these days
>
> "That outage was fixed a while back - oh you're still down?"
>
> Matt
>
> -----Original Message-----
> From: ausnog-bounces at lists.ausnog.net 
> [mailto:ausnog-bounces at lists.ausnog.net] On Behalf Of Graeme Allen
> Sent: Wednesday, 22 May 2013 10:45 PM
> To: Shaun McGuane
> Cc: ausnog at ausnog.net
> Subject: Re: [AusNOG] PIpe VIC IX
>
> And as I wrote that it just came back....
>
> On Wed, 2013-05-22 at 22:42 +1000, Graeme Allen wrote:
>> PipeEthernet still down....
>>
>> On Wed, 2013-05-22 at 12:32 +0000, Shaun McGuane wrote:
>>> Just want to add that IX and Transit have both just been brought 
>>> back online.
>>>
>>>  
>>>
>>> Regards
>>>
>>> Shaun
>>>
>>>  
>>>
>>> RackCentral
>>>
>>>
>>> Shaun McGuane |CEO
>>>
>>> t 1300 722 532
>>> t 0400 177 077
>>> t shaun at rackcentral.com.au
>>> t www.rackcentral.com.au
>>> t Level 3/480 Collins St Melbourne,
>>> VIC 3000
>>>
>>>
>>> http://www.rackcentral.com.au/signature/f.png
>>>
>>>
>>>  
>>>
>>>
>>>  
>>>
>>> From: Jared Hirst [mailto:jared.hirst at serversaustralia.com.au]
>>> Sent: 22 May 2013 22:24
>>> To: Shaun McGuane; James Braunegg; ausnog at ausnog.net
>>> Subject: RE: [AusNOG] PIpe VIC IX
>>>
>>>
>>>  
>>>
>>> The graphs are showing and going, James also said he saw broadcast 
>>> traffic. Brisbane is also down :/
>>>
>>>  
>>>
>>> Is it possible that they have had some form of magical mass 
>>> broadcast storm.
>>>
>>>  
>>>
>>> From:ausnog-bounces at lists.ausnog.net
>>> [mailto:ausnog-bounces at lists.ausnog.net] On Behalf Of Shaun McGuane
>>> Sent: Wednesday, May 22, 2013 10:19 PM
>>> To: James Braunegg; ausnog at ausnog.net
>>> Subject: Re: [AusNOG] PIpe VIC IX
>>>
>>>
>>>  
>>>
>>> Oh and yes we lost IX and Transit at the exact same time which was 
>>> just before 7pm.
>>>
>>>  
>>>
>>> Image removed by sender.
>>> RackCentral
>>>
>>>
>>> Shaun McGuane |CEO
>>>
>>> Image removed by sender. t 1300 722
>>> 532
>>> Image removed by sender. t 0400 177
>>> 077
>>> Image removed by sender.
>>> t shaun at rackcentral.com.au
>>> Image removed by sender.
>>> t www.rackcentral.com.au
>>> Image removed by sender. t Level
>>> 3/480 Collins St Melbourne, VIC
>>> 3000
>>>
>>>
>>> Image removed by sender.
>>> http://www.rackcentral.com.au/signature/f.png
>>>
>>>
>>>  
>>>
>>>
>>>  
>>>
>>> From: James Braunegg [mailto:james.braunegg at micron21.com]
>>> Sent: 22 May 2013 22:13
>>> To: Shaun McGuane; ausnog at ausnog.net
>>> Subject: RE: PIpe VIC IX
>>>
>>>
>>>  
>>>
>>> Dear Shaun
>>>
>>>  
>>>
>>> The pipe IX graphs show RackCentral, TPG, and brennan peering went 
>>> down at around 7pm in Vic however it looks like everyone else on 
>>> pipe Vic IX lost transit around 9:40pm which is when we 1st noticed issues.
>>>
>>>  
>>>
>>> NSW peering and QLD peering seem perfectly fine
>>>
>>>  
>>>
>>> Kindest Regards
>>>
>>>  
>>>
>>> James Braunegg
>>> W:  1300 769 972  |  M:  0488 997 207 |  D:  (03) 9751 7616
>>>
>>> E:  james.braunegg at micron21.com  |  ABN:  12 109 977 666   
>>>
>>> Description: Description: Description: Description: M21.jpg
>>>
>>>
>>> This message is intended for the addressee named above. It may 
>>> contain privileged or confidential information. If you are not the 
>>> intended recipient of this message you must not use, copy, 
>>> distribute or disclose it to anyone other than the addressee. If you 
>>> have received this message in error please return the message to the 
>>> sender by replying to it and then delete the message from your computer.
>>>
>>>
>>>  
>>>
>>> From: Shaun McGuane [mailto:shaun at rackcentral.com.au]
>>> Sent: Wednesday, May 22, 2013 10:03 PM
>>> To: James Braunegg; ausnog at ausnog.net
>>> Subject: RE: PIpe VIC IX
>>>
>>>
>>>  
>>>
>>> Hi James,
>>>
>>>  
>>>
>>> There has been a vic outage - We lost all pipe transit and pipe ix 
>>> since 7pm.
>>>
>>>  
>>>
>>> Surprised its so quiet on this listJ
>>>
>>>  
>>>
>>> Regards
>>>
>>>  
>>>
>>>  
>>>
>>> Image removed by sender.
>>> RackCentral
>>>
>>>
>>> Shaun McGuane |CEO
>>>
>>> Image removed by sender. t 1300 722
>>> 532
>>> Image removed by sender. t 0400 177
>>> 077
>>> Image removed by sender.
>>> t shaun at rackcentral.com.au
>>> Image removed by sender.
>>> t www.rackcentral.com.au
>>> Image removed by sender. t Level
>>> 3/480 Collins St Melbourne, VIC
>>> 3000
>>>
>>>
>>> Image removed by sender.
>>> http://www.rackcentral.com.au/signature/f.png
>>>
>>>
>>>  
>>>
>>>
>>>  
>>>
>>> From: ausnog-bounces at lists.ausnog.net 
>>> [mailto:ausnog-bounces at lists.ausnog.net] On Behalf Of James Braunegg
>>> Sent: 22 May 2013 21:44
>>> To: ausnog at ausnog.net
>>> Subject: [AusNOG] PIpe VIC IX
>>>
>>>
>>>  
>>>
>>> Hey guys we are seeing some funny traffic / issue on Pipe Vic IX 
>>> with packet loss within 55 crockford so just a heads up for anyone 
>>> else seeing issues starting about 10min ago.
>>>
>>>  
>>>
>>> Our solution was to shut the interface down and route around the 
>>> issue.
>>>
>>>  
>>>
>>> Kindest Regards
>>>
>>>  
>>>
>>> James Braunegg
>>> W:  1300 769 972  |  M:  0488 997 207 |  D:  (03) 9751 7616
>>>
>>> E:  james.braunegg at micron21.com  |  ABN:  12 109 977 666   
>>>
>>> Description: Description: Description: Description: M21.jpg
>>>
>>>
>>> This message is intended for the addressee named above. It may 
>>> contain privileged or confidential information. If you are not the 
>>> intended recipient of this message you must not use, copy, 
>>> distribute or disclose it to anyone other than the addressee. If you 
>>> have received this message in error please return the message to the 
>>> sender by replying to it and then delete the message from your computer.
>>>
>>>  
>>>
>>>
>>> Message protected by RackCentral: e-mail anti-virus, anti-spam and 
>>> content filtering. http://www.rackcentral.com.au
>>>
>>>
>>> Message protected by RackCentral: e-mail anti-virus, anti-spam and 
>>> content filtering. http://www.rackcentral.com.au
>>>
>>>
>>>
>>> Message protected by RackCentral: e-mail anti-virus, anti-spam and 
>>> content filtering. http://www.rackcentral.com.au 
>>> _______________________________________________
>>> AusNOG mailing list
>>> AusNOG at lists.ausnog.net
>>> http://lists.ausnog.net/mailman/listinfo/ausnog
>>
>> _______________________________________________
>> AusNOG mailing list
>> AusNOG at lists.ausnog.net
>> http://lists.ausnog.net/mailman/listinfo/ausnog
>
> _______________________________________________
> AusNOG mailing list
> AusNOG at lists.ausnog.net
> http://lists.ausnog.net/mailman/listinfo/ausnog
> _______________________________________________
> AusNOG mailing list
> AusNOG at lists.ausnog.net
> http://lists.ausnog.net/mailman/listinfo/ausnog
> Message protected by RackCentral: e-mail anti-virus, anti-spam and content filtering.
> http://www.rackcentral.com.au
> _______________________________________________
> AusNOG mailing list
> AusNOG at lists.ausnog.net
> http://lists.ausnog.net/mailman/listinfo/ausnog



_______________________________________________
AusNOG mailing list
AusNOG at lists.ausnog.net
http://lists.ausnog.net/mailman/listinfo/ausnog
Message protected by RackCentral: e-mail anti-virus, anti-spam and content filtering.
http://www.rackcentral.com.au