[AusNOG] Microsoft bilateral peer issues via Megaport Melbourne

Fri Jun 5 13:24:37 EST 2020

A random thing I just noticed, which MAY correlate to this issue…

https://www.cnet.com/how-to/windows-10-may-2020-update-everything-you-need-to-know/

Here is a quote - note the last sentence in particular:
Microsoft's Windows 10 May 2020 Update is now generally available to download, with several new features to help with productivity, security and speed. The update -- also known as Windows 10 versions 2004 and 20H1, and formerly referred to as the April 2020 Update -- began rolling out to mainstream users on Wednesday, a day earlier than expected.

Regards,
Philip Loenneker | Senior Network Engineer | TasmaNet
40-50 Innovation Drive, Dowsing Point, Tas 7010, Australia
P: 1300 792 711
philip.loenneker at tasmanet.com.au<mailto:philip.loenneker at tasmanet.com.au>
www.tasmanet.com.au<http://www.tasmanet.com.au/>

From: AusNOG <ausnog-bounces at lists.ausnog.net> On Behalf Of Philip Loenneker
Sent: Friday, 5 June 2020 8:51 AM
To: ausnog at ausnog.net
Subject: Re: [AusNOG] Microsoft bilateral peer issues via Megaport Melbourne

Hi again all,

The problems appeared to gradually clear up yesterday. I believe all of the issues we saw are now resolved.

I spent about an hour on a call with a Microsoft engineer last night and they couldn’t identify any reason for the problems. I did some testing to try to reproduce the issue but could not.

Did anyone get any feedback to say that Microsoft were working on it? If so, could you share the case number so that I can get the engineer I was working with to identify what, if anything, was done?

Regards,
Philip Loenneker | Senior Network Engineer | TasmaNet
40-50 Innovation Drive, Dowsing Point, Tas 7010, Australia
P: 1300 792 711
philip.loenneker at tasmanet.com.au<mailto:philip.loenneker at tasmanet.com.au>
www.tasmanet.com.au<https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.tasmanet.com.au%2F&data=02%7C01%7Cphilip.loenneker%40tasmanet.com.au%7Ca9ddeab419494431a69308d808d9da13%7Cb53dc580ab7847208b30536f36d398ac%7C0%7C0%7C637269079044343274&sdata=0cChN6Tq0HIWc7od1oJnj5rz9Ae7D5BT6EI2yV22dYY%3D&reserved=0>

From: AusNOG <ausnog-bounces at lists.ausnog.net> On Behalf Of Philip Loenneker
Sent: Thursday, 4 June 2020 12:59 PM
To: Johnathon Brandis <jcbrandis at gmail.com>; David Allen <david at virtutel.com.au>
Cc: ausnog at ausnog.net
Subject: Re: [AusNOG] Microsoft bilateral peer issues via Megaport Melbourne

Thanks everyone for the feedback, I’m glad to hear it isn’t just us.

Things seem to be a bit more stable over the past hour or so, but we’re still seeing errors in our monitoring.

I have requested an update from Microsoft - I’ll let everyone know when I have an update.

From: Johnathon Brandis <jcbrandis at gmail.com>
Sent: Thursday, 4 June 2020 12:37 PM
To: David Allen <david at virtutel.com.au>
Cc: Philip Loenneker <Philip.Loenneker at tasmanet.com.au>; ausnog at ausnog.net
Subject: Re: [AusNOG] Microsoft bilateral peer issues via Megaport Melbourne

Gday,

Speculating, however, have seen a series of rolling planned works for MS in MegIX locations this week and last. Again, speculating could be related.Starting 9am

On Thu, Jun 4, 2020 at 12:29 PM David Allen <david at virtutel.com.au<mailto:david at virtutel.com.au>> wrote:
Hi Philip,

Can confirmed we have experienced the same issue and I have a ticket lodged with both Megaport and Microsoft over it. It seems to be fine over Equinix IX however.

Regards
David

Kind regards,

David Allen | Director, CTO
P: 1300 655 132 or +61 3 9999 8800 F: +61 3 9999 8899
E: david at virtutel.com.au<mailto:david at virtutel.com.au> W: www.virtutel.com.au<https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.virtutel.com.au%2F&data=02%7C01%7Cphilip.loenneker%40tasmanet.com.au%7Ca9ddeab419494431a69308d808d9da13%7Cb53dc580ab7847208b30536f36d398ac%7C0%7C0%7C637269079044348247&sdata=Pv8JYCS%2FrkqkHBMqH1U%2BCblxi8KoZV%2FO5DylsahRu4M%3D&reserved=0>
A: Level 9, 401 Collins Street, Melbourne, Victoria, 3000, Australia

[cid:image001.jpg at 01D63B3C.A80CB550]

This e-mail message and any accompanying attachments may contain confidential information. If you are not the intended recipient, do not read, use, disseminate, distribute or copy this message or attachments. If you have received this message in error, please notify the sender immediately and delete this message. Any views expressed in this message are those of the individual sender, except where the sender expressly, and with authority, states them to be the views of Virtutel Before opening any attachments, please check them for viruses and defects.

On 4 Jun 2020, at 12:13 pm, Philip Loenneker <Philip.Loenneker at tasmanet.com.au<mailto:Philip.Loenneker at tasmanet.com.au>> wrote:

Good morning everyone,

We became aware of issues this morning for clients on our network reaching some Azure workloads and Office365 services. Traffic was reaching the remote end of our bilateral peer with Microsoft over Megaport Melbourne, but we had connectivity issues reaching hops past that. We stopped sending and receiving routes via this peer (keeping the BGP peer up for testing purposes) and after a few minutes most services appeared to be back to normal, with the traffic currently preferring a path via NSW-IX.

Since then however, we’re still having issues with Azure workloads in AU-SE region. We’re seeing 42% error rate in initiating connections to some VMs.

I’ve logged a fault directly with Microsoft, and they are investigating, but I was wondering if anyone else is having similar issues that could help to isolate the cause. I can share the incident number with others experiencing problems if it is helpful.

Regards,
Philip Loenneker | Senior Network Engineer | TasmaNet
40-50 Innovation Drive, Dowsing Point, Tas 7010, Australia
P: 1300 792 711
philip.loenneker at tasmanet.com.au<mailto:philip.loenneker at tasmanet.com.au>
www.tasmanet.com.au<https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.tasmanet.com.au%2F&data=02%7C01%7Cphilip.loenneker%40tasmanet.com.au%7Ca9ddeab419494431a69308d808d9da13%7Cb53dc580ab7847208b30536f36d398ac%7C0%7C0%7C637269079044353226&sdata=3ywTxDdPYzoFTmHRp3dRNE%2BDdTmi%2BFh4kaBwyfK3rGY%3D&reserved=0>

_______________________________________________
AusNOG mailing list
AusNOG at lists.ausnog.net<mailto:AusNOG at lists.ausnog.net>
http://lists.ausnog.net/mailman/listinfo/ausnog<https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.ausnog.net%2Fmailman%2Flistinfo%2Fausnog&data=02%7C01%7Cphilip.loenneker%40tasmanet.com.au%7Ca9ddeab419494431a69308d808d9da13%7Cb53dc580ab7847208b30536f36d398ac%7C0%7C0%7C637269079044358204&sdata=yHCAtjo3zhApMOFuopKM%2B68ysS8%2FrPmM%2B7rJGwj%2BGGg%3D&reserved=0>

_______________________________________________
AusNOG mailing list
AusNOG at lists.ausnog.net<mailto:AusNOG at lists.ausnog.net>
http://lists.ausnog.net/mailman/listinfo/ausnog<https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.ausnog.net%2Fmailman%2Flistinfo%2Fausnog&data=02%7C01%7Cphilip.loenneker%40tasmanet.com.au%7Ca9ddeab419494431a69308d808d9da13%7Cb53dc580ab7847208b30536f36d398ac%7C0%7C0%7C637269079044363183&sdata=UmhI5VbJdPciuOiARDfkn%2BvO2zX5aQQAo02BvSn5BiM%3D&reserved=0>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20200605/de49858b/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 10801 bytes
Desc: image001.jpg
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20200605/de49858b/attachment.jpg>