[AusNOG] Vocus Office 365 CDN corrupt again

Samuel D. Leslie sdl at nexiom.net
Wed Apr 29 09:24:17 EST 2020


All,

Effective last Friday (24th April) the issue is apparently resolved. My own testing seems to confirm that, though I was unable to get any details from the Akamai NOC as to the cause of the underlying issue. Hopefully that's the end of it, but this has reoccurred before, so will try and keep tabs on it.


Cheers,
-SDL

-----Original Message-----
From: Phil Mawson <phil.mawson at gmail.com> 
Sent: Monday, 20 April 2020 9:40 AM
To: Samuel D. Leslie <sdl at nexiom.net>
Cc: James Andrewartha <trs80 at ucc.gu.uwa.edu.au>; ausnog at lists.ausnog.net
Subject: Re: [AusNOG] Vocus Office 365 CDN corrupt again

Hi,

I have flagged this again with the content providers.

Cheers,
Phil

> On 18 Apr 2020, at 8:31 pm, Samuel D. Leslie <sdl at nexiom.net> wrote:
> 
> Hi James,
> 
> I've been put in touch with some Akamai and Vocus engineers but as of yet no progress appears to have been made. If/when that changes I'll update this thread. I've replied to you off-list w.r.t. your other questions.
> 
> 
> Cheers,
> -SDL
> 
> -----Original Message-----
> From: James Andrewartha <trs80 at ucc.gu.uwa.edu.au>
> Sent: Friday, 17 April 2020 6:42 PM
> To: Samuel D. Leslie <sdl at nexiom.net>; Phil Mawson 
> <phil.mawson at gmail.com>
> Cc: ausnog at lists.ausnog.net
> Subject: Re: [AusNOG] Vocus Office 365 CDN corrupt again
> 
> Hi Phil,
> 
> Akamai is now giving us Vocus Akamai servers, and they are giving us a 
> bad file too - 139.218.20.187 has an md5sum of
> 4f93c7595d3965dc836e6b0eb7b06c05 for stream.x64.x-none.dat
> 
> Thanks,
> 
> -- 
> # TRS-80              trs80(a)ucc.gu.uwa.edu.au #/ "Otherwise Bub here will do \
> # UCC Wheel Member     https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ftrs80.ucc.asn.au%2F&data=02%7C01%7C%7Cfc3d460bdc5740f3241c08d7e4baed63%7C3deb19d522704bec8e4d912c52be1b9d%7C0%7C0%7C637229363816172162&sdata=chlGyx4s4eA%2BR707ASPZb1eyUViZTiYsrG%2FgWYz1M34%3D&reserved=0 #|  what squirrels do best     |
> [ "There's nobody getting rich writing          ]|  -- Collect and hide your   |
> [  software that I know of" -- Bill Gates, 1980 ]\  nuts." -- Acid 
> Reflux #231 /
> 
> 
> On Fri, 17 Apr 2020, James Andrewartha wrote:
> 
>> Oddly I switched to direct DNS and got switched to Akamai WAIX, but I 
>> get a different MD5sum again, f4a4e53bd2869971c342a06881e445bc from
>> 
>> officecdn.microsoft.com.edgesuite.net is an alias for 
>> officecdn.microsoft.com.edgesuite.net.globalredir.akadns.net.
>> officecdn.microsoft.com.edgesuite.net.globalredir.akadns.net is an 
>> alias for a1737.dspw65.akamai.net.
>> a1737.dspw65.akamai.net is an alias for 
>> a1737.dspw65.akamai.net.0.1.cn.akamaitech.net.
>> a1737.dspw65.akamai.net.0.1.cn.akamaitech.net has address
>> 23.192.239.161 a1737.dspw65.akamai.net.0.1.cn.akamaitech.net has 
>> address 23.192.239.169 a1737.dspw65.akamai.net.0.1.cn.akamaitech.net
>> has IPv6 address 2600:1415:b800::1737:de0b 
>> a1737.dspw65.akamai.net.0.1.cn.akamaitech.net has IPv6 address 
>> 2600:1415:b800::1737:de0a
>> 
>> Setting my DNS forwarder to 1.1.1.1 and I connect to 184.86.223.8 and 
>> now the install works, md5sum is b091593c99575c9f9c1f970d23cf4cc2
>> 
>> So that's 4 different hashes from 4 different Akamai mirrors. Well I 
>> tested again and 184.86.223.32 gives me
>> b091593c99575c9f9c1f970d23cf4cc2 too, so 4 different from 5.
>> 
>> -- 
>> # TRS-80              trs80(a)ucc.gu.uwa.edu.au #/ "Otherwise Bub here will do \
>> # UCC Wheel Member     https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ftrs80.ucc.asn.au%2F&data=02%7C01%7C%7Cfc3d460bdc5740f3241c08d7e4baed63%7C3deb19d522704bec8e4d912c52be1b9d%7C0%7C0%7C637229363816172162&sdata=chlGyx4s4eA%2BR707ASPZb1eyUViZTiYsrG%2FgWYz1M34%3D&reserved=0 #|  what squirrels do best     |
>> [ "There's nobody getting rich writing          ]|  -- Collect and hide your   |
>> [  software that I know of" -- Bill Gates, 1980 ]\  nuts." -- Acid 
>> Reflux #231 /
>> 
>> On Fri, 17 Apr 2020, James Andrewartha wrote:
>> 
>>> Hi Samuel,
>>> 
>>> Where did you find the logfile with the error? We're having problems 
>>> installing Office 365 yesterday and today, the client seems to be 
>>> downloading 
>>> https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Foff
>>> icecdn.microsoft.com.edgesuite.net%2Fpr%2F7ffbc6bf-bc32-4f92-8982-f9
>>> dd17fd3114%2FOffice%2FData%2F16.0.11929.20708%2Fstream.x64.x-none.da
>>> t&data=02%7C01%7C%7C0c32741b173e4501f4d208d7e2ab23d1%7C3deb19d52
>>> 2704bec8e4d912c52be1b9d%7C0%7C0%7C637227096997619312&sdata=s79uZ
>>> A%2Fz47jlwA3Qx8vjk7YskEJpHd%2FprqhZUvizCA4%3D&reserved=0
>>> which is coming from the AARNet mirror and has an md5sum of
>>> 82ba6ca2947f30ea7130370caf45b066
>>> 
>>> officecdn.microsoft.com.edgesuite.net is an alias for 
>>> officecdn.microsoft.com.edgesuite.net.globalredir.akadns.net.
>>> officecdn.microsoft.com.edgesuite.net.globalredir.akadns.net is an 
>>> alias for a1737.dspw65.akamai.net.
>>> a1737.dspw65.akamai.net has address 203.13.161.144 
>>> a1737.dspw65.akamai.net has address 203.13.161.138 
>>> a1737.dspw65.akamai.net has IPv6 address 2001:388:1:180d::cb0d:a190 
>>> a1737.dspw65.akamai.net has IPv6 address 2001:388:1:180d::cb0d:a18a
>>> 
>>> The install gets stuck at 51%, even overnight. Just tested by 
>>> pointing my DNS at 1.1.1.1 and downloading from this host:
>>> 
>>> officecdn.microsoft.com.edgesuite.net is an alias for 
>>> officecdn.microsoft.com.edgesuite.net.globalredir.akadns.net.
>>> officecdn.microsoft.com.edgesuite.net.globalredir.akadns.net is an 
>>> alias for a1737.dspw65.akamai.net.
>>> a1737.dspw65.akamai.net has address 23.53.241.83 
>>> a1737.dspw65.akamai.net has address 23.53.241.67 
>>> a1737.dspw65.akamai.net has IPv6 address 2600:1415:b000::1735:f129 
>>> a1737.dspw65.akamai.net has IPv6 address 2600:1415:b000::1735:f11a 
>>> a1737.dspw65.akamai.net has IPv6 address 2600:1415:b000::1735:f122
>>> 
>>> gets me an md5sum of 68453f76ba26d026c6e810304a633c5c for 
>>> stream.x64.x-none.dat
>>> 
>>> So time to contact AARNet NOC.
>>> 
>>> 
>>> On Sun, 5 Apr 2020, Samuel D. Leslie wrote:
>>> 
>>>> Looks like the Office 365 CDN on the Vocus network is corrupt again. This has happened before (see earlier thread from February 2020). If anyone from Vocus is on this list, or someone here has any contacts at Vocus, it'd be much appreciated if you could raise it with someone who can look into it.
>>>> 
>>>> This has been causing some sporadic but frustrating issues on our Office 365 deployments since the start of the year. For anyone else reading this, if you're seeing Office 365 deployments running for an abnormally long time before eventually failing you may be seeing the same issue.
>>>> 
>>>> Affected Vocus server:
>>>> Name:       a1737.dspw65.akamai.net
>>>> Addresses:  2403:4800:3003:4::8bda:1520
>>>>            2403:4800:3003:4::8bda:150a
>>>>            139.218.20.194
>>>>            139.218.20.187
>>>> Aliases:    officecdn.microsoft.com.edgesuite.net
>>>> 
>>>> officecdn.microsoft.com.edgesuite.net.globalredir.akadns.net
>>>> 
>>>> Sample corrupted SHA-256 file hashes:
>>>> pr/492350f6-3a01-4f97-b9c0-c7c6ddf67d60/Office/Data/16.0.12624.203
>>>> 82/i640.cab
>>>> Vocus: 
>>>> 692D7A31176A0F26FB018613B4AE24CDC1E49481B95C890A0674637FFE0DA9E9
>>>> Correct: 
>>>> B4295DCB07D3F7753B6D939CF950FA63419DD0D85C931580777C419F5C6DD32E
>> 
>> 
>> _______________________________________________
>> AusNOG mailing list
>> AusNOG at lists.ausnog.net
>> https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Flist
>> s
>> .ausnog.net%2Fmailman%2Flistinfo%2Fausnog&data=02%7C01%7C%7C0c327
>> 4
>> 1b173e4501f4d208d7e2ab23d1%7C3deb19d522704bec8e4d912c52be1b9d%7C0%7C0
>> %7C637227096997619312&sdata=q%2FQfCMurYZ7N26QEkZmPwcerDsoUvktxswKzABEX3IU%3D&reserved=0
>> 
> 
> 



More information about the AusNOG mailing list