[AusNOG] 10GBs

[Matt Walker]

G'day Burt,

We had an "interesting" issue with 10GBE at work a few months back, similar story in that packets seemed to be just black-holing into nowhere.

Unfortunately what had occured is that an SFP+ Optic had failed on the Rx direction only, and as such none of the upstream switches detected the issue or reported any sort of broken/corrupt packets.

I diagnosed it by seeing at first that all Tx/Rx stats on the switches were perfect, and no links were reporting down.
It seems that early versions of the Dell Force10 M IO Aggregators dont support proper stat collections or thresholding to trigger SNMP alarms.

Only when a show tech was run was there a sneaky line that didnt directly say it was the issue, but turns out the counter was the Rx CRC Error Counter.

We changed out all the SFP+'s on the Dell end (to newer now "qualified" Optics) cleaned and scoped all flyleads and havent seen the issue since!
________________________________
From: AusNOG <ausnog-bounces at lists.ausnog.net> on behalf of Burt Mascareigne <Burt at stormnetwork.com.au>
Sent: 08 November 2017 13:23
To: <ausnog at lists.ausnog.net>
Subject: [AusNOG] 10GBs


Hi Noggers



We’re having “fun” with 10GB NICS, Switches and SFPs.



We can’t work out which is causing drop out, packets.. we are somewhat certain packets are vanishing into the Ether..



We don’t know which is causing what.



I’m not after troubleshooting, I am curious what people’s view on this.



Do you buy 1 Vendor for all your 10GBs, A-Z, is there some hidden rule about mixing vendors, is this all trial and error (and very expensive at best)?



Any recommendations on set ups?  Preferred Vendors, Vender to avoid like the plague.



We’re talking Servers to Switch kind of thing.  Not SANs etc.  Good ol’ HyperVisor to the switch.



Thanks











Regards,





Burt Mascareigne
Mobile 0414 450 962   Office (02) 9965 5422
Address Level 19, 1 O’Connell Street, Sydney NSW 2000
Web http://www.stormnetwork.com.au<http://www.stormnetwork.com.au/>
[01-300x70]


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20171109/f0069a33/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.png
Type: image/png
Size: 5873 bytes
Desc: image003.png
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20171109/f0069a33/attachment.png>