<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body dir="auto">
<div>Broadcom Trident 2 runs 12MB packet buffer, the original Trident was less from memory.</div>
<div><br>
</div>
<div>The Broadcom Tomahawk chipset (25/50/100GE cheap switches) run a 7.6MB packet buffer. </div>
<div><br>
</div>
<div>The Broadcom Dune (Jericho) chipset uses external DDR4/GDDR5 memory for packet buffering, so you'll see various sizing from different vendors depending on how much they throw at it. For example, the new Arista 7280CR-48 which is based on this chipset has
32GB of packet buffer. The downside to external memory is that it isn't necessarily as fast as on-ASIC/SoC packet buffers, so if you're in a latency sensitive environment it may not be the best option. Weapon of a storage switch though!</div>
<div><br>
</div>
<div>Again, it all comes down to due diligence and selecting the right hardware for your requirements. Various features can differ greatly between the chipsets also, e.g. if you want to VXLAN route at line rate without packet recirculation, don't buy a Trident
2 switch (unless it's a Nexus 9300 with it's Merchant+ Insieme ASIC wizardry). Trident 2+ is better though with single pass encap/decap and double the VXLAN performance of the Trident 2. Tomahawk and Jericho are better again, but Tomahawk has truly terrible
buffers and arguably some hardware deficiencies vendors are still trying to sort out around arbitration of packets when congested, Jericho switches are expensive.</div>
<div><br>
<div>Sent from my iPhone</div>
</div>
<div><br>
On 5 Jul 2016, at 10:40 AM, Andrew Yager <<a href="mailto:andrew@rwts.com.au">andrew@rwts.com.au</a>> wrote:<br>
<br>
</div>
<blockquote type="cite">
<div>
<div dir="ltr">We've been running it for almost 18 months now in production and have done a fair bit of work with a number of the vendors building OS platforms.
<div><br>
</div>
<div>IMO the one to watch in the ISP/"Traditional Network" space is a product called OCNOS by IP Infusion. It's a very Cisco like CLI with a range of "carrier" technologies including MPLS, RSVP, LDP implemented. We have found a couple of limitations with FRR,
but still quite acceptable once tested. We've also done a fair bit of interop testing with Juniper and Cisco and are still running it in our labs on some S6000s and have had no major issues. It also has a rudimentary HQOS implementation that we haven't really
drilled into yet.</div>
<div><br>
</div>
<div>The buffer discussion is something that we keep going back to with Dell. I'm told it's a Broadcom architecture limitation at the moment, but there are new chipsets due out later this year with larger packet buffers.</div>
<div><br>
</div>
<div>Thanks,</div>
<div>Andrew<br>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On 4 July 2016 at 17:21, Greg Anderson <span dir="ltr"><<a href="mailto:ganderson@raywhite.com" target="_blank">ganderson@raywhite.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">My question would be regarding buffer sizes. Looking at the Dell S3048-ON BaseT switch, it has only 4MB buffers, the SFP+ S4048-ON has 12MB buffers, but this is about 1/10th to 1/3 (respectively) of what a Nexus 9300 series has (~37-52MB).
<div><br>
</div>
<div>Is this really enough to run a converged network environment in a datacentre, especially with iSCSI being one of those protocols?</div>
<div><br>
</div>
<div>(Appreciate any advice either on or off list)</div>
<div><br>
</div>
<div>Thanks,<br>
Greg.</div>
<div><br>
<div>
<div class="gmail_quote">
<div>
<div class="h5">
<div dir="ltr">On Mon, 4 Jul 2016 at 14:46 Matt Smee <<a href="mailto:m.smee@unsw.edu.au" target="_blank">m.smee@unsw.edu.au</a>> wrote:<br>
</div>
</div>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
<div class="h5">
<div lang="EN-AU" link="#0563C1" vlink="#954F72">
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">For what it’s worth, I remember hearing Cumulus now supports PoE+ from 3.0+ though limited hardware so far:<u></u><u></u></span></p>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><u></u> <u></u></span></p>
<p class="MsoNormal" style="background:white"><a href="https://docs.cumulusnetworks.com/display/DOCS/Power+over+Ethernet+-+PoE" target="_blank"><span style="font-size:10.0pt;font-family:"Tahoma",sans-serif;color:windowtext">https://docs.cumulusnetworks.com/display/DOCS/Power+over+Ethernet+-+PoE</span></a><span style="font-size:10.0pt;font-family:"Tahoma",sans-serif"><u></u><u></u></span></p>
<p class="MsoNormal" style="background:white"><a href="https://cumulusnetworks.com/support/linux-hardware-compatibility-list/" target="_blank"><span style="font-size:10.0pt;font-family:"Tahoma",sans-serif;color:windowtext">https://cumulusnetworks.com/support/linux-hardware-compatibility-list/</span></a><span style="font-size:10.0pt;font-family:"Tahoma",sans-serif"><u></u><u></u></span></p>
<p class="MsoNormal" style="background:white"><span style="font-size:10.0pt;font-family:"Tahoma",sans-serif">‘edgecore
</span><a href="http://www.edge-core.com/ProdDtl.asp?sno=472&AS4610-54P" target="_blank"><span style="font-size:10.5pt;font-family:"Arial",sans-serif;color:windowtext;background:white;text-decoration:none">AS4610-54P</span></a>’<u></u><u></u></p>
<p class="MsoNormal" style="background:white"><u></u> <u></u></p>
<p class="MsoNormal" style="background:white">I’ve been impressed with the zero touch deployment part of it but still learning/playing with it at the moment. Though it doesn’t seem quite yet ideal in the enterprise access space, there’s some missing features
that I do like such as the various L2 security options but then again it’s definitely more Data Centre focused than enterprise access, though that may change in the future…<u></u><u></u></p>
<p class="MsoNormal" style="background:white">
<u></u><u></u></p>
<p class="MsoNormal" style="background:white">I’d also give a +1 to Ben, why pay so much for simple routing/L3 switching? In 3-5 years with some maturity I can’t see how you could ever justify the $bigvendor prices for some deployments or at least some devices
within the network. Looking at doing 40/100G and we can see its definitely looking like a good option even now.<u></u><u></u></p>
<p class="MsoNormal" style="background:white"><span style="font-size:10.0pt;font-family:"Tahoma",sans-serif;color:black"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> AusNOG [mailto:<a href="mailto:ausnog-bounces@lists.ausnog.net" target="_blank">ausnog-bounces@lists.ausnog.net</a>]
<b>On Behalf Of </b>Simon Attwell<br>
<b>Sent:</b> Monday, 4 July 2016 12:35 PM<br>
<b>To:</b> <a href="mailto:ausnog@lists.ausnog.net" target="_blank">ausnog@lists.ausnog.net</a><br>
<b>Subject:</b> [AusNOG] Open Networking<u></u><u></u></span></p>
</div>
</div>
<div lang="EN-AU" link="#0563C1" vlink="#954F72">
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">Hi All,<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">Just curious how many of you have deployed / are deploying / Open Networking in production environments.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">I'm interested to see if ON is making its way down to the edge (1Gbps PoE/PoE+) or if it's mainly being used at the distribution / core layers or at the service provider level where there's little
end device connectivity and it's more about moving the packets around.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">Comments on hardware choice / stability / longevity / MTBF / support, are also appreciated.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">From a Cumulus perspective it looks like 1 Gbps - 100Gbps is where things are focused. <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">Nothing with PoE/PoE+ support so it looks like at the moment we're only talking about datacenter switching.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">What I don't see deployed today is a lot of technology mix, especially in switching. Customers have a preference and for support / interop / personal reasons tend to stick with a single vendor
for switching.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">In the past this has made sense as switches did not always play well with others.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">I'm wondering what you all think the 3 - 5 year picture looks like.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">I suspect it looks a lot like the current virtualization market. A few major players with custom software built on open source foundations, being hardware agnostic and the holdouts trying to
ignore the fact that the industry is fundamentally changing.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">- Simon<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><u></u> <u></u></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
_______________________________________________<span class=""><br>
AusNOG mailing list<br>
<a href="mailto:AusNOG@lists.ausnog.net" target="_blank">AusNOG@lists.ausnog.net</a><br>
<a href="http://lists.ausnog.net/mailman/listinfo/ausnog" rel="noreferrer" target="_blank">http://lists.ausnog.net/mailman/listinfo/ausnog</a><br>
</span></blockquote>
</div>
</div>
</div>
</div>
<br>
_______________________________________________<br>
AusNOG mailing list<br>
<a href="mailto:AusNOG@lists.ausnog.net">AusNOG@lists.ausnog.net</a><br>
<a href="http://lists.ausnog.net/mailman/listinfo/ausnog" rel="noreferrer" target="_blank">http://lists.ausnog.net/mailman/listinfo/ausnog</a><br>
<br>
</blockquote>
</div>
<br>
<br clear="all">
<div><br>
</div>
-- <br>
<div class="gmail_signature" data-smartmail="gmail_signature">
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div dir="ltr">
<div dir="ltr"><b>Andrew Yager, CEO</b> <i>(BCompSc, JNCIS-SP, MACS (Snr) CP)</i><br>
</div>
<div dir="ltr">Real World Technology Solutions - IT People you can trust</div>
<div dir="ltr">Voice | Data | IT Procurement | Managed IT</div>
<div dir="ltr"><a href="http://rwts.com.au" target="_blank">rwts.com.au</a> | 1300 798 718</div>
<div dir="ltr"><br>
</div>
<div dir="ltr"><img src="http://www.rwts.com.au/email-signature-logo.jpg"><br>
</div>
<div dir="ltr"><i style="font-family:arial;font-size:small">Real World is a Dell Premier Partner</i><br>
</div>
<div dir="ltr"><br>
</div>
<div dir="ltr">This document should be read only by those persons to whom it is addressed and its content is not intended for use by any other persons. If you have received this message in error, please notify us immediately. Please also destroy and delete
the message from your computer. Any unauthorised form of reproduction of this message is strictly prohibited. We are not liable for the proper and complete transmission of the information contained in this communication, nor for any delay in its receipt. Please
consider the environment before printing this e-mail.</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
<blockquote type="cite">
<div><span>_______________________________________________</span><br>
<span>AusNOG mailing list</span><br>
<span><a href="mailto:AusNOG@lists.ausnog.net">AusNOG@lists.ausnog.net</a></span><br>
<span><a href="http://lists.ausnog.net/mailman/listinfo/ausnog">http://lists.ausnog.net/mailman/listinfo/ausnog</a></span><br>
</div>
</blockquote>
</body>
</html>