<html><body> <br />
If you have time to wait, Mikrotik are releasing a new CCR item later this year. It will be interesting to see througput figures.<br /><br /><br /><div dir="ltr" style="font-size:18.6667px;font-family:sans-serif;"><small>CCR1072</small></div><div dir="ltr" style="font-size:18.6667px;font-family:sans-serif;"><small> (72 core Tilera CPU, 8x 10GBit SFP+, dual PSU and more, coming Q4, 2014),<br /><br />There are also some new/other CCR's coming to market with more SFP ports :)<br /><br />As detailed in this recent .PDF <a href="http://mum.mikrotik.com/presentations/IT14/it14.pdf">http://mum.mikrotik.com/presentations/IT14/it14.pdf</a><br /></small></div><small><br /></small>Cheers<br />Greg.<br /><br /><blockquote><br />----- Original Message -----<br /><div style="width:100%;background:rgb(228,228,228);"><div style="font-weight:bold;">From:</div> "Alex Samad - Yieldbroker" <Alex.Samad@yieldbroker.com></div><br /><div style="font-weight:bold;">To:</div>"Tom Berryman" <tom@connectivityit.com.au>, "David Bomba" <turbo124@gmail.com>, "Damian Guppy" <the.damo@gmail.com><br /><div style="font-weight:bold;">Cc:</div>"ausnog@lists.ausnog.net" <ausnog@lists.ausnog.net><br /><div style="font-weight:bold;">Sent:</div>Mon, 10 Mar 2014 03:04:52 +0000<br /><div style="font-weight:bold;">Subject:</div>Re: [AusNOG] RouterBoard<br /><br /><br /><div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;">Hi</span></p><p></p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;"></span></p><p> </p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;">Yeah I have read a bit about the single core issues on the CCR, the last time I looked because of this I saw 3 cpu’s floating around 30-60% non-maxed</span></p><p></p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;"></span></p><p> </p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;">I started this by looking at VM routers, but I couldn’t get pas the 1Gb/s nic. There is Brocades vyatta, but its just way to expensive compared to routeros</span></p><p></p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;"></span></p><p> </p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;">My constraints are more along the lines of, I have core switching already, I wanted to add some core routing</span></p><p></p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;">I am happy with the CCR on $$ on CLI</span></p><p></p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;">I am not so happy about the current performance, be that limited to my testing via iperf… I am nearly ready to live with that, on the presumption I can get
8+Gbs with multi stream tcp.</span></p><p></p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;"></span></p><p> </p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;">My current risk is support, especially as I have had a hard time working through this CCR performance issue. I don’t want to roll out 2 of these at each DC
and then run into a bug, where the only solution is to throw it away. I can duplicate about all the functionality of routeros on linux apart from BGP and OSPF. And I am guessing if I looked really hard and spent some time I could get that working as well.</span></p><p></p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;"></span></p><p> </p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;">So taking into account their low $$ I can also live with minimal support if I have another hardware solution to match up with it on a similar $$ level. If
they can talk iBGP, OSPF and VRRP, then I am just about set. </span><span style="font-size:11pt;font-family:Wingdings;color:#1F497D;">J</span><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;"></span></p><p></p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;"></span></p><p> </p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;">So I thought I would dig into the knowledge pool that is AUSNOG and find out what other devices like RouterOS are being used..</span></p><p></p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;"></span></p><p> </p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;">Alex</span></p><p></p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;"></span></p><p> </p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;"></span></p><p> </p><p></p>
<div style="border:none;border-left:solid #0000FF 1.5pt;padding:0cm 0cm 0cm 4pt;">
<div>
<div style="border:none;border-top:solid #B5C4DF 1pt;padding:3pt 0cm 0cm 0cm;">
<p class="MsoNormal"><b><span style="font-size:10pt;font-family:Tahoma, 'sans-serif';" lang="en-us" xml:lang="en-us">From:</span></b><span style="font-size:10pt;font-family:Tahoma, 'sans-serif';" lang="en-us" xml:lang="en-us"> AusNOG [mailto:ausnog-bounces@lists.ausnog.net]
<b>On Behalf Of </b>Tom Berryman<br /><b>Sent:</b> Monday, 10 March 2014 1:45 PM<br /><b>To:</b> David Bomba; Damian Guppy<br /><b>Cc:</b> ausnog@lists.ausnog.net<br /><b>Subject:</b> Re: [AusNOG] RouterBoard</span></p><p></p><p></p>
</div>
</div>
<p class="MsoNormal"></p><p> </p><p></p>
<p class="MsoNormal"><a><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;">David is correct, the Tilera CPU with RouterOS does struggle with single threaded processes – worse than
just BGP operating on a single core, all routing (OSPF, RIP and static) processing will happen on the same core. ROS7 is likely to change this (rumours).</span></a><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;"></span></p><p></p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;">But still, the CCR range has forced a lot of people to change how they think about routing (at a relatively small scale) – and has
certainly bought the cost down. “Routed” packets per dollar, I don’t think anything in the new hardware market can compete.</span></p><p></p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;">Vyatta has other challenges like x86 PCI architecture that will limit your total throughput – however things like processing BGP
are drastically improved compared to ROS. Ubiquity has ported the Vyatta/VyOS to MIPS processors, possibly worth a look but I don’t think it has any SFP+.</span></p><p></p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;">Given Alex’s application – storage – a layer 3 solution is not likely to be the best.
</span></p><p></p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;">Alex, have you considered something like the Brocade VDX Ethernet fabric (VDX could enable 40g native interfaces)? Or at least other
layer 2 solutions? I noticed that you have tried routing on switches (Dell) perhaps something with some more power with this design would yield better results for you?</span></p><p></p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;">Tom</span><b><span style="font-size:10pt;font-family:Arial, 'sans-serif';color:#002060;"></span></b></p><p></p><p></p>
<p class="MsoNormal"><b><span style="font-size:10pt;font-family:Arial, 'sans-serif';color:#002060;"></span></b></p><p><b> </b></p><p></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri, 'sans-serif';color:#1F497D;"></span></p><p> </p><p></p>
<p class="MsoNormal"><b><span style="font-size:11pt;font-family:Calibri, 'sans-serif';" lang="en-us" xml:lang="en-us">From:</span></b><span style="font-size:11pt;font-family:Calibri, 'sans-serif';" lang="en-us" xml:lang="en-us"> AusNOG [<a href="mailto:ausnog-bounces@lists.ausnog.net">mailto:ausnog-bounces@listsausnog.net</a>]
<b>On Behalf Of </b>David Bomba<br /><b>Sent:</b> Monday, 10 March 2014 12:32 PM<br /><b>To:</b> Damian Guppy<br /><b>Cc:</b> <a href="mailto:ausnog@lists.ausnog.net">ausnog@lists.ausnog.net</a><br /><b>Subject:</b> Re: [AusNOG] RouterBoard</span></p><p></p><p></p>
<p class="MsoNormal"></p><p> </p><p></p>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12pt;">I believe he has the CCR1036-8G-2S+ which has 2x10GB SFP+ ports.<br /><br />
I think the issue he is hitting is the single threaded nature of routerOS for a lot of its functionality.</p><p></p><p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12pt;">BGP, for instance spins on a single core. Until ROS becomes multi-core aware/capable a lot of its functionality will be capped at the per core performance.</p><p></p><p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12pt;"></p><p> </p><p></p>
<div>
<p class="MsoNormal">On 10 March 2014 12:26, Damian Guppy <<a href="mailto:the.damo@gmail.com">the.damo@gmail.com</a>> wrote:</p><p></p><p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1pt;padding:0cm 0cm 0cm 6pt;margin-left:4.8pt;margin-top:5pt;margin-right:0cm;margin-bottom:5pt;">
<div>
<div>
<p class="MsoNormal">CCR1036 has no 10G ports, only 1G, so im not sure why you would expect to get a single TCP stream past 1G (even with LACP since that is not how LACP works)</p><p></p><p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:#888888;"></span></p><p> </p><p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:#888888;">--Damian</span></p><p></p><p></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal"></p><p> </p><p></p>
<div>
<p class="MsoNormal">On Mon, Mar 10, 2014 at 6:58 AM, Alex Samad - Yieldbroker <<a href="mailto:Alex.Samad@yieldbroker.com">Alex.Samad@yieldbroker.com</a>> wrote:</p><p></p><p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1pt;padding:0cm 0cm 0cm 6pt;margin-left:4.8pt;margin-top:5pt;margin-right:0cm;margin-bottom:5pt;">
<p class="MsoNormal">Hi<br /><br /><br />
So I have tested routerOS ... in VM and also bought the ccr1036.<br /><br />
I'm not 100% happy with the ccr1036. Basically can't push 1 tcp stream past 1Gb/s I can get 8-9Gb/s with multiple streams. I can get UDP up to 9.8Gb/s<br /><br />
I like routerOS interface (have to admit I like the vyatta better from what I saw).<br /><br />
But now I need to find something similar to these devices around the same price and around the same performance, I would like to push it all to a VM but Brocade want my 1st and 2nd child ...<br /><br />
So routerOS support is nowhere close to Cisco and rightly so for the price, so I have some hesitancy in rolling these things out, especially if they are going into the core.<br /><br />
So are there any suggestions from the list ?<br /><br />
Alex<br /><br />
_______________________________________________<br />
AusNOG mailing list<br /><a href="mailto:AusNOG@lists.ausnog.net">AusNOG@lists.ausnog.net</a><br /><a href="http://lists.ausnog.net/mailman/listinfo/ausnog">http://lists.ausnog.net/mailman/listinfo/ausnog</a></p><p></p><p></p>
</blockquote>
</div>
<p class="MsoNormal"></p><p> </p><p></p>
</div>
</div>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12pt;"><br />
_______________________________________________<br />
AusNOG mailing list<br /><a href="mailto:AusNOG@lists.ausnog.net">AusNOG@lists.ausnog.net</a><br /><a href="http://lists.ausnog.net/mailman/listinfo/ausnog">http://lists.ausnog.net/mailman/listinfo/ausnog</a></p><p></p><p></p>
</blockquote>
</div>
<p class="MsoNormal"></p><p> </p><p></p>
</div>
</div>
</div>
</blockquote></body></html>