[AusNOG] RouterBoard

Tom Berryman tom at connectivityit.com.au
Mon Mar 10 13:44:37 EST 2014

David is correct, the Tilera CPU with RouterOS does struggle with single threaded processes - worse than just BGP operating on a single core, all routing (OSPF, RIP and static) processing will happen on the same core. ROS7 is likely to change this (rumours).
But still, the CCR range has forced a lot of people to change how they think about routing (at a relatively small scale) - and has certainly bought the cost down. "Routed" packets per dollar, I don't think anything in the new hardware market can compete.
Vyatta has other challenges like x86 PCI architecture that will limit your total throughput - however things like processing BGP are drastically improved compared to ROS. Ubiquity has ported the Vyatta/VyOS to MIPS processors, possibly worth a look but I don't think it has any SFP+.
Given Alex's application - storage - a layer 3 solution is not likely to be the best.
Alex, have you considered something like the Brocade VDX Ethernet fabric (VDX could enable 40g native interfaces)? Or at least other layer 2 solutions? I noticed that you have tried routing on switches (Dell) perhaps something with some more power with this design would yield better results for you?

From: AusNOG [mailto:ausnog-bounces at lists.ausnog.net] On Behalf Of David Bomba
Sent: Monday, 10 March 2014 12:32 PM
To: Damian Guppy
Cc: ausnog at lists.ausnog.net
Subject: Re: [AusNOG] RouterBoard

I believe he has the CCR1036-8G-2S+ which has 2x10GB SFP+ ports.

I think the issue he is hitting is the single threaded nature of routerOS for a lot of its functionality.
BGP, for instance spins on a single core. Until ROS becomes multi-core aware/capable a lot of its functionality will be capped at the per core performance.

On 10 March 2014 12:26, Damian Guppy <the.damo at gmail.com<mailto:the.damo at gmail.com>> wrote:
CCR1036 has no 10G ports, only 1G, so im not sure why you would expect to get a single TCP stream past 1G (even with LACP since that is not how LACP works)


On Mon, Mar 10, 2014 at 6:58 AM, Alex Samad - Yieldbroker <Alex.Samad at yieldbroker.com<mailto:Alex.Samad at yieldbroker.com>> wrote:

So I have tested routerOS ... in VM and also bought the ccr1036.

I'm not 100% happy with the ccr1036.  Basically can't push 1 tcp stream past 1Gb/s I can get 8-9Gb/s with multiple streams. I can get UDP up to 9.8Gb/s

I like routerOS interface (have to admit I like the vyatta better from what I saw).

But now I need to find something similar to these devices around the same price and around the same performance, I would like to push it all to a VM but Brocade want my 1st and 2nd child ...

So routerOS support is nowhere close to Cisco and rightly so for the price, so I have some hesitancy in rolling these things out, especially if they are going into the core.

So are there any suggestions from the list ?


AusNOG mailing list
AusNOG at lists.ausnog.net<mailto:AusNOG at lists.ausnog.net>

AusNOG mailing list
AusNOG at lists.ausnog.net<mailto:AusNOG at lists.ausnog.net>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ausnog.net/pipermail/ausnog/attachments/20140310/de705ad9/attachment.html>

More information about the AusNOG mailing list