<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoPlainText, li.MsoPlainText, div.MsoPlainText
{mso-style-priority:99;
mso-style-link:"Plain Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.PlainTextChar
{mso-style-name:"Plain Text Char";
mso-style-priority:99;
mso-style-link:"Plain Text";
font-family:"Calibri","sans-serif";}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoPlainText>The Tilera CPU is extremely powerful... great to see the new 72 core CPU being used in the new CCR<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>The 72 core data sheet can be found here - <a href="http://www.tilera.com/sites/default/files/productbriefs/TILE-Gx8072_PB041-03_WEB.pdf">http://www.tilera.com/sites/default/files/productbriefs/TILE-Gx8072_PB041-03_WEB.pdf</a> <o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>NSFOCUS use the pro version of the Telera TilePro64 CPU for its ADS 6020 DDoS mitigation platform for those interested the spec sheet can be found here<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><a href="http://www.tilera.com/sites/default/files/productbriefs/TILEPro64_Processor_PB019_v4.pdf">http://www.tilera.com/sites/default/files/productbriefs/TILEPro64_Processor_PB019_v4.pdf</a> <o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>Kindest Regards<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><b><span style='font-family:"Verdana","sans-serif";color:black'>James Braunegg<br></span></b><b><span style='font-size:8.0pt;font-family:"Verdana","sans-serif";color:black'>P:</span></b><span style='font-size:8.0pt;font-family:"Verdana","sans-serif";color:black'> 1300 769 972 | <b>M:</b> 0488 997 207 | <b>D:</b> (03) 9751 7616</span><span style='font-size:8.0pt;font-family:"Verdana","sans-serif";color:black'><o:p></o:p></span></p><p class=MsoNormal><b><span style='font-size:8.0pt;font-family:"Verdana","sans-serif";color:black'>E:</span></b><span style='font-size:8.0pt;font-family:"Verdana","sans-serif";color:black'> </span><span style='color:black'><a href="mailto:james.braunegg@micron21.com"><span style='font-size:8.0pt;font-family:"Verdana","sans-serif";color:black'>james.braunegg@micron21.com</span></a></span><span style='font-size:8.0pt;font-family:"Verdana","sans-serif";color:black'> | <b>ABN:</b> 12 109 977 666 <br><b>W:</b> <a href="http://www.micron21.com/ddos-protection"><span style='color:black'>www.micron21.com/ddos-protection</span></a> <b>T:</b> @micron21<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:8.0pt;font-family:"Verdana","sans-serif";color:black'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:8.0pt;font-family:"Verdana","sans-serif";color:black'><br><img border=0 width=250 height=39 id="Picture_x0020_1" src="cid:image001.jpg@01CF3D21.F94D94E0" alt="Description: Description: Description: Description: M21.jpg"><br></span><span lang=EN-AU style='font-size:8.0pt;font-family:"Verdana","sans-serif";color:black'>This message is intended for the addressee named above. It may contain privileged or confidential information. If you are not the intended recipient of this message you must not use, copy, distribute or disclose it to anyone other than the addressee. If you have received this message in error please return the message to the sender by replying to it and then delete the message from your computer.</span><span style='font-size:8.0pt;font-family:"Verdana","sans-serif";color:black'><o:p></o:p></span></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>-----Original Message-----<br>From: AusNOG [mailto:ausnog-bounces@lists.ausnog.net] On Behalf Of Alex Samad - Yieldbroker<br>Sent: Tuesday, March 11, 2014 11:53 AM<br>To: mclennan@internode.on.net<br>Cc: ausnog@lists.ausnog.net<br>Subject: Re: [AusNOG] RouterBoard</p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>Lol as murphy would have it i saw this about 2 days after I got my devices<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>Sent from my smart phone<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>-----Original Message-----<o:p></o:p></p><p class=MsoPlainText>From: Greg McLennan [mclennan@internode.on.net]<o:p></o:p></p><p class=MsoPlainText>Received: Tuesday, 11 Mar 2014, 11:51<o:p></o:p></p><p class=MsoPlainText>To: Alex Samad - Yieldbroker [Alex.Samad@yieldbroker.com]<o:p></o:p></p><p class=MsoPlainText>CC: <a href="mailto:ausnog@lists.ausnog.net"><span style='color:windowtext;text-decoration:none'>ausnog@lists.ausnog.net</span></a> [ausnog@lists.ausnog.net]<o:p></o:p></p><p class=MsoPlainText>Subject: Re: [AusNOG] RouterBoard<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>If you have time to wait, Mikrotik are releasing a new CCR item later this year. It will be interesting to see througput figures.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>CCR1072<o:p></o:p></p><p class=MsoPlainText>(72 core Tilera CPU, 8x 10GBit SFP+, dual PSU and more, coming Q4, 2014),<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>There are also some new/other CCR's coming to market with more SFP ports :)<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>As detailed in this recent .PDF <a href="http://mum.mikrotik.com/presentations/IT14/it14.pdf"><span style='color:windowtext;text-decoration:none'>http://mum.mikrotik.com/presentations/IT14/it14.pdf</span></a><o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>Cheers<o:p></o:p></p><p class=MsoPlainText>Greg.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>----- Original Message -----<o:p></o:p></p><p class=MsoPlainText>From:<o:p></o:p></p><p class=MsoPlainText>"Alex Samad - Yieldbroker" <<a href="mailto:Alex.Samad@yieldbroker.com"><span style='color:windowtext;text-decoration:none'>Alex.Samad@yieldbroker.com</span></a>><o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>To:<o:p></o:p></p><p class=MsoPlainText>"Tom Berryman" <<a href="mailto:tom@connectivityit.com.au"><span style='color:windowtext;text-decoration:none'>tom@connectivityit.com.au</span></a>>, "David Bomba" <<a href="mailto:turbo124@gmail.com"><span style='color:windowtext;text-decoration:none'>turbo124@gmail.com</span></a>>, "Damian Guppy" <<a href="mailto:the.damo@gmail.com"><span style='color:windowtext;text-decoration:none'>the.damo@gmail.com</span></a>><o:p></o:p></p><p class=MsoPlainText>Cc:<o:p></o:p></p><p class=MsoPlainText>"<a href="mailto:ausnog@lists.ausnog.net"><span style='color:windowtext;text-decoration:none'>ausnog@lists.ausnog.net</span></a>" <<a href="mailto:ausnog@lists.ausnog.net"><span style='color:windowtext;text-decoration:none'>ausnog@lists.ausnog.net</span></a>><o:p></o:p></p><p class=MsoPlainText>Sent:<o:p></o:p></p><p class=MsoPlainText>Mon, 10 Mar 2014 03:04:52 +0000<o:p></o:p></p><p class=MsoPlainText>Subject:<o:p></o:p></p><p class=MsoPlainText>Re: [AusNOG] RouterBoard<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>Hi<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>Yeah I have read a bit about the single core issues on the CCR, the last time I looked because of this I saw 3 cpu’s floating around 30-60% non-maxed<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>I started this by looking at VM routers, but I couldn’t get pas the 1Gb/s nic. There is Brocades vyatta, but its just way to expensive compared to routeros<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>My constraints are more along the lines of, I have core switching already, I wanted to add some core routing I am happy with the CCR on $$ on CLI I am not so happy about the current performance, be that limited to my testing via iperf… I am nearly ready to live with that, on the presumption I can get 8+Gbs with multi stream tcp.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>My current risk is support, especially as I have had a hard time working through this CCR performance issue. I don’t want to roll out 2 of these at each DC and then run into a bug, where the only solution is to throw it away. I can duplicate about all the functionality of routeros on linux apart from BGP and OSPF. And I am guessing if I looked really hard and spent some time I could get that working as well.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>So taking into account their low $$ I can also live with minimal support if I have another hardware solution to match up with it on a similar $$ level. If they can talk iBGP, OSPF and VRRP, then I am just about set. :)<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>So I thought I would dig into the knowledge pool that is AUSNOG and find out what other devices like RouterOS are being used..<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>Alex<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>From: AusNOG [<a href="mailto:ausnog-bounces@lists.ausnog.net"><span style='color:windowtext;text-decoration:none'>mailto:ausnog-bounces@lists.ausnog.net</span></a>] On Behalf Of Tom Berryman<o:p></o:p></p><p class=MsoPlainText>Sent: Monday, 10 March 2014 1:45 PM<o:p></o:p></p><p class=MsoPlainText>To: David Bomba; Damian Guppy<o:p></o:p></p><p class=MsoPlainText>Cc: <a href="mailto:ausnog@lists.ausnog.net"><span style='color:windowtext;text-decoration:none'>ausnog@lists.ausnog.net</span></a><o:p></o:p></p><p class=MsoPlainText>Subject: Re: [AusNOG] RouterBoard<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>David is correct, the Tilera CPU with RouterOS does struggle with single threaded processes – worse than just BGP operating on a single core, all routing (OSPF, RIP and static) processing will happen on the same core. ROS7 is likely to change this (rumours).<o:p></o:p></p><p class=MsoPlainText>But still, the CCR range has forced a lot of people to change how they think about routing (at a relatively small scale) – and has certainly bought the cost down. “Routed” packets per dollar, I don’t think anything in the new hardware market can compete.<o:p></o:p></p><p class=MsoPlainText>Vyatta has other challenges like x86 PCI architecture that will limit your total throughput – however things like processing BGP are drastically improved compared to ROS. Ubiquity has ported the Vyatta/VyOS to MIPS processors, possibly worth a look but I don’t think it has any SFP+.<o:p></o:p></p><p class=MsoPlainText>Given Alex’s application – storage – a layer 3 solution is not likely to be the best.<o:p></o:p></p><p class=MsoPlainText>Alex, have you considered something like the Brocade VDX Ethernet fabric (VDX could enable 40g native interfaces)? Or at least other layer 2 solutions? I noticed that you have tried routing on switches (Dell) perhaps something with some more power with this design would yield better results for you?<o:p></o:p></p><p class=MsoPlainText>Tom<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>From: AusNOG [<a href="mailto:ausnog-bounces@listsausnog.net%3cmailto:ausnog-bounces@lists.ausnog.net%3e"><span style='color:windowtext;text-decoration:none'>mailto:ausnog-bounces@listsausnog.net<mailto:ausnog-bounces@lists.ausnog.net></span></a>] On Behalf Of David Bomba<o:p></o:p></p><p class=MsoPlainText>Sent: Monday, 10 March 2014 12:32 PM<o:p></o:p></p><p class=MsoPlainText>To: Damian Guppy<o:p></o:p></p><p class=MsoPlainText>Cc: <a href="mailto:ausnog@lists.ausnog.net%3cmailto:ausnog@lists.ausnog.net"><span style='color:windowtext;text-decoration:none'>ausnog@lists.ausnog.net<mailto:ausnog@lists.ausnog.net</span></a>><o:p></o:p></p><p class=MsoPlainText>Subject: Re: [AusNOG] RouterBoard<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>I believe he has the CCR1036-8G-2S+ which has 2x10GB SFP+ ports.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>I think the issue he is hitting is the single threaded nature of routerOS for a lot of its functionality.<o:p></o:p></p><p class=MsoPlainText>BGP, for instance spins on a single core. Until ROS becomes multi-core aware/capable a lot of its functionality will be capped at the per core performance.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>On 10 March 2014 12:26, Damian Guppy <<a href="mailto:the.damo@gmail.com%3cmailto:the.damo@gmail.com"><span style='color:windowtext;text-decoration:none'>the.damo@gmail.com<mailto:the.damo@gmail.com</span></a>>> wrote:<o:p></o:p></p><p class=MsoPlainText>CCR1036 has no 10G ports, only 1G, so im not sure why you would expect to get a single TCP stream past 1G (even with LACP since that is not how LACP works)<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>--Damian<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>On Mon, Mar 10, 2014 at 6:58 AM, Alex Samad - Yieldbroker <<a href="mailto:Alex.Samad@yieldbroker.com%3cmailto:Alex.Samad@yieldbroker.com"><span style='color:windowtext;text-decoration:none'>Alex.Samad@yieldbroker.com<mailto:Alex.Samad@yieldbroker.com</span></a>>> wrote:<o:p></o:p></p><p class=MsoPlainText>Hi<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>So I have tested routerOS ... in VM and also bought the ccr1036.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>I'm not 100% happy with the ccr1036. Basically can't push 1 tcp stream past 1Gb/s I can get 8-9Gb/s with multiple streams. I can get UDP up to 9.8Gb/s<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>I like routerOS interface (have to admit I like the vyatta better from what I saw).<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>But now I need to find something similar to these devices around the same price and around the same performance, I would like to push it all to a VM but Brocade want my 1st and 2nd child ...<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>So routerOS support is nowhere close to Cisco and rightly so for the price, so I have some hesitancy in rolling these things out, especially if they are going into the core.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>So are there any suggestions from the list ?<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>Alex<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>_______________________________________________<o:p></o:p></p><p class=MsoPlainText>AusNOG mailing list<o:p></o:p></p><p class=MsoPlainText><a href="mailto:AusNOG@lists.ausnog.net%3cmailto:AusNOG@lists.ausnog.net"><span style='color:windowtext;text-decoration:none'>AusNOG@lists.ausnog.net<mailto:AusNOG@lists.ausnog.net</span></a>><o:p></o:p></p><p class=MsoPlainText><a href="http://lists.ausnog.net/mailman/listinfo/ausnog"><span style='color:windowtext;text-decoration:none'>http://lists.ausnog.net/mailman/listinfo/ausnog</span></a><o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>_______________________________________________<o:p></o:p></p><p class=MsoPlainText>AusNOG mailing list<o:p></o:p></p><p class=MsoPlainText><a href="mailto:AusNOG@lists.ausnog.net%3cmailto:AusNOG@lists.ausnog.net"><span style='color:windowtext;text-decoration:none'>AusNOG@lists.ausnog.net<mailto:AusNOG@lists.ausnog.net</span></a>><o:p></o:p></p><p class=MsoPlainText><a href="http://lists.ausnog.net/mailman/listinfo/ausnog"><span style='color:windowtext;text-decoration:none'>http://lists.ausnog.net/mailman/listinfo/ausnog</span></a><o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>_______________________________________________<o:p></o:p></p><p class=MsoPlainText>AusNOG mailing list<o:p></o:p></p><p class=MsoPlainText><a href="mailto:AusNOG@lists.ausnog.net"><span style='color:windowtext;text-decoration:none'>AusNOG@lists.ausnog.net</span></a><o:p></o:p></p><p class=MsoPlainText><a href="http://lists.ausnog.net/mailman/listinfo/ausnog"><span style='color:windowtext;text-decoration:none'>http://lists.ausnog.net/mailman/listinfo/ausnog</span></a><o:p></o:p></p></div></body></html>