<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";
mso-fareast-language:EN-US;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
span.EmailStyle18
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";
mso-fareast-language:EN-US;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:396175087;
mso-list-type:hybrid;
mso-list-template-ids:632296628 -940510228 201916419 201916421 201916417 201916419 201916421 201916417 201916419 201916421;}
@list l0:level1
{mso-level-start-at:0;
mso-level-number-format:bullet;
mso-level-text:-;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:"Calibri","sans-serif";
mso-fareast-font-family:Calibri;}
@list l0:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:"Courier New";}
@list l0:level3
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Wingdings;}
@list l0:level4
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Symbol;}
@list l0:level5
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:"Courier New";}
@list l0:level6
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Wingdings;}
@list l0:level7
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Symbol;}
@list l0:level8
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:"Courier New";}
@list l0:level9
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Wingdings;}
ol
{margin-bottom:0cm;}
ul
{margin-bottom:0cm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-AU link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span style='color:#1F497D'>Hi All,<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>On the TCP Window size of things… Is there a way for the border routers/switches on each end of the VPLS to be able to handle this so that manually setting TCP Window and TCP Window scaling on every single Windows Desktop PC/server isn’t required? <o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>I just did some further tests, and from a Centos/Linux virtual machine in Sydney, I can get 100Mbps to the iiNet FTP, and to both Perth sites.<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>--2011-04-05 20:03:02-- ftp://ftp.iinet.net.au/test500MB.dat<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'> => `test500MB.dat'<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Resolving ftp.iinet.net.au... 203.0.178.32<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Connecting to ftp.iinet.net.au|203.0.178.32|:21... connected.<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Logging in as anonymous ... Logged in!<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>==> SYST ... done. ==> PWD ... done.<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>==> TYPE I ... done. ==> CWD not needed.<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>==> SIZE test500MB.dat ... 500000000<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>==> PASV ... done. ==> RETR test500MB.dat ... done.<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Length: 500000000 (477M)<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>100%[===================================================================================================================================================================================================>] 500,000,000 10.1M/s in 46s<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>2011-04-05 20:03:48 (10.3 MB/s) - `test500MB.dat' saved [500000000]<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>From a Windows server on the same subnet/switch, I get 4.5MB/s…. So it seems like the link itself is fine, and it is indeed TCP Window related. Why this behaviour is so radically different between Windows and Linux is quite suprising.<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Thanks,<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Greg<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm'><p class=MsoNormal><b><span lang=EN-US style='font-size:10.0pt;font-family:"Tahoma","sans-serif";mso-fareast-language:EN-AU'>From:</span></b><span lang=EN-US style='font-size:10.0pt;font-family:"Tahoma","sans-serif";mso-fareast-language:EN-AU'> ausnog-bounces@lists.ausnog.net [mailto:ausnog-bounces@lists.ausnog.net] <b>On Behalf Of </b>Greg M<br><b>Sent:</b> Tuesday, 5 April 2011 4:45 PM<br><b>To:</b> ausnog@lists.ausnog.net<br><b>Subject:</b> Re: [AusNOG] Looking for someone who has experience with Nextgen VPLS<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><span style='color:#1F497D'>Thanks for everyone’s replies – I was able to do extensive troubleshooting today thanks to the excellent replies on and off-list, and it turns out that there may be multiple issues at play, including too many MAC’s on the circuit, et al.<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>It also seems that Telstra has not enabled 802.1q-in-q on their end so we are seeing a lot of encapsulation errors, and can only push traffic across VLAN1 from the Sydney side. They are now telling Nextgen that they cant enable Q-in-q, which could point to Nextgen provisioning the wrong type of Telstra service for us:<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>The order from LOLO states “</span><span lang=EN-US style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>Telstra Wholesale Business Grade Ethernet Service N275XXXXX for Nextgen Networks”</span><span style='color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Is this a L3 only service?<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Since this morning, we have only been able to push 10Mbps through this VPLS circuit as well, so there definitely seems to be some faults on the Nextgen/Telstra side of the circuit, even though they claim everything is configured correctly.<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Cheers,<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Greg<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm'><p class=MsoNormal><b><span lang=EN-US style='font-size:10.0pt;font-family:"Tahoma","sans-serif";mso-fareast-language:EN-AU'>From:</span></b><span lang=EN-US style='font-size:10.0pt;font-family:"Tahoma","sans-serif";mso-fareast-language:EN-AU'> ausnog-bounces@lists.ausnog.net [mailto:ausnog-bounces@lists.ausnog.net] <b>On Behalf Of </b>Greg M<br><b>Sent:</b> Monday, 4 April 2011 7:07 PM<br><b>To:</b> ausnog@lists.ausnog.net<br><b>Subject:</b> [AusNOG] Looking for someone who has experience with Nextgen VPLS<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Hi Noggers,<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>I am looking for someone who is able to consult/provide support to a large organisation which has recently deployed a 100M Nextgen VPLS link between an office in Perth & Sydney, and is experiencing the most bizzare throughput issues.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>This link has Nextgen fiber in Perth, with Telstra fiber hand off in Sydney, resold via Nextgen as an end-to-end VPLS circuit.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>The issue we face is relating to speed.<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>From Switch A In Sydney to Switch B in Perth, we can do a non-df ping of 1500 bytes for 24 hours without a single dropped packet - so there are no MTU issues. Latency is also always stable, even when maxing the link at 100Mbps.<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>Each server in Sydney connected to Switch A, can push the full VPLS line speed of 100Mbps to servers connected to Switch B in Perth (two endpoints of the VPLS tails)<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>There is a 3<sup>rd</sup> site in Perth that has a 1Gbps Amcom fiber link directly between Switch C in this site, and Switch B in the other Perth site.<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>Some systems on Switch A in Sydney, can push 100Mbps to some servers on Switch C in Perth site #2, yet others can only push 10Mbp, while some can only push 1-3Mbps. There are no speed issues between the two Perth sites, however as they can happily pump a full 1Gbps to each other.<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>There is a 100Mbps link to WAIX connecting into Switch B in Perth. Perth site #2 can do full 100mbps to a test FTP download (lets say iiNet’s 500MB test file on their FTP), yet Sydney can only get 45Mbps.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Basically only the directly connected Sydney Switch and Perth switch are able to max out the 100Mbps VPLS circuit. As soon as traffic goes beyond this switch, speed seems to degrade – however it doesn’t degrade to all locations, as some systems/servers can obtain a full 100Mbps transfer speed both inbound and outbound via the Sydney to Perth VPLS. In Perth sites #1 and #2, there are no speed issues at all, to any site (there are other remote VPLS and other connected endpoints), it is only this specific site that is having issues.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>There are no errors on any of the interfaces in any of the Perth sites, however the Sydney site reports a lot of Outbound Discards on the switch port that connects to the Telstra/nextgen VPLS link in Sydney.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Happy to receive responses on or off-list, and we are happy to pay for someone either locally in Sydney or in Perth to help diagnose this – as a lot of money is being burnt on this circuit that is not providing consistent speeds. We have raised these issues to both Nextgen and Telstra and they are pointing the finger at our internal network.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Thanks!<o:p></o:p></p><p class=MsoNormal><br>Greg<o:p></o:p></p></div></body></html>