...EoMLPPPoE with byte-wise load balancing...<br><br>*hides* ;)))<br><br><div class="gmail_quote">On Thu, Nov 18, 2010 at 4:51 PM, Sean K. Finn <span dir="ltr"><<a href="mailto:sean.finn@ozservers.com.au">sean.finn@ozservers.com.au</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<div link="blue" vlink="purple" lang="EN-AU">
<div>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);">Fellow Noggers,</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);">In My experience,</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);">Bonding doesn’t make multiple 1gb cables into one bigger
virtual cable, but it does push different traffic from different sources across
different links. (In most configurations)</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);">*<b>OVERALL</b>*, you can breach 1GB/s for *<b>multiple
transfers</b>* to/from *<b>multiple hosts</b>* on multiple 1Gbs NIC’s.</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);">For single sessions however, it’s extremely difficult to
implement. This is a fact that is not referred to in much, if any documentation
at all. You kind of have to read between the lines to figure it out.</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);">I haven’t been able to replicate true bi-symmetric Load-Aggreagation
in a test lab, with almost unlimited configurations of Kit, switches, hardware
and different vendors. (Not through lack of trying)</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);">Data To/From one single host on one side of the
bonding to another single host on the other side of the boding wont breach
1gbps, but multiple to multiple, the aggregate will, with SOME types of
bonding.</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);">I hate linking to Wikipedia but this is a pretty good read:</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"><a href="http://en.wikipedia.org/wiki/IEEE_802.3" target="_blank">http://en.wikipedia.org/wiki/IEEE_802.3</a></span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);">Specifically:</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"><a href="http://en.wikipedia.org/wiki/802.3ad" target="_blank">http://en.wikipedia.org/wiki/802.3ad</a>
dealing with link aggregation and talking about one of the different types.
(802.3ad specifically)</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);">Have a read here for the different types of host load balancing</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"><a href="http://www.linuxhorizon.ro/bonding.html" target="_blank">http://www.linuxhorizon.ro/bonding.html</a></span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);">Even though the above link is a linux article, Teaming
INTEL Nic’s under windows server 2008R2 with the Intel drivers offers the
same policy choices.</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);">The most effective poor-mans bonding that I can see is Balance-ALB
( Which is Transmit Load Balancing, and Receive Load Balancing)</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);">I *<b>HAVE</b>* been able to replicate EITHER Receve Load
balancing, or Transmit load balancing from 1 host to 1 other host on a single
session breaching 1gbps, however never both at the same time.</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);">Some configurations support Inbound-only Load balancing from the
switch to your device, and other the polar opposite.</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);">That is, 4 Nic’s will bond in one direction, but back the
other way, only 1 NIC will bond.</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);">The hardest part to read in between the fine-print is that it’s
more systematic Load-Sharing of multiple sessions rather than Load-Sharing of
single sessions.</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);">If anyone has in practise managed to accomplish this and to genuinely
increase the throughput of a single IPv4 connection above the throughput of that
of a teamed single NIC, and can share with me how, I’ll owe you a beer.</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p><font color="#888888">
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);">S.</span></p></font><div><div></div><div class="h5">
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);"> </span></p>
<div>
<p class="MsoNormal"> </p>
</div>
<p class="MsoNormal"> </p>
<div class="MsoNormal" style="text-align: center;" align="center"><span lang="EN-US">
<hr align="center" width="100%" size="2">
</span></div>
<p class="MsoNormal" style="margin-bottom: 12pt;"><b><span style="font-size: 10pt;" lang="EN-US">From:</span></b><span style="font-size: 10pt;" lang="EN-US">
<a href="mailto:ausnog-bounces@lists.ausnog.net" target="_blank">ausnog-bounces@lists.ausnog.net</a> [mailto:<a href="mailto:ausnog-bounces@lists.ausnog.net" target="_blank">ausnog-bounces@lists.ausnog.net</a>] <b>On
Behalf Of </b>Bruce Renner<br>
<b>Sent:</b> Thursday, 18 November 2010 1:23 PM<br>
<b>To:</b> Jay Mitchell<br>
<b>Cc:</b> ausnog<br>
<b>Subject:</b> Re: [AusNOG] VM throughput to network</span><span lang="EN-US"></span></p>
<p class="MsoNormal">A quick google search revealed this. </p>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal"><a href="http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1004048" target="_blank">http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1004048</a></p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">The short answer is yes, ESX can use 2 or more nics to
improve throughput.</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">Cheers All, Bruce</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom: 12pt;"> </p>
<div>
<p class="MsoNormal">On Thu, Nov 18, 2010 at 12:44 PM, Jay Mitchell <<a href="mailto:jay@miscreant.org" target="_blank">jay@miscreant.org</a>> wrote:</p>
<div>
<div>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);">It’s
configurable at the VMWare side also:</span></p>
<p class="MsoNormal"> </p>
<p><span style="font-size: 11pt; color: rgb(31, 73, 125);">-</span><span style="font-size: 7pt; color: rgb(31, 73, 125);"> </span><span style="font-size: 11pt; color: rgb(31, 73, 125);">Route based on the originating virtual
port ID</span></p>
<p><span style="font-size: 11pt; color: rgb(31, 73, 125);">-</span><span style="font-size: 7pt; color: rgb(31, 73, 125);"> </span><span style="font-size: 11pt; color: rgb(31, 73, 125);">Route based in IP hash </span></p>
<p><span style="font-size: 11pt; color: rgb(31, 73, 125);">-</span><span style="font-size: 7pt; color: rgb(31, 73, 125);"> </span><span style="font-size: 11pt; color: rgb(31, 73, 125);">Route based on source MAC hash</span></p>
<p><span style="font-size: 11pt; color: rgb(31, 73, 125);">-</span><span style="font-size: 7pt; color: rgb(31, 73, 125);"> </span><span style="font-size: 11pt; color: rgb(31, 73, 125);">Use explicit failover order</span></p>
<p class="MsoNormal"> </p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125);">--Jay</span></p>
<p class="MsoNormal"> </p>
<p class="MsoNormal"><b><span style="font-size: 10pt;" lang="EN-US">From:</span></b><span style="font-size: 10pt;" lang="EN-US"> <a href="mailto:ausnog-bounces@lists.ausnog.net" target="_blank">ausnog-bounces@lists.ausnog.net</a>
[mailto:<a href="mailto:ausnog-bounces@lists.ausnog.net" target="_blank">ausnog-bounces@lists.ausnog.net</a>]
<b>On Behalf Of </b>Daniel Thoroughgood<br>
<b>Sent:</b> Thursday, 18 November 2010 11:12 AM<br>
<b>To:</b> ausnog<br>
<b>Subject:</b> Re: [AusNOG] VM throughput to network</span></p>
<p class="MsoNormal"> </p>
<div>
<p class="MsoNormal">I believe ESX load-balances outbound traffic based
upon destination MAC address. If traffic is mostly going to a default
gateway, or a storage device, then it's unlikely to be moved over more than one
link.</p>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">Incoming traffic depends on the switch.</p>
</div>
</div>
</div>
</div>
<p class="MsoNormal" style="margin-bottom: 12pt;"><br>
_______________________________________________<br>
AusNOG mailing list<br>
<a href="mailto:AusNOG@lists.ausnog.net" target="_blank">AusNOG@lists.ausnog.net</a><br>
<a href="http://lists.ausnog.net/mailman/listinfo/ausnog" target="_blank">http://lists.ausnog.net/mailman/listinfo/ausnog</a></p>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<br>
-- <br>
<b><span style="color: rgb(31, 73, 125);">Bruce Renner<br>
</span></b><span style="font-size: 10pt; color: rgb(31, 73, 125);">Hosted Services</span> </p>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal"><span style="font-size: 10pt; color: rgb(31, 73, 125);"><img src="" border="0"></span></p>
</div>
<div>
<p class="MsoNormal"><b><span style="font-size: 10pt; color: gray;">Phone:</span></b><span style="font-size: 10pt; color: gray;"> 07 3809 2999 |<b> Fax:</b> 07 3809 3999 <br>
<b>Address:</b> Unit 2 / 55 Tradelink Rd, Hillcrest, 4118</span><span style="font-size: 10pt; color: rgb(31, 73, 125);"> <br>
<a href="http://www.bettacomputers.com.au" target="_blank">www.bettacomputers.com.au</a></span></p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal"><span style="font-size: 10pt; color: rgb(31, 73, 125);"><img src="" border="0"></span></p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal"><span style="font-size: 7.5pt; color: gray;">Note: This message may contain privileged and confidential information
that is the property of the intended recipient. The information herein is
intended only for use of the addressee. If you are not the intended recipient,
then you are requested to return e-mail to Betta Computer Services Pty Ltd and
destroy any copies made. Copying or disseminating any of this message is
prohibited. Any views expressed in this message are those of the individual
sender and may not necessarily reflect the views of Betta Computer Services Pty
Ltd.</span></p>
</div>
<p class="MsoNormal"> </p>
</div>
</div></div></div>
</div>
<br>_______________________________________________<br>
AusNOG mailing list<br>
<a href="mailto:AusNOG@lists.ausnog.net">AusNOG@lists.ausnog.net</a><br>
<a href="http://lists.ausnog.net/mailman/listinfo/ausnog" target="_blank">http://lists.ausnog.net/mailman/listinfo/ausnog</a><br>
<br></blockquote></div><br>