ESXi multiple Cisco switches etherchannel configuration ...

[neohal]

Hi ...

I have 3 ESXi servers Cisco C210 with 6 nics each.
We have 2 Cisco Switches 6509 as CORE in the network.
The 6509 are connected in HSRP (high availability L2 configuration).
We configured the network connections between Cisco Switches and Servers considering the suggestions on:
KB 2032469
KB 1004048

The configuration is working but we got a lot of messages in 6509:

%MAC_MOVE-SP-4-NOTIF: Host 000c.297b.16c1 in vlan 30 is flapping between port Po1 and port Po16
Host 000c.296e.419a in vlan 100 is flapping between port Po17 and port Po1
Host 000c.296e.419a in vlan 100 is flapping between port Po17 and port Po1
Host 000c.29d7.b4d4 in vlan 30 is flapping between port Po1 and port Po13
Host 000c.2956.245b in vlan 30 is flapping between port Po13 and port Po1
Host 000c.2956.245b in vlan 30 is flapping between port Po13 and port Po1
Host 000c.296e.419a in vlan 100 is flapping between port Po17 and port Po1
Host 000c.296e.419a in vlan 100 is flapping between port Po17 and port Po1

Po1 is the etherchannel between 6509 switches and Po13, Po17 and Po16 are the etherchannel of each ESXi server in this 6509.

The servers are configured using just one Virtual Switch, in each Virtual Switch we have configured the port-groups of each
VLAN for VMs.
The Virtual Switches has "Routed based on ip hash" in NIC Teaming configuration.

Are these messages representing an configuration error ?
How could we eliminate these messages ?

Please your suggestions ...

[Josh26]

Guillermo Gonzalez wrote:

The Virtual Switches has "Routed based on ip hash" in NIC Teaming configuration.

You can't "route based on ip hash" to two physically separate switches, unless your switches are configured with a vPC - a Nexus feature. At that point, it's more a Cisco supported thing than a VMware one.

[neohal]

Thanks,  but,  what is the best practice to configure one ESXi to 2 switches using etherchannel in each switch ?

Is there any example o "best practice configuration" for this considering Cisco 6509 (no Nexus with vPC) ?

Thanks ...

[Josh26]

Guillermo Gonzalez wrote:

Thanks,  but,  what is the best practice to configure one ESXi to 2 switches using etherchannel in each switch ?

Is there any example o "best practice configuration" for this considering Cisco 6509 (no Nexus with vPC) ?

Thanks ...

You CAN NOT use etherchannel in this situation. The "best practise" is DO NOT DO IT.

Configure your VMware teaming function to "Route based on virtual port ID".

[neohal]

Thanks Josh ...

I just follow and old document about ESX networking configuration.

Pls, check it and tell me your suggestions ...

In this document you can see some configurations.  We have the multiple pswitches with one ESXi conected with 3 NICs in each pswitch.

Thanks for your help ...

[Josh26]

The document presents several options and I'm unsure which one you followed. It's certainly not a VMware or "best practice" guide.

Note that under no option given, does any etherchannel span two physical switches.

There is the option of a one vSwitch with one etherchannel to switch A, and another vSwitch with etherchannel to switch B. Then VMs are assigned to either vSwitch. If you are just hell bent on using etherchannel on multiple switches, then this is the path to take. The guide does point out that this doesn't provide any switch redundancy - and surely that is your goal.