OpenVZ Forum: Support » HN Network Connectivity loss when VE stopped

Home » General » Support » HN Network Connectivity loss when VE stopped

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

HN Network Connectivity loss when VE stopped [message #26576]

Mon, 28 January 2008 20:27

nimbus4321
Messages: 8
Registered: January 2008

Junior Member

Hi,

I've got a HN set-up with two VEs, each using veth for network access. The veth interfaces and the HN interface (eth0) are bridged using a bridge vzbr0. The bridge is assigned the HN's IP, and all traffic is routed via the bridge.
Networking all works fine to the VEs and HN, including (importantly for me) multicast between all nodes.

However, if I stop one of the VEs using "vzctl stop", I lose all network connectivity (i.e. including unicast) to the HN and to the other VE from external nodes. Connectivity to both returns after a couple of minutes.

I've tried removing the route for the VE (via the bridge) before stopping the VE, but this makes no difference.

Has anyone seen this behaviour before ? Does anyone have any suggestions on what might be wrong ? I will investigate further, but would be grateful for any help.

Thanks in advance for any suggestions.

Report message to a moderator

Re: HN Network Connectivity loss when VE stopped [message #26584 is a reply to message #26576]

Tue, 29 January 2008 05:38

dietmar
Messages: 54
Registered: March 2007

Member

Yes, I also see that behaviour here. After vzctl stop network is unavailable, but gets back a few minute later.

- Dietmar

Report message to a moderator

Re: HN Network Connectivity loss when VE stopped [message #26590 is a reply to message #26576]

Tue, 29 January 2008 09:37

nimbus4321
Messages: 8
Registered: January 2008

Junior Member

Hi Dietmar,

Do you have a similar set-up to the one described above - i.e. with all interfaces (VE and HN) being bridged ?

I ask this because the connectivity loss only started happening when I added the HN's interface (eth0) to the bridge (vzbr0). Before this, when the VE interfaces were bridged but not the HN interface, stopping a VE had no effect on network connectivity. So, seems to be some interaction between the bridge and the HN interface. At any rate, will investigate more today.

Report message to a moderator

Re: HN Network Connectivity loss when VE stopped [message #26650 is a reply to message #26590]

Wed, 30 January 2008 06:38

dietmar
Messages: 54
Registered: March 2007

Member

yes, same setup

Report message to a moderator

Re: HN Network Connectivity loss when VE stopped [message #26652 is a reply to message #26576]

Wed, 30 January 2008 08:15

dietmar
Messages: 54
Registered: March 2007

Member

I just tried another network card (r8169 Gigabit Ethernet driver), and that works without those problems. Seems that my eth1000_ich9 driver causes those delays.

- Dietmar

Report message to a moderator

Re: HN Network Connectivity loss when VE stopped [message #30860 is a reply to message #26576]

Mon, 09 June 2008 13:21

swindmill
Messages: 57
Registered: April 2007

Member

This is related to a linux bridge inheriting it's mac address from the bridged devices it contains.

I've seen reference on this forum to the bridge inheriting the "lowest" mac address of the bridged devices.

Since your bridge includes eth0 or your physical network device, other machines on the network communicate with your machine now using the bridge's mac, which isn't necessarily the same as eth0.

When you add a veth device into the bridge, the mac address of the bridge can change. This seems to be handled properly, even on remote machines that are connected at the time of the container with the veth starting. Perhaps an arpsend -U is being ran?

When you stop the container, and the veth is removed from the bridge, the bridge's mac address can change again. This can lead to a loss of connectivity because other machines on the network are still trying to access the machine using the old mac address. I have verified this on a Windows XP machine, I briefly lose connectivity but can restore it using arp -d IP.

I'm not sure how to best tackle this one, any ideas?

Report message to a moderator

Re: HN Network Connectivity loss when VE stopped [message #30949 is a reply to message #30860]

Wed, 11 June 2008 07:00

dietmar
Messages: 54
Registered: March 2007

Member

This post:

https://lists.linux-foundation.org/pipermail/bridge/2008-Jan uary/005686.html

indicates that they changed the behavoiur, by my 2.6.24 still uses the lowest mac - bad :-/

Report message to a moderator

Re: HN Network Connectivity loss when VE stopped [message #30991 is a reply to message #26576]

Thu, 12 June 2008 05:21

dietmar
Messages: 54
Registered: March 2007

Member

Report message to a moderator

Re: HN Network Connectivity loss when VE stopped [message #31006 is a reply to message #26576]

Thu, 12 June 2008 14:35

swindmill
Messages: 57
Registered: April 2007

Member

I seem to have been able to resolve this issue for myself by modifying the custom network script I use to add the veth devices created by vzctl into my bridge (containing eth0) at the VE start.

I manually set br0's mac address to that of eth0 after adding the veth device, and I also added a VEID.umount script that does the same when the VE is shutdown.

This seems to allow me to start and stop the VE without causing any network connectivity issues.

The command I'm using is:

/sbin/ifconfig br0 hw ether $(ifconfig eth0 | awk '{print $5; exit}')

Report message to a moderator

Previous Topic:	setlocale not working properly in perl script
Next Topic:	ENOMEM errors

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Tue Nov 05 23:08:15 GMT 2024

Total time taken to generate the page: 0.03517 seconds