We have a server connected to 2 switches via two NICs. On each NIC are 2 VLANs, management and production. Right now we only have one switch connected, so haven't setup the spanning tree etc.
We have LXC installed, and want to bridge (rather than NAT) the XLC containers (so they are on the same subnet as the host).
When we try to create a bridge in /etc/network/interfaces on the host ubuntu server, the networking fails to start, and we have to go to the console, remove the edits and reboot (lucky we have LOM cards!)
interfaces file:
auto em1.3
iface em1.3 inet manual
bond-master bond2
bond-primary em1.3
auto em2.3
iface em2.3 inet manual
bond-master bond2
auto bond2 #Production VLAN
iface bond2 inet static
address 10.100.100.10
netmask 255.255.255.0
gateway 10.100.100.1
dns-nameservers 10.100.10.1
bond-slaves em1.3, em2.3
bond-miimon 100
bond-mode active-backup
dns-nameservers 10.100.100.1
auto br_prod
iface br_prod inet dhcp
bridge_ports bond2
bridge_fd 0
bridge_maxwait 0
When we add that last section (br_prod) the server wont start networking, and we have to use the console. It says "waiting another 60 seconds for networking to start", but doesn't.
I also tried adding
pre-up ifup bond2
post-down ifup bond2
Tried making it manual.
Tried making it static rather than DHCP, supplying appropriate ip/gateway/netmask. No luck.
Tried naming it br2 instead of br_prod, tried pre_up post_down, bridge-ports etc. We tried every combination of options, switches and underscores vs dashes. Always same effect – networking wont start (no errors).
Any ideas?
UPDATE 1
From the answer from electrometro below, I tried this:
auto bond1
iface bond1 inet static
address 10.30.30.10
netmask 255.255.255.0
#bond-slaves em1.2, em2.2
bond-slaves none
bond-miimon 100
bond-mode active-backup
up route add -net .....
auto em1.2
iface em1.2 inet manual
bond-master bond1
bond-primary em1.2
auto em2.2
iface em2.2 inet manual
bond-master bond1
bond-primary em1.2
br1
iface br1 inet manual
bridge_ports bond1
bridge_fd 0
bridge_maxwait 0
But get the same problem – networking doesn't start.
UPDATE 2
Thanks for the contribution by Oliver. I tried this config, and the networking comes up, I can use ifconf to see the interfaces, but I cant ssh as the routing is not working. basically I cant ping the default gateway using the manually added route.
auto em1.2
iface em1.2 inet manual
auto em2.2
iface em2.2 inet namual
auto bond1
iface bond1 inet manual
bond-slaves em1.2 em2.2
bond-mode active-backup
auto br10
iface br10 inet static
address 10.30.30.10
netmask 255.255.255.0
bridge_ports bond1
up route add -net 10.242.1.0/24 gw 10.30.30.1 dev bond1 # also tried dev br10
The reason we are manually setting a gateway, is that we have to networks defined: production and management. We have 2 interfaces, each connected to a switch. Each interface carries fail over for both networks, and the production network has the default gateway. I am now just trying to get a bridge on the management network as a start.
UPDATE 3
In a long line of trial and error I also tried specifying the VLAN:
auto em1.2
iface em1.2 inet manual
auto em2.2
iface em2.2 inet manual
auto bond1
iface bond1 inet manual
bond-slaves em1.2 em2.2
bond-mode active-backup
auto br10.2
iface br10.2 inet static
address 10.30.30.10
netmask 255.255.255.0
bridge_ports bond1
up route add -net 10.242.1.0/24 gw 10.30.30.1 dev br10.2
Best Answer
Here is a similar setup that is working for a docker host. Hope it points you in the right direction.