Centos 7 Problem with 802.1q on bond0 interface


(Sergey Ganchuk) #1

Hello
I’m having problem with implementing 802.1q vnet
So I have CentOS Linux release 7.5.1804
Configured with bonding:
cat /etc/sysconfig/network-scripts/ifcfg-bond0
DEVICE=bond0
BOOTPROTO=dhcp
BONDING_OPTS=“miimon=100 mode=1”
ONBOOT=yes
USERCTL=NO

cat /etc/sysconfig/network-scripts/ifcfg-eno2
TYPE=Ethernet
PROXY_METHOD=none
BROWSER_ONLY=no
BOOTPROTO=none
IPV4_FAILURE_FATAL=no
IPV6INIT=no
NAME=eno2
DEVICE=eno2
ONBOOT=yes
SLAVE=yes
MASTER=bond0

And same for eno3

Here is config of VNET:
[oneadmin@nebulafe ~]$ onevnet show 7
VIRTUAL NETWORK 7 INFORMATION
ID : 7
NAME : lanvlan
USER : oneadmin
GROUP : oneadmin
LOCK : None
CLUSTERS : 0
BRIDGE : onebr.161
VN_MAD : 802.1Q
PHYSICAL DEVICE : bond0
VLAN ID : 161
AUTOMATIC VLAN ID : NO
AUTOMATIC OUTER VLAN ID : NO
USED LEASES : 3

PERMISSIONS
OWNER : um-
GROUP : —
OTHER : —

VIRTUAL NETWORK TEMPLATE
BRIDGE=“onebr.161”
DNS=“192.168.1.18”
GATEWAY=“10.231.248.1”
NETWORK_ADDRESS=“10.231.248.0”
NETWORK_MASK=“255.255.255.0”
PHYDEV=“bond0”
SECURITY_GROUPS=“0”
VLAN_ID=“161”
VN_MAD=“802.1Q”

ADDRESS RANGE POOL
AR 0
SIZE : 10
LEASES : 3

RANGE FIRST LAST
MAC 02:00:0a:e7:f8:64 02:00:0a:e7:f8:6d
IP 10.231.248.100 10.231.248.109

LEASES
AR OWNER MAC IP IP6
0 V:274 02:00:0a:e7:f8:64 10.231.248.100 -
0 V:275 02:00:0a:e7:f8:65 10.231.248.101 -
0 V:276 02:00:0a:e7:f8:66 10.231.248.102 -

I can see mac’s and arp of VM from my switch:
sd4500_1#sh arp | incl 0200
Internet 10.231.248.100 0 0200.0ae7.f864 ARPA Vlan161
Internet 10.231.248.101 0 0200.0ae7.f865 ARPA Vlan161
Internet 10.231.248.102 0 0200.0ae7.f866 ARPA Vlan161

sd4500_1#sh mac address-table | include 0200
161 0200.0ae7.f864 dynamic ip,ipx,assigned,other TenGigabitEthernet2/1/12
161 0200.0ae7.f865 dynamic ip,ipx,assigned,other TenGigabitEthernet2/1/11
161 0200.0ae7.f866 dynamic ip,ipx,assigned,other TenGigabitEthernet1/1/10

But I’m not able to ping guests.

Bridge config
[root@nebulanode1 ~]# brctl show
bridge name bridge id STP enabled interfaces
onebr.161 8000.8c0f6f7df242 no bond0.161
one-276-0
virbr0 8000.5254009fa8a1 yes virbr0-nic

Interfaces config

[root@nebulanode1 ~]# ifconfig
bond0: flags=5187<UP,BROADCAST,RUNNING,MASTER,MULTICAST> mtu 1500
inet 10.231.248.25 netmask 255.255.255.0 broadcast 10.231.248.255
inet6 fe80::8e0f:6fff:fe7d:f242 prefixlen 64 scopeid 0x20
ether 8c:0f:6f:7d:f2:42 txqueuelen 1000 (Ethernet)
RX packets 3340 bytes 1040272 (1015.8 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 2506 bytes 500193 (488.4 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

bond0.161: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet6 fe80::8e0f:6fff:fe7d:f242 prefixlen 64 scopeid 0x20
ether 8c:0f:6f:7d:f2:42 txqueuelen 1000 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0

TX packets 15 bytes 1206 (1.1 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

eno2: flags=6211<UP,BROADCAST,RUNNING,SLAVE,MULTICAST> mtu 1500
ether 8c:0f:6f:7d:f2:42 txqueuelen 1000 (Ethernet)
RX packets 3174 bytes 1027203 (1003.1 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 2515 bytes 502055 (490.2 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

eno3: flags=6211<UP,BROADCAST,RUNNING,SLAVE,MULTICAST> mtu 1500
ether 8c:0f:6f:7d:f2:42 txqueuelen 1000 (Ethernet)
RX packets 166 bytes 13069 (12.7 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10
loop txqueuelen 1000 (Local Loopback)
RX packets 271 bytes 93862 (91.6 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 271 bytes 93862 (91.6 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

onebr.161: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet6 fe80::4c8e:25ff:fe78:61ea prefixlen 64 scopeid 0x20
ether 8c:0f:6f:7d:f2:42 txqueuelen 1000 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 8 bytes 648 (648.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

virbr0: flags=4099<UP,BROADCAST,MULTICAST> mtu 1500
inet 192.168.122.1 netmask 255.255.255.0 broadcast 192.168.122.255
ether 52:54:00:9f:a8:a1 txqueuelen 1000 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

It’s suspicious that RX counters on bond0.161 interface showing zeroes.
I tryed same config, but using physical interfaces eno and it’s working great.

Thanks for advice.
Sergey


(Kristian Feldsam) #2

Hi, check this sysctl variables

net.bridge.bridge-nf-call-arptables
net.bridge.bridge-nf-call-ip6tables
net.bridge.bridge-nf-call-iptables

and also check iptables, but if something blocked by iptables, there should be some traffic on interfaces…


(Sergey Ganchuk) #3

Thanks, Kristian.
Thist problem is solved now.
It was my misconfiguration of native vlan on switch.
Everything is working now, but I faced with very low bandwith on vxlan VNET.