Attachment 864294 Details for Bug 1206674

Test script outputs with 4.x, 6.0 and 6.1 cases

bond-ip.txt (text/plain), 43.16 KB, created by Marius Tomaschewski on 2023-01-20 23:10:59 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Marius Tomaschewski

Created: 2023-01-20 23:10:59 UTC

Size: 43.16 KB

patch

obsolete

>=== Working case "one" with SLE-12-SP5 4.x kernel ======================================
>
># ./bond-ip.sh -1 sfp1 -2 sfp2 -m 802.3ad one
>+ uname -a
>Linux nemesis 4.12.14-122.106-default #1 SMP Mon Jan 3 22:02:42 UTC 2022 (cca30be) x86_64 x86_64 x86_64 GNU/Linux
>+ ip link delete bond0
>+ ip link set up dev sfp1
>+ ip link set up dev sfp2
>+ sleep 3
>+ ip a s dev sfp1
>3: sfp1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>    inet6 fe80::3efd:feff:fea2:fad4/64 scope link 
>       valid_lft forever preferred_lft forever
>+ ip a s dev sfp2
>6: sfp2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d5 brd ff:ff:ff:ff:ff:ff
>    inet6 fe80::3efd:feff:fea2:fad5/64 scope link 
>       valid_lft forever preferred_lft forever
>+ ip -d link show dev bond0
>Device "bond0" does not exist.
>+ ip link add bond0 type bond mode 802.3ad miimon 100
>+ test xone = xone
>+ echo 'enslave in one message per slave as done by wicked (works on 4.x-6.0 kernel)'
>enslave in one message per slave as done by wicked (works on 4.x-6.0 kernel)
>+ ip link set down master bond0 dev sfp1
>+ ip link set down master bond0 dev sfp2
>+ sleep 3
>+ ip a s dev sfp1
>3: sfp1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>+ ip a s dev sfp2
>6: sfp2: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>+ ip -d link show dev bond0
>22: bond0: <BROADCAST,MULTICAST,MASTER> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff promiscuity 0 
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 use_carrier 1 arp_interval 0 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_rate slow ad_select stable ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 
>+ ip link set up dev bond0
>+ ip -d link show dev bond0
>22: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff promiscuity 0 
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 use_carrier 1 arp_interval 0 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_rate slow ad_select stable ad_aggregator 1 ad_num_ports 1 ad_actor_key 15 ad_partner_key 1 ad_partner_mac 00:00:00:00:00:00 ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 
>+ sleep 5
>+ ip a s dev sfp1
>3: sfp1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>+ ip a s dev sfp2
>6: sfp2: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>+ ip -d link show dev bond0
>22: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff promiscuity 0 
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 use_carrier 1 arp_interval 0 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_rate slow ad_select stable ad_aggregator 1 ad_num_ports 2 ad_actor_key 15 ad_partner_key 15 ad_partner_mac c4:ad:34:4a:6c:f6 ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 
>
>
>=== Working case "two" with SLE-12-SP5 4.x kernel ======================================
>
># ./bond-ip.sh -1 sfp1 -2 sfp2 -m 802.3ad two
>+ uname -a
>Linux nemesis 4.12.14-122.106-default #1 SMP Mon Jan 3 22:02:42 UTC 2022 (cca30be) x86_64 x86_64 x86_64 GNU/Linux
>+ ip link delete bond0
>+ ip link set up dev sfp1
>+ ip link set up dev sfp2
>+ sleep 3
>+ ip a s dev sfp1
>3: sfp1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>    inet6 fe80::3efd:feff:fea2:fad4/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip a s dev sfp2
>6: sfp2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d5 brd ff:ff:ff:ff:ff:ff
>    inet6 fe80::3efd:feff:fea2:fad5/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip -d link show dev bond0
>Device "bond0" does not exist.
>+ ip link add bond0 type bond mode 802.3ad miimon 100
>+ test xtwo = xone
>+ test xtwo = xtwo
>+ echo 'enslave in two messages per slave ... possible workaround for 6.1 kernel'
>enslave in two messages per slave ... possible workaround for 6.1 kernel
>+ ip link set down dev sfp1
>+ ip link set down dev sfp2
>+ ip link set master bond0 dev sfp1
>+ ip link set master bond0 dev sfp2
>+ sleep 3
>+ ip a s dev sfp1
>3: sfp1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>+ ip a s dev sfp2
>6: sfp2: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>+ ip -d link show dev bond0
>23: bond0: <BROADCAST,MULTICAST,MASTER> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff promiscuity 0
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 use_carrier 1 arp_interval 0 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_rate slow ad_select stable ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535
>+ ip link set up dev bond0
>+ ip -d link show dev bond0
>23: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff promiscuity 0
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 use_carrier 1 arp_interval 0 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_rate slow ad_select stable ad_aggregator 1 ad_num_ports 1 ad_actor_key 15 ad_partner_key 1 ad_partner_mac 00:00:00:00:00:00 ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535
>+ sleep 5
>+ ip a s dev sfp1
>3: sfp1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>+ ip a s dev sfp2
>6: sfp2: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>+ ip -d link show dev bond0
>23: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff promiscuity 0
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 use_carrier 1 arp_interval 0 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_rate slow ad_select stable ad_aggregator 1 ad_num_ports 2 ad_actor_key 15 ad_partner_key 15 ad_partner_mac c4:ad:34:4a:6c:f6 ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535
>
>
>=== Failure case "fail" with SLE-12-SP5 4.x kernel ======================================
>
># ./bond-ip.sh -1 sfp1 -2 sfp2 -m 802.3ad fail
>+ uname -a
>Linux nemesis 4.12.14-122.106-default #1 SMP Mon Jan 3 22:02:42 UTC 2022 (cca30be) x86_64 x86_64 x86_64 GNU/Linux
>+ ip link delete bond0
>Cannot find device "bond0"
>+ ip link set up dev sfp1
>+ ip link set up dev sfp2
>+ sleep 3
>+ ip a s dev sfp1
>3: sfp1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>    inet6 fe80::3efd:feff:fea2:fad4/64 scope link 
>       valid_lft forever preferred_lft forever
>+ ip a s dev sfp2
>6: sfp2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d5 brd ff:ff:ff:ff:ff:ff
>    inet6 fe80::3efd:feff:fea2:fad5/64 scope link 
>       valid_lft forever preferred_lft forever
>+ ip -d link show dev bond0
>Device "bond0" does not exist.
>+ ip link add bond0 type bond mode 802.3ad miimon 100
>+ test xfail = xone
>+ test xfail = xtwo
>+ echo 'failing aka rejected enslave (since 3.x on sle11) because slave are UP already'
>failing aka rejected enslave (since 3.x on sle11) because slave are UP already
>+ ip link set master bond0 dev sfp1
>RTNETLINK answers: Operation not permitted
>+ ip link set master bond0 dev sfp2
>RTNETLINK answers: Operation not permitted
>+ sleep 3
>+ ip a s dev sfp1
>3: sfp1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>    inet6 fe80::3efd:feff:fea2:fad4/64 scope link 
>       valid_lft forever preferred_lft forever
>+ ip a s dev sfp2
>6: sfp2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d5 brd ff:ff:ff:ff:ff:ff
>    inet6 fe80::3efd:feff:fea2:fad5/64 scope link 
>       valid_lft forever preferred_lft forever
>+ ip -d link show dev bond0
>24: bond0: <BROADCAST,MULTICAST,MASTER> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
>    link/ether 9e:42:2b:93:d2:91 brd ff:ff:ff:ff:ff:ff promiscuity 0 
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 use_carrier 1 arp_interval 0 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_rate slow ad_select stable ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 
>+ ip link set up dev bond0
>+ ip -d link show dev bond0
>24: bond0: <NO-CARRIER,BROADCAST,MULTICAST,MASTER,UP> mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000
>    link/ether 9e:42:2b:93:d2:91 brd ff:ff:ff:ff:ff:ff promiscuity 0 
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 use_carrier 1 arp_interval 0 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_rate slow ad_select stable ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 
>+ sleep 5
>+ ip a s dev sfp1
>3: sfp1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>    inet6 fe80::3efd:feff:fea2:fad4/64 scope link 
>       valid_lft forever preferred_lft forever
>+ ip a s dev sfp2
>6: sfp2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d5 brd ff:ff:ff:ff:ff:ff
>    inet6 fe80::3efd:feff:fea2:fad5/64 scope link 
>       valid_lft forever preferred_lft forever
>+ ip -d link show dev bond0
>24: bond0: <NO-CARRIER,BROADCAST,MULTICAST,MASTER,UP> mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000
>    link/ether 9e:42:2b:93:d2:91 brd ff:ff:ff:ff:ff:ff promiscuity 0 
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 use_carrier 1 arp_interval 0 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_rate slow ad_select stable ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 
>
>
>=== Regression case "one" with Tumbleweed 6.1 kernel ===================================
>
># ./bond-ip.sh -m 802.3ad one
>+ uname -a
>Linux nemesis 6.1.6-1-default #1 SMP PREEMPT_DYNAMIC Mon Jan 16 05:11:14 UTC 2023 (573f4a9) x86_64 x86_64 x86_64 GNU/Linux
>+ ip link delete bond0
>Cannot find device "bond0"
>+ ip link set up dev ens1f0
>+ ip link set up dev ens1f1
>+ sleep 3
>+ ip a s dev ens1f0
>2: ens1f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f0
>    inet6 fe80::3efd:feff:fea2:fad4/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip a s dev ens1f1
>3: ens1f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d5 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f1
>    inet6 fe80::3efd:feff:fea2:fad5/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip -d link show dev bond0
>Device "bond0" does not exist.
>+ ip link add bond0 type bond mode 802.3ad miimon 100
>+ test xone = xone
>+ echo 'enslave in one message per slave as done by wicked (works on 4.x-6.0 kernel)'
>enslave in one message per slave as done by wicked (works on 4.x-6.0 kernel)
>+ ip link set down master bond0 dev ens1f0
>Error: Device can not be enslaved while up.
>+ ip link set down master bond0 dev ens1f1
>Error: Device can not be enslaved while up.
>+ sleep 3
>+ ip a s dev ens1f0
>2: ens1f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f0
>    inet6 fe80::3efd:feff:fea2:fad4/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip a s dev ens1f1
>3: ens1f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d5 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f1
>    inet6 fe80::3efd:feff:fea2:fad5/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip -d link show dev bond0
>9: bond0: <BROADCAST,MULTICAST,MASTER> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff promiscuity 0  allmulti 0 minmtu 68 maxmtu 65535
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 peer_notify_delay 0 use_carrier 1 arp_interval 0 arp_missed_max 2 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_active on lacp_rate slow ad_select stable ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536
>+ ip link set up dev bond0
>+ ip -d link show dev bond0
>9: bond0: <NO-CARRIER,BROADCAST,MULTICAST,MASTER,UP> mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff promiscuity 0  allmulti 0 minmtu 68 maxmtu 65535
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 peer_notify_delay 0 use_carrier 1 arp_interval 0 arp_missed_max 2 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_active on lacp_rate slow ad_select stable ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536
>+ sleep 5
>+ ip a s dev ens1f0
>2: ens1f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f0
>    inet6 fe80::3efd:feff:fea2:fad4/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip a s dev ens1f1
>3: ens1f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d5 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f1
>    inet6 fe80::3efd:feff:fea2:fad5/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip -d link show dev bond0
>9: bond0: <NO-CARRIER,BROADCAST,MULTICAST,MASTER,UP> mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff promiscuity 0  allmulti 0 minmtu 68 maxmtu 65535
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 peer_notify_delay 0 use_carrier 1 arp_interval 0 arp_missed_max 2 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_active on lacp_rate slow ad_select stable ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536
>
>
>=== Working case "two" with Tumbleweed 6.1 kernel ======================================
>
># ./bond-ip.sh -m 802.3ad two
>+ uname -a
>Linux nemesis 6.1.6-1-default #1 SMP PREEMPT_DYNAMIC Mon Jan 16 05:11:14 UTC 2023 (573f4a9) x86_64 x86_64 x86_64 GNU/Linux
>+ ip link delete bond0
>+ ip link set up dev ens1f0
>+ ip link set up dev ens1f1
>+ sleep 3
>+ ip a s dev ens1f0
>2: ens1f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f0
>    inet6 fe80::3efd:feff:fea2:fad4/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip a s dev ens1f1
>3: ens1f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d5 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f1
>    inet6 fe80::3efd:feff:fea2:fad5/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip -d link show dev bond0
>Device "bond0" does not exist.
>+ ip link add bond0 type bond mode 802.3ad miimon 100
>+ test xtwo = xone
>+ test xtwo = xtwo
>+ echo 'enslave in two messages per slave ... possible workaround for 6.1 kernel'
>enslave in two messages per slave ... possible workaround for 6.1 kernel
>+ ip link set down dev ens1f0
>+ ip link set down dev ens1f1
>+ ip link set master bond0 dev ens1f0
>+ ip link set master bond0 dev ens1f1
>+ sleep 3
>+ ip a s dev ens1f0
>2: ens1f0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff permaddr 3c:fd:fe:a2:fa:d4
>    altname enp1s0f0
>+ ip a s dev ens1f1
>3: ens1f1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff permaddr 3c:fd:fe:a2:fa:d5
>    altname enp1s0f1
>+ ip -d link show dev bond0
>10: bond0: <BROADCAST,MULTICAST,MASTER> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff promiscuity 0  allmulti 0 minmtu 68 maxmtu 65535
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 peer_notify_delay 0 use_carrier 1 arp_interval 0 arp_missed_max 2 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_active on lacp_rate slow ad_select stable ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536
>+ ip link set up dev bond0
>+ ip -d link show dev bond0
>10: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff promiscuity 0  allmulti 0 minmtu 68 maxmtu 65535
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 peer_notify_delay 0 use_carrier 1 arp_interval 0 arp_missed_max 2 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_active on lacp_rate slow ad_select stable ad_aggregator 1 ad_num_ports 1 ad_actor_key 15 ad_partner_key 1 ad_partner_mac 00:00:00:00:00:00 ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536
>+ sleep 5
>+ ip a s dev ens1f0
>2: ens1f0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff permaddr 3c:fd:fe:a2:fa:d4
>    altname enp1s0f0
>+ ip a s dev ens1f1
>3: ens1f1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff permaddr 3c:fd:fe:a2:fa:d5
>    altname enp1s0f1
>+ ip -d link show dev bond0
>10: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff promiscuity 0  allmulti 0 minmtu 68 maxmtu 65535
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 peer_notify_delay 0 use_carrier 1 arp_interval 0 arp_missed_max 2 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_active on lacp_rate slow ad_select stable ad_aggregator 1 ad_num_ports 2 ad_actor_key 15 ad_partner_key 15 ad_partner_mac c4:ad:34:4a:6c:f6 ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536
>
>
>=== Failure case "fail" with Tumbleweed 6.1 kernel ======================================
>
># ./bond-ip.sh -m 802.3ad fail
>+ uname -a
>Linux nemesis 6.1.6-1-default #1 SMP PREEMPT_DYNAMIC Mon Jan 16 05:11:14 UTC 2023 (573f4a9) x86_64 x86_64 x86_64 GNU/Linux
>+ ip link delete bond0
>+ ip link set up dev ens1f0
>+ ip link set up dev ens1f1
>+ sleep 3
>+ ip a s dev ens1f0
>2: ens1f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f0
>    inet6 fe80::3efd:feff:fea2:fad4/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip a s dev ens1f1
>3: ens1f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d5 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f1
>    inet6 fe80::3efd:feff:fea2:fad5/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip -d link show dev bond0
>Device "bond0" does not exist.
>+ ip link add bond0 type bond mode 802.3ad miimon 100
>+ test xfail = xone
>+ test xfail = xtwo
>+ echo 'failing aka rejected enslave (since 3.x on sle11) because slave are UP already'
>failing aka rejected enslave (since 3.x on sle11) because slave are UP already
>+ ip link set master bond0 dev ens1f0
>Error: Device can not be enslaved while up.
>+ ip link set master bond0 dev ens1f1
>Error: Device can not be enslaved while up.
>+ sleep 3
>+ ip a s dev ens1f0
>2: ens1f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f0
>    inet6 fe80::3efd:feff:fea2:fad4/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip a s dev ens1f1
>3: ens1f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d5 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f1
>    inet6 fe80::3efd:feff:fea2:fad5/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip -d link show dev bond0
>11: bond0: <BROADCAST,MULTICAST,MASTER> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff promiscuity 0  allmulti 0 minmtu 68 maxmtu 65535
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 peer_notify_delay 0 use_carrier 1 arp_interval 0 arp_missed_max 2 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_active on lacp_rate slow ad_select stable ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536
>+ ip link set up dev bond0
>+ ip -d link show dev bond0
>11: bond0: <NO-CARRIER,BROADCAST,MULTICAST,MASTER,UP> mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff promiscuity 0  allmulti 0 minmtu 68 maxmtu 65535
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 peer_notify_delay 0 use_carrier 1 arp_interval 0 arp_missed_max 2 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_active on lacp_rate slow ad_select stable ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536
>+ sleep 5
>+ ip a s dev ens1f0
>2: ens1f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f0
>    inet6 fe80::3efd:feff:fea2:fad4/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip a s dev ens1f1
>3: ens1f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d5 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f1
>    inet6 fe80::3efd:feff:fea2:fad5/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip -d link show dev bond0
>11: bond0: <NO-CARRIER,BROADCAST,MULTICAST,MASTER,UP> mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff promiscuity 0  allmulti 0 minmtu 68 maxmtu 65535
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 peer_notify_delay 0 use_carrier 1 arp_interval 0 arp_missed_max 2 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_active on lacp_rate slow ad_select stable ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536
>
>
>=== Working case "one" with Tumbleweed 6.0 kernel ======================================
>
># ./bond-ip.sh -m 802.3ad one
>+ uname -a
>Linux nemesis 6.0.12-1-default #1 SMP PREEMPT_DYNAMIC Thu Dec 8 10:49:09 UTC 2022 (523a283) x86_64 x86_64 x86_64 GNU/Linux
>+ ip link delete bond0
>Cannot find device "bond0"
>+ ip link set up dev ens1f0
>+ ip link set up dev ens1f1
>+ sleep 3
>+ ip a s dev ens1f0
>2: ens1f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f0
>    inet6 fe80::3efd:feff:fea2:fad4/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip a s dev ens1f1
>3: ens1f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d5 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f1
>    inet6 fe80::3efd:feff:fea2:fad5/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip -d link show dev bond0
>Device "bond0" does not exist.
>+ ip link add bond0 type bond mode 802.3ad miimon 100
>+ test xone = xone
>+ echo 'enslave in one message per slave as done by wicked (works on 4.x-6.0 kernel)'
>enslave in one message per slave as done by wicked (works on 4.x-6.0 kernel)
>+ ip link set down master bond0 dev ens1f0
>+ ip link set down master bond0 dev ens1f1
>+ sleep 3
>+ ip a s dev ens1f0
>2: ens1f0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff permaddr 3c:fd:fe:a2:fa:d4
>    altname enp1s0f0
>+ ip a s dev ens1f1
>3: ens1f1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff permaddr 3c:fd:fe:a2:fa:d5
>    altname enp1s0f1
>+ ip -d link show dev bond0
>9: bond0: <BROADCAST,MULTICAST,MASTER> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff promiscuity 0 minmtu 68 maxmtu 65535
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 peer_notify_delay 0 use_carrier 1 arp_interval 0 arp_missed_max 2 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_active on lacp_rate slow ad_select stable ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536
>+ ip link set up dev bond0
>+ ip -d link show dev bond0
>9: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff promiscuity 0 minmtu 68 maxmtu 65535
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 peer_notify_delay 0 use_carrier 1 arp_interval 0 arp_missed_max 2 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_active on lacp_rate slow ad_select stable ad_aggregator 1 ad_num_ports 1 ad_actor_key 15 ad_partner_key 1 ad_partner_mac 00:00:00:00:00:00 ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536
>+ sleep 5
>+ ip a s dev ens1f0
>2: ens1f0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff permaddr 3c:fd:fe:a2:fa:d4
>    altname enp1s0f0
>+ ip a s dev ens1f1
>3: ens1f1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff permaddr 3c:fd:fe:a2:fa:d5
>    altname enp1s0f1
>+ ip -d link show dev bond0
>9: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff promiscuity 0 minmtu 68 maxmtu 65535
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 peer_notify_delay 0 use_carrier 1 arp_interval 0 arp_missed_max 2 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_active on lacp_rate slow ad_select stable ad_aggregator 1 ad_num_ports 2 ad_actor_key 15 ad_partner_key 15 ad_partner_mac c4:ad:34:4a:6c:f6 ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536
>
>
>=== Working case "two" with Tumbleweed 6.0 kernel ======================================
>
># ./bond-ip.sh -m 802.3ad two
>+ uname -a
>Linux nemesis 6.0.12-1-default #1 SMP PREEMPT_DYNAMIC Thu Dec 8 10:49:09 UTC 2022 (523a283) x86_64 x86_64 x86_64 GNU/Linux
>+ ip link delete bond0
>+ ip link set up dev ens1f0
>+ ip link set up dev ens1f1
>+ sleep 3
>+ ip a s dev ens1f0
>2: ens1f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f0
>    inet6 fe80::3efd:feff:fea2:fad4/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip a s dev ens1f1
>3: ens1f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d5 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f1
>    inet6 fe80::3efd:feff:fea2:fad5/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip -d link show dev bond0
>Device "bond0" does not exist.
>+ ip link add bond0 type bond mode 802.3ad miimon 100
>+ test xtwo = xone
>+ test xtwo = xtwo
>+ echo 'enslave in two messages per slave ... possible workaround for 6.1 kernel'
>enslave in two messages per slave ... possible workaround for 6.1 kernel
>+ ip link set down dev ens1f0
>+ ip link set down dev ens1f1
>+ ip link set master bond0 dev ens1f0
>+ ip link set master bond0 dev ens1f1
>+ sleep 3
>+ ip a s dev ens1f0
>2: ens1f0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff permaddr 3c:fd:fe:a2:fa:d4
>    altname enp1s0f0
>+ ip a s dev ens1f1
>3: ens1f1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff permaddr 3c:fd:fe:a2:fa:d5
>    altname enp1s0f1
>+ ip -d link show dev bond0
>10: bond0: <BROADCAST,MULTICAST,MASTER> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff promiscuity 0 minmtu 68 maxmtu 65535
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 peer_notify_delay 0 use_carrier 1 arp_interval 0 arp_missed_max 2 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_active on lacp_rate slow ad_select stable ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536
>+ ip link set up dev bond0
>+ ip -d link show dev bond0
>10: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff promiscuity 0 minmtu 68 maxmtu 65535
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 peer_notify_delay 0 use_carrier 1 arp_interval 0 arp_missed_max 2 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_active on lacp_rate slow ad_select stable ad_aggregator 1 ad_num_ports 1 ad_actor_key 15 ad_partner_key 1 ad_partner_mac 00:00:00:00:00:00 ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536
>+ sleep 5
>+ ip a s dev ens1f0
>2: ens1f0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff permaddr 3c:fd:fe:a2:fa:d4
>    altname enp1s0f0
>+ ip a s dev ens1f1
>3: ens1f1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff permaddr 3c:fd:fe:a2:fa:d5
>    altname enp1s0f1
>+ ip -d link show dev bond0
>10: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff promiscuity 0 minmtu 68 maxmtu 65535
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 peer_notify_delay 0 use_carrier 1 arp_interval 0 arp_missed_max 2 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_active on lacp_rate slow ad_select stable ad_aggregator 1 ad_num_ports 2 ad_actor_key 15 ad_partner_key 15 ad_partner_mac c4:ad:34:4a:6c:f6 ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536
>
>
>=== Failure case "fail" with Tumbleweed 6.0 kernel =====================================
>
># ./bond-ip.sh -m 802.3ad fail
>+ uname -a
>Linux nemesis 6.0.12-1-default #1 SMP PREEMPT_DYNAMIC Thu Dec 8 10:49:09 UTC 2022 (523a283) x86_64 x86_64 x86_64 GNU/Linux
>+ ip link delete bond0
>+ ip link set up dev ens1f0
>+ ip link set up dev ens1f1
>+ sleep 3
>+ ip a s dev ens1f0
>2: ens1f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f0
>    inet6 fe80::3efd:feff:fea2:fad4/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip a s dev ens1f1
>3: ens1f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d5 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f1
>    inet6 fe80::3efd:feff:fea2:fad5/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip -d link show dev bond0
>Device "bond0" does not exist.
>+ ip link add bond0 type bond mode 802.3ad miimon 100
>+ test xfail = xone
>+ test xfail = xtwo
>+ echo 'failing aka rejected enslave (since 3.x on sle11) because slave are UP already'
>failing aka rejected enslave (since 3.x on sle11) because slave are UP already
>+ ip link set master bond0 dev ens1f0
>Error: Device can not be enslaved while up.
>+ ip link set master bond0 dev ens1f1
>Error: Device can not be enslaved while up.
>+ sleep 3
>+ ip a s dev ens1f0
>2: ens1f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f0
>    inet6 fe80::3efd:feff:fea2:fad4/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip a s dev ens1f1
>3: ens1f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d5 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f1
>    inet6 fe80::3efd:feff:fea2:fad5/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip -d link show dev bond0
>11: bond0: <BROADCAST,MULTICAST,MASTER> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff promiscuity 0 minmtu 68 maxmtu 65535
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 peer_notify_delay 0 use_carrier 1 arp_interval 0 arp_missed_max 2 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_active on lacp_rate slow ad_select stable ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536
>+ ip link set up dev bond0
>+ ip -d link show dev bond0
>11: bond0: <NO-CARRIER,BROADCAST,MULTICAST,MASTER,UP> mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff promiscuity 0 minmtu 68 maxmtu 65535
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 peer_notify_delay 0 use_carrier 1 arp_interval 0 arp_missed_max 2 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_active on lacp_rate slow ad_select stable ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536
>+ sleep 5
>+ ip a s dev ens1f0
>2: ens1f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d4 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f0
>    inet6 fe80::3efd:feff:fea2:fad4/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip a s dev ens1f1
>3: ens1f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
>    link/ether 3c:fd:fe:a2:fa:d5 brd ff:ff:ff:ff:ff:ff
>    altname enp1s0f1
>    inet6 fe80::3efd:feff:fea2:fad5/64 scope link
>       valid_lft forever preferred_lft forever
>+ ip -d link show dev bond0
>11: bond0: <NO-CARRIER,BROADCAST,MULTICAST,MASTER,UP> mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000
>    link/ether 4a:82:96:f2:4a:03 brd ff:ff:ff:ff:ff:ff promiscuity 0 minmtu 68 maxmtu 65535
>    bond mode 802.3ad miimon 100 updelay 0 downdelay 0 peer_notify_delay 0 use_carrier 1 arp_interval 0 arp_missed_max 2 arp_validate none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_active on lacp_rate slow ad_select stable ad_actor_sys_prio 65535 ad_user_port_key 0 ad_actor_system 00:00:00:00:00:00 tlb_dynamic_lb 1 addrgenmode eui64 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536
>

Actions: View

Attachments on bug 1206674: 863670 | 864293 | 864294