multipass icon indicating copy to clipboard operation
multipass copied to clipboard

Published 20 hours ago • verified publisher icon canonical

Bridged networking on Ubuntu Server with systemd-networkd not working

Open gunterze opened this issue 2 years ago • 0 comments

I could not get bridged networking working on Ubuntu 22.04.1 LTS Server so far: Trying to create the bridge automatically by

$ multipass launch --network eno1 
Multipass needs to create a bridge to connect to eno1.                          
This will temporarily disrupt connectivity on that interface.

Do you want to continue (yes/no)? yes
launch failed: Could not create bridge. Could not reach remote D-Bus object: The name org.freedesktop.NetworkManager was not provided by any .service files

fails, because Ubuntu Server uses systemd-networkd and not network-manager to control the network interfaces by default.

Creating the bridge manually with

$ netplan apply

with configuration file:

$ cat /etc/netplan/00-installer-config.yaml
# This is the network config written by 'subiquity'
network:
  ethernets:
    eno1:
      match:
        macaddress: 74:d0:2b:cb:f3:dc
  bridges:
    br0:
      addresses:
        - 192.168.2.123/24
      interfaces:
        - eno1
      gateway4: 192.168.2.1
      nameservers:
        addresses:
          - 192.168.2.10
      parameters:
        forward-delay: 0
        stp: false
      optional: true
  version: 2

and passing the name of the created bridge:

$ ip a show br0
40: br0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether ba:93:eb:ae:5e:08 brd ff:ff:ff:ff:ff:ff
    inet 192.168.2.123/24 brd 192.168.2.255 scope global br0
       valid_lft forever preferred_lft forever
    inet6 fe80::b893:ebff:feae:5e08/64 scope link 
       valid_lft forever preferred_lft forever

on invoking

$ multipass launch --network br0
Launched:         enlivened-murrelet

does not attach the instance to the bridge network:

$ multipass list
Name                    State             IPv4             Image
enlivened-murrelet      Running           10.26.22.23      Ubuntu 20.04 LTS

The kernel log shows:

Aug 26 14:32:50 test-ng systemd-networkd[1012]: br0: Re-configuring with /run/systemd/network/10-netplan-br0.network
Aug 26 14:32:50 test-ng systemd-networkd[1012]: br0: DHCPv6 lease lost
Aug 26 14:32:50 test-ng systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped.
Aug 26 14:32:50 test-ng sudo[26042]: pam_unix(sudo:session): session closed for user root
Aug 26 14:32:51 test-ng systemd-networkd[1012]: br0: Gained carrier
Aug 26 14:32:51 test-ng systemd-timesyncd[808]: Network configuration changed, trying to establish connection.
Aug 26 14:32:51 test-ng kernel: IPv6: ADDRCONF(NETDEV_CHANGE): br0: link becomes ready
Aug 26 14:32:51 test-ng systemd-timesyncd[808]: Initial synchronization to time server 185.125.190.56:123 (ntp.ubuntu.com).
Aug 26 14:32:52 test-ng systemd-networkd[1012]: br0: Gained IPv6LL
Aug 26 14:33:20 test-ng systemd[1]: systemd-hostnamed.service: Deactivated successfully.
Aug 26 14:40:36 test-ng systemd[2411]: Started snap.multipass.multipass.577ed3e2-c8c4-469e-8ea6-c9d01990b118.scope.
Aug 26 14:40:36 test-ng multipassd[14879]: Using the 'multipass' storage pool.
Aug 26 14:40:46 test-ng systemd[2411]: Started snap.multipass.multipass.72f78346-7d47-4198-b00e-e57e6ad93621.scope.
Aug 26 14:40:46 test-ng multipassd[14879]: Using the 'multipass' storage pool.
Aug 26 14:42:50 test-ng systemd[2411]: Started snap.multipass.multipass.da39fa7d-9ddc-4034-b452-2c38e5d3f348.scope.
Aug 26 14:43:33 test-ng systemd[2411]: Started snap.multipass.multipass.33f7c165-a939-4aea-8f33-438a08e67bab.scope.
Aug 26 14:43:35 test-ng multipassd[14879]: Using the 'multipass' storage pool.
Aug 26 14:43:35 test-ng audit[14879]: AVC apparmor="DENIED" operation="open" profile="snap.multipass.multipassd" name="/proc/14879/mountinfo" pid=14879 comm=5468726561642028706F6F6C656429 requested_mask="r" denied_mask="r" fsuid=0 ouid=0
Aug 26 14:43:35 test-ng kernel: audit: type=1400 audit(1661525015.790:717): apparmor="DENIED" operation="open" profile="snap.multipass.multipassd" name="/proc/14879/mountinfo" pid=14879 comm=5468726561642028706F6F6C656429 requested_mask="r" denied_mask="r" fsuid=0 ouid=0
Aug 26 14:43:35 test-ng multipassd[14879]: Creating instance with image id: 5567d3311ce96a215e476d2c266be92d026e09fe1a1b210ca27fdf4edb3936e6
Aug 26 14:43:35 test-ng dnsmasq[9884]: read /etc/hosts - 7 addresses
Aug 26 14:43:35 test-ng dnsmasq-dhcp[9884]: read /var/snap/lxd/common/lxd/networks/mpbr0/dnsmasq.hosts/multipass_enlivened-murrelet.eth0
Aug 26 14:43:35 test-ng audit[26256]: AVC apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxd_archive-var-snap-lxd-common-lxd-storage-pools-multipass-virtual-machines-multipass_enlivened-murrelet" pid=26256 comm="apparmor_parser"
Aug 26 14:43:35 test-ng kernel: audit: type=1400 audit(1661525015.890:718): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxd_archive-var-snap-lxd-common-lxd-storage-pools-multipass-virtual-machines-multipass_enlivened-murrelet" pid=26256 comm="apparmor_parser"
Aug 26 14:43:35 test-ng audit[26262]: AVC apparmor="STATUS" operation="profile_remove" profile="unconfined" name="lxd_archive-var-snap-lxd-common-lxd-storage-pools-multipass-virtual-machines-multipass_enlivened-murrelet" pid=26262 comm="apparmor_parser"
Aug 26 14:43:35 test-ng kernel: audit: type=1400 audit(1661525015.954:719): apparmor="STATUS" operation="profile_remove" profile="unconfined" name="lxd_archive-var-snap-lxd-common-lxd-storage-pools-multipass-virtual-machines-multipass_enlivened-murrelet" pid=26262 comm="apparmor_parser"
Aug 26 14:43:43 test-ng networkd-dispatcher[1048]: WARNING:Unknown index 41 seen, reloading interface list
Aug 26 14:43:43 test-ng systemd-udevd[26285]: Using default interface naming scheme 'v249'.
Aug 26 14:43:43 test-ng systemd-networkd[1012]: tapb85e6991: Link UP
Aug 26 14:43:43 test-ng kernel: mpbr0: port 1(tapb85e6991) entered blocking state
Aug 26 14:43:43 test-ng kernel: mpbr0: port 1(tapb85e6991) entered disabled state
Aug 26 14:43:43 test-ng kernel: device tapb85e6991 entered promiscuous mode
Aug 26 14:43:43 test-ng networkd-dispatcher[1048]: WARNING:Unknown index 42 seen, reloading interface list
Aug 26 14:43:43 test-ng systemd-networkd[1012]: tap1632b249: Link UP
Aug 26 14:43:43 test-ng kernel: br0: port 2(tap1632b249) entered blocking state
Aug 26 14:43:43 test-ng kernel: br0: port 2(tap1632b249) entered disabled state
Aug 26 14:43:43 test-ng kernel: device tap1632b249 entered promiscuous mode
Aug 26 14:43:43 test-ng kernel: br0: port 2(tap1632b249) entered blocking state
Aug 26 14:43:43 test-ng kernel: br0: port 2(tap1632b249) entered forwarding state
Aug 26 14:43:43 test-ng audit[26307]: AVC apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxd-multipass_enlivened-murrelet_</var/snap/lxd/common/lxd>" pid=26307 comm="apparmor_parser"
Aug 26 14:43:43 test-ng kernel: audit: type=1400 audit(1661525023.214:720): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxd-multipass_enlivened-murrelet_</var/snap/lxd/common/lxd>" pid=26307 comm="apparmor_parser"
Aug 26 14:43:43 test-ng systemd-networkd[1012]: tapb85e6991: Gained carrier
Aug 26 14:43:43 test-ng systemd-networkd[1012]: mpbr0: Gained carrier
Aug 26 14:43:43 test-ng kernel: mpbr0: port 1(tapb85e6991) entered blocking state
Aug 26 14:43:43 test-ng kernel: mpbr0: port 1(tapb85e6991) entered forwarding state
Aug 26 14:43:43 test-ng systemd-networkd[1012]: tap1632b249: Gained carrier
Aug 26 14:43:43 test-ng multipassd[14879]: Waiting for SSH to be up
Aug 26 14:44:00 test-ng systemd-networkd[1012]: tapb85e6991: Lost carrier
Aug 26 14:44:00 test-ng kernel: mpbr0: port 1(tapb85e6991) entered disabled state
Aug 26 14:44:00 test-ng kernel: device tap1632b249 left promiscuous mode
Aug 26 14:44:00 test-ng kernel: br0: port 2(tap1632b249) entered disabled state
Aug 26 14:44:00 test-ng systemd-networkd[1012]: tap1632b249: Link UP
Aug 26 14:44:00 test-ng systemd-networkd[1012]: tap1632b249: Gained carrier
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: WARNING:Unknown index 42 seen, reloading interface list
Aug 26 14:44:00 test-ng systemd-networkd[1012]: tap1632b249: Link DOWN
Aug 26 14:44:00 test-ng systemd-networkd[1012]: tap1632b249: Lost carrier
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: ERROR:Unknown interface index 42 seen even after reload
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: WARNING:Unknown index 42 seen, reloading interface list
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: ERROR:Unknown interface index 42 seen even after reload
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: WARNING:Unknown index 42 seen, reloading interface list
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: ERROR:Unknown interface index 42 seen even after reload
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: WARNING:Unknown index 42 seen, reloading interface list
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: ERROR:Unknown interface index 42 seen even after reload
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: WARNING:Unknown index 42 seen, reloading interface list
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: ERROR:Unknown interface index 42 seen even after reload
Aug 26 14:44:00 test-ng kernel: device tapb85e6991 left promiscuous mode
Aug 26 14:44:00 test-ng kernel: mpbr0: port 1(tapb85e6991) entered disabled state
Aug 26 14:44:00 test-ng systemd-networkd[1012]: tapb85e6991: Link UP
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: WARNING:Unknown index 41 seen, reloading interface list
Aug 26 14:44:00 test-ng systemd-networkd[1012]: tapb85e6991: Link DOWN
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: ERROR:Unknown interface index 41 seen even after reload
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: WARNING:Unknown index 41 seen, reloading interface list
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: ERROR:Unknown interface index 41 seen even after reload
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: WARNING:Unknown index 41 seen, reloading interface list
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: ERROR:Unknown interface index 41 seen even after reload
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: WARNING:Unknown index 41 seen, reloading interface list
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: ERROR:Unknown interface index 41 seen even after reload
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: WARNING:Unknown index 41 seen, reloading interface list
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: ERROR:Unknown interface index 41 seen even after reload
Aug 26 14:44:00 test-ng audit[26428]: AVC apparmor="STATUS" operation="profile_remove" profile="unconfined" name="lxd-multipass_enlivened-murrelet_</var/snap/lxd/common/lxd>" pid=26428 comm="apparmor_parser"
Aug 26 14:44:00 test-ng kernel: audit: type=1400 audit(1661525040.665:721): apparmor="STATUS" operation="profile_remove" profile="unconfined" name="lxd-multipass_enlivened-murrelet_</var/snap/lxd/common/lxd>" pid=26428 comm="apparmor_parser"
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: WARNING:Unknown index 43 seen, reloading interface list
Aug 26 14:44:00 test-ng systemd-udevd[26412]: Using default interface naming scheme 'v249'.
Aug 26 14:44:00 test-ng systemd-networkd[1012]: tap6c3808f4: Link UP
Aug 26 14:44:00 test-ng kernel: mpbr0: port 1(tap6c3808f4) entered blocking state
Aug 26 14:44:00 test-ng kernel: mpbr0: port 1(tap6c3808f4) entered disabled state
Aug 26 14:44:00 test-ng kernel: device tap6c3808f4 entered promiscuous mode
Aug 26 14:44:00 test-ng kernel: mpbr0: port 1(tap6c3808f4) entered blocking state
Aug 26 14:44:00 test-ng kernel: mpbr0: port 1(tap6c3808f4) entered forwarding state
Aug 26 14:44:00 test-ng networkd-dispatcher[1048]: WARNING:Unknown index 44 seen, reloading interface list
Aug 26 14:44:00 test-ng systemd-networkd[1012]: tapfd19b8f0: Link UP
Aug 26 14:44:00 test-ng kernel: br0: port 2(tapfd19b8f0) entered blocking state
Aug 26 14:44:00 test-ng kernel: br0: port 2(tapfd19b8f0) entered disabled state
Aug 26 14:44:00 test-ng kernel: device tapfd19b8f0 entered promiscuous mode
Aug 26 14:44:00 test-ng kernel: br0: port 2(tapfd19b8f0) entered blocking state
Aug 26 14:44:00 test-ng kernel: br0: port 2(tapfd19b8f0) entered forwarding state
Aug 26 14:44:00 test-ng audit[26450]: AVC apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxd-multipass_enlivened-murrelet_</var/snap/lxd/common/lxd>" pid=26450 comm="apparmor_parser"
Aug 26 14:44:00 test-ng kernel: audit: type=1400 audit(1661525040.789:722): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxd-multipass_enlivened-murrelet_</var/snap/lxd/common/lxd>" pid=26450 comm="apparmor_parser"
Aug 26 14:44:00 test-ng systemd-networkd[1012]: tap6c3808f4: Gained carrier
Aug 26 14:44:00 test-ng systemd-networkd[1012]: tapfd19b8f0: Gained carrier
Aug 26 14:44:14 test-ng dnsmasq-dhcp[9884]: Ignoring domain multipass for DHCP host name enlivened-murrelet
Aug 26 14:44:20 test-ng audit[14879]: AVC apparmor="DENIED" operation="open" profile="snap.multipass.multipassd" name="/etc/ssh/ssh_config" pid=14879 comm=5468726561642028706F6F6C656429 requested_mask="r" denied_mask="r" fsuid=0 ouid=0
Aug 26 14:44:20 test-ng kernel: audit: type=1400 audit(1661525060.429:723): apparmor="DENIED" operation="open" profile="snap.multipass.multipassd" name="/etc/ssh/ssh_config" pid=14879 comm=5468726561642028706F6F6C656429 requested_mask="r" denied_mask="r" fsuid=0 ouid=0
Aug 26 14:44:20 test-ng audit[14879]: AVC apparmor="DENIED" operation="open" profile="snap.multipass.multipassd" name="/etc/ssh/ssh_config" pid=14879 comm=5468726561642028706F6F6C656429 requested_mask="r" denied_mask="r" fsuid=0 ouid=0
Aug 26 14:44:20 test-ng kernel: audit: type=1400 audit(1661525060.497:724): apparmor="DENIED" operation="open" profile="snap.multipass.multipassd" name="/etc/ssh/ssh_config" pid=14879 comm=5468726561642028706F6F6C656429 requested_mask="r" denied_mask="r" fsuid=0 ouid=0
Aug 26 14:44:20 test-ng multipassd[14879]: Executing '[ -e /var/lib/cloud/instance/boot-finished ]'
Aug 26 14:44:23 test-ng audit[14879]: AVC apparmor="DENIED" operation="open" profile="snap.multipass.multipassd" name="/etc/ssh/ssh_config" pid=14879 comm=5468726561642028706F6F6C656429 requested_mask="r" denied_mask="r" fsuid=0 ouid=0
Aug 26 14:44:23 test-ng kernel: audit: type=1400 audit(1661525063.777:725): apparmor="DENIED" operation="open" profile="snap.multipass.multipassd" name="/etc/ssh/ssh_config" pid=14879 comm=5468726561642028706F6F6C656429 requested_mask="r" denied_mask="r" fsuid=0 ouid=0
Aug 26 14:44:23 test-ng multipassd[14879]: Executing '[ -e /var/lib/cloud/instance/boot-finished ]'
Aug 26 14:44:25 test-ng audit[14879]: AVC apparmor="DENIED" operation="open" profile="snap.multipass.multipassd" name="/etc/ssh/ssh_config" pid=14879 comm=5468726561642028706F6F6C656429 requested_mask="r" denied_mask="r" fsuid=0 ouid=0
Aug 26 14:44:25 test-ng kernel: audit: type=1400 audit(1661525065.193:726): apparmor="DENIED" operation="open" profile="snap.multipass.multipassd" name="/etc/ssh/ssh_config" pid=14879 comm=5468726561642028706F6F6C656429 requested_mask="r" denied_mask="r" fsuid=0 ouid=0
Aug 26 14:44:25 test-ng multipassd[14879]: Executing '[ -e /var/lib/cloud/instance/boot-finished ]'
Aug 26 14:44:26 test-ng audit[14879]: AVC apparmor="DENIED" operation="open" profile="snap.multipass.multipassd" name="/etc/ssh/ssh_config" pid=14879 comm=5468726561642028706F6F6C656429 requested_mask="r" denied_mask="r" fsuid=0 ouid=0
Aug 26 14:44:26 test-ng kernel: audit: type=1400 audit(1661525066.557:727): apparmor="DENIED" operation="open" profile="snap.multipass.multipassd" name="/etc/ssh/ssh_config" pid=14879 comm=5468726561642028706F6F6C656429 requested_mask="r" denied_mask="r" fsuid=0 ouid=0
Aug 26 14:44:26 test-ng multipassd[14879]: Executing '[ -e /var/lib/cloud/instance/boot-finished ]'
Aug 26 14:44:26 test-ng multipassd[14879]: Returning setting local.privileged-mounts=true

Installed multipass and lxd version:

$ snap list multipass lxd
Name       Version        Rev    Tracking       Publisher   Notes
lxd        5.0.1-9dcf35b  23541  5.0/stable/…   canonical✓  -
multipass  1.10.1         7689   latest/stable  canonical✓  -

Reported also at https://discourse.ubuntu.com/t/bridged-networking-on-ubuntu-server-with-systemd-networkd-instead-network-manager/30235

gunterze avatar Aug 29 '22 10:08 gunterze