XMU Devices are not preserved when switching between controllers on an input

[antangelo]

Bug Description

Steps to reproduce:

1. Connect two controllers to xemu (one can be Keyboard)
2. Under input, have one controller connected to port 1 and one unconnected
3. Connect an XMU peripheral to the controller
4. Switch to the other controller
5. Observe that the XMU peripherals have been disconnected

Note that this behavior does not occur if None is selected before switching controllers.

Expected Behavior

XMU devices should be maintained after switching controllers

xemu Version

v0.7.118 hash 03f40b1d8e873b57eab68dc66ae9892aa5e39f89

System Information

No response

Additional Context

This is caused by qemu releasing the XMU devices when the controller is disconnected, because xemu is recreating the underlying controller. See discussion here: https://github.com/xemu-project/xemu/pull/1315#discussion_r1376541676