exo icon indicating copy to clipboard operation
exo copied to clipboard

support for qemu?

Open JocelynPanPan opened this issue 11 months ago • 11 comments

Does the project currently support interconnection of multiple qemu virtual machines? I installed exo in Qemu of multiple architectures, but they can't find each other.

JocelynPanPan avatar Jan 18 '25 11:01 JocelynPanPan

Sounds like a network issue to me. I did some early testing using KVM, which is similar. While i had other issues networking was not one of them. ( many reported by others around here so i didn't, and holding off on more testing until things stabilize more )

Nurb4000 avatar Jan 18 '25 11:01 Nurb4000

Thank you for your reply, the network should be a reason. My main purpose is to test whether servers with different architectures can be interconnected, so I tested it on ARM and x86 servers in the same network segment, and they were also unable to recognize each other.

JocelynPanPan avatar Jan 19 '25 08:01 JocelynPanPan

Unless i got things confused ( doing a lot of testing that week ) during one of my tests i was able to add a JetsonNX device ( ARM based ) to a couple of x86 VMs ( on a proxmox server ) and they saw each other. Had other issues, but networking wasn't one of them.

Nurb4000 avatar Jan 19 '25 14:01 Nurb4000

According to your tests, devices with different architectures should be able to recognize each other. Have you made any changes to this? I don't know how to solve this problem now.

JocelynPanPan avatar Jan 19 '25 14:01 JocelynPanPan

I made no changes, but it was not 'todays version' since it was a couple of weeks ago. If i get a chance this weekend ill spin up a couple of VMs and dig out an ARM box out of the closet and try most current and see if they at least talk to each other still.

While this project has great promise in the long run, I stopped my testing as there were enough other issues going on i figured i wait a bit. Honestly don't have time these days to be on bleeding edge of stuff and contribute back bug reports. Too busy at the office with a new project for me to be useful.

Nurb4000 avatar Jan 19 '25 14:01 Nurb4000

Got it, thank you! At least now I know that devices from different architectures can recognize one another. I will try to solve it next.

JocelynPanPan avatar Jan 19 '25 14:01 JocelynPanPan

Well i had a few mins so thought id try it, but i had forgot about it trying to install MLX on non apple ARM ( which fails to install since its not an apple device ). I forget the work around, but if i have time later ill go try to dig that up.

EDIT: seems others are having this same issue with MLX, i thought is saw it before and worked around it, perhaps im dreaming. Once i see a workaround and i get a few spare minutes ill get my laptop ( ya, its arm, im a weirdo ) hooked up and see if it still talks to x86. ( tearing apart my jetson isn't practical right now due to time )

Nurb4000 avatar Jan 19 '25 17:01 Nurb4000

OK, looking forward to your results.

JocelynPanPan avatar Jan 21 '25 08:01 JocelynPanPan

They fixed the MLX issue today and got it running on my laptop, a RK3588. Also started up 2 x86 VMs, using KVM ( via PVE server ). All on the same physical subnet.

Networking worked right out of the box. Cant say about 'use' as none of these would be worthy of even trying that. But they did find each other and connected fine.

I suspect its due to your VMs behind behind NAT or something. When i used QEMU on my desktop for the occasional testing VM ( not related to exo ), it was a lot of overhead to get past that and i never did.

Image

Nurb4000 avatar Jan 21 '25 17:01 Nurb4000

OK, thank you very much for the test results. It seems that I still need to spend some time on the network configuration of the Qemu virtual machine.

JocelynPanPan avatar Jan 22 '25 10:01 JocelynPanPan

Please I need a littile bit of help. I am trying to run exo on WSL as well. when i run just the exo command it shows me available commands. but when I try to run the command "exo run llama-3.2-3b" I get "error: unknown command "run" for "exo"

Did you mean this? runstatus" error. Please help.

Fahad16301139 avatar Feb 06 '25 03:02 Fahad16301139