machnet icon indicating copy to clipboard operation
machnet copied to clipboard

Does this work across different regions on the cloud?

Open 0xbentang opened this issue 1 year ago • 5 comments

I'm using AWS and trying to test machnet for different AWS regions

When I try to run the hello world example, on the sender side I always got

ERROR: Failed to dequeue response from control queue.
machnet_connect() failed

Then I tried to create another VM in the same region, and the hello world works. This suggested something is wrong when it's cross regions?

I then also tried to build DPDK and run dpdk-testpmd on both end, and it shows it's receiving. The caveat is that for --eth-peer I need to specify the gateway MAC instead of the NIC MAC. I don't see similar setting in machnet, can you advise if this is indeed the issue and any potential fixes? Thanks in advance!

0xbentang avatar Dec 02 '24 07:12 0xbentang

Hi @0xbentang,

Thanks for opening this issue. I can confirm that machnet doesn't currently support connecting to a remote peer when traffic needs to be routed to a different subnet via a gateway; machnet currently does ARP resolution for hosts in the same subnet. The changes should be straight forward but the current implementation just doesn't support this.

Best, Ilias

marinosi avatar Dec 02 '24 07:12 marinosi

Hi @marinosi,

Thanks for the quick reply! Good to know that it's currently not supported. Do you have an idea on when this will be implemented?

If possible I can also try to help on implementing it if it's straightforward. I'm more on Rust though and less experienced in C++, it will be very helpful if you can provide more context/guidance roughly on how you'd expect it to be done, thanks in advance!

0xbentang avatar Dec 02 '24 09:12 0xbentang

Hi @0xbentang @marinosi

@0xbentang, I am happy to sit with you sometime later this week to give some context so you can start.

sarsanaee avatar Dec 02 '24 09:12 sarsanaee

Hi @0xbentang @marinosi

@0xbentang, I am happy to sit with you sometime later this week to give some context so you can start.

Sure @sarsanaee what's the best way to communicate this?

0xbentang avatar Dec 02 '24 13:12 0xbentang

Thanks @0xbentang

Please join the following Discord server that I created recently. Please use the link and join; we can coordinate there. https://discord.gg/eYCJsc2n

sarsanaee avatar Dec 02 '24 21:12 sarsanaee