Helium_DPU icon indicating copy to clipboard operation
Helium_DPU copied to clipboard

Openstack Integration

Open Kryptoxic opened this issue 2 years ago • 11 comments

Is your feature request related to a problem? Please describe. I am trying to integrate the DPU with Openstack such that we are able to offload the OVS from Openstack to the DPU.

Describe the solution you'd like Seamless integration of the DPU that is in line with the Openstack documentation.

Additional context Looking at the Openstack documentation, there is a section where it mentions that Openstack will auto detect the smartnic based on the card serial number, PF mac address and VF logical number. I am not sure if the Helium advertises this to the server or not.

For reference, we are running Openstack Zed via the Kolla-Ansible deploy method on an all-in-one inventory.

https://docs.openstack.org/neutron/zed/admin/ovn/smartnic_dpu.html

Kryptoxic avatar May 25 '23 03:05 Kryptoxic

Just an update, I tried following the instructions in the openstack documentation after setting up the Helium drivers and when I try to create the virtual machine on openstack and use the port which is mapped to the Helium's port and I am met with the following error.

image

Kryptoxic avatar May 30 '23 09:05 Kryptoxic

Thank you for your comments. Could you possibly send us your configuration?

Aster-Marvin avatar May 31 '23 01:05 Aster-Marvin

Which specific configuration do you need? I used the devstack script to setup a openstack instance on my test server before following the commands listed in the openstack documentation which I linked in the first post.

Kryptoxic avatar May 31 '23 02:05 Kryptoxic

OK. I will follow the reference to reproduce it.

Aster-Marvin avatar May 31 '23 04:05 Aster-Marvin

Here is more information about devstack and how I set my test server up.

https://docs.openstack.org/devstack/latest/

After the setup I created an instance to ensure that everything is working correctly before I installed and loaded the helium drivers. Then I followed the instructions in https://docs.openstack.org/neutron/zed/admin/ovn/smartnic_dpu.html to add the pci passthrough option in the /etc/nova/nova.conf.

image

After I have set that in the nova.conf, I set the serial number in the helium ovs table.

image

The serial number I got by running lspci on the host with the DPU pci address

image

Then I added the port to the openstack network

image

And finally create the VM on openstack. But at this point, I meet the error which I posted earlier.

image

Kryptoxic avatar May 31 '23 05:05 Kryptoxic

Hi guys,

Is there any update on this?

Kryptoxic avatar Jun 05 '23 03:06 Kryptoxic

Hi, we check the off-path spec, and found the "PCIe VPD capability" is not exposed on PCIe bar space. Then we should add this capability first, any news will let you know later.

Aster-Marvin avatar Jun 06 '23 05:06 Aster-Marvin

Hi Marvin,

Thanks for the update. Is there a timeline on adding this capability?

Kryptoxic avatar Jun 06 '23 06:06 Kryptoxic

When it query table resource_provider_traits in database placement, trait_id=257 (corresponding to COMPUTE_REMOTE_MANAGED_PORTS) is not found, therefore it is believed that remote-managed is not supported, resulting in a failure to create a virtual machine.

You can add a piece of data to make the detection pass: image image

zcf900604 avatar Sep 27 '23 08:09 zcf900604

Thanks for the information. We tried to follow your instructions in our production environment which is deployed using kolla ansible but we still meet the same issue.

image

image

Kryptoxic avatar Sep 27 '23 09:09 Kryptoxic

Hi @zcf900604, is there any updates? Apologies for the rush but we have a deadline to meet for the customer as well.

Kryptoxic avatar Oct 02 '23 01:10 Kryptoxic