conan-center-index icon indicating copy to clipboard operation
conan-center-index copied to clipboard

dpdk: new recipe

Open valgur opened this issue 1 year ago • 10 comments

Summary

Changes to recipe: dpdk/24.07

Motivation

DPDK: a set of libraries and drivers for fast packet processing

https://www.dpdk.org/ https://github.com/DPDK/dpdk

Packaging status

Details

Continues from #24801 and fills many gaps in that recipe.

  • Closes #24801
  • Closes #5210

valgur avatar Aug 04 '24 15:08 valgur

Conan v1 pipeline :heavy_check_mark:

All green in build 1 (fb6371990eedf28d634c7d5e2a641da969b8ea90):

  • dpdk/24.07: All packages built successfully! (All logs)

Conan v2 pipeline :x:

Note: Conan v2 builds are now mandatory. Please read our discussion about it.

The v2 pipeline failed. Please, review the errors and note this is required for pull requests to be merged. In case this recipe is still not ported to Conan 2.x, please, ping @conan-io/barbarians on the PR and we will help you.

Failure in build 1 (fb6371990eedf28d634c7d5e2a641da969b8ea90):

  • dpdk/24.07: CI failed to create some packages (All logs)

    Logs for packageID d464e14efa63c947876b4a9f013096dd542d57ee:
    [settings]
    arch=x86_64
    build_type=Release
    compiler=gcc
    compiler.cppstd=17
    compiler.libcxx=libstdc++11
    compiler.version=11
    os=Linux
    [options]
    */*:shared=True
    
    [...]
          |                                  ^~~~~~~~~~~~
    ../src/lib/eal/include/rte_common.h:688:67: warning: initialization of 'const int *' from incompatible pointer type 'struct vfio_info_cap_header *' [-Wincompatible-pointer-types]
      688 |                         const typeof(((type *)0)->member) *_ptr = (ptr); \
          |                                                                   ^
    ../src/drivers/bus/pci/linux/pci_vfio.c:875:34: note: in expansion of macro 'container_of'
      875 |                         sparse = container_of(hdr,
          |                                  ^~~~~~~~~~~~
    In file included from /usr/include/time.h:37,
                     from ../src/lib/eal/include/rte_eal.h:15,
                     from ../src/lib/eal/include/rte_lcore.h:18,
                     from ../src/lib/eal/include/generic/rte_spinlock.h:20,
                     from ../src/lib/eal/x86/include/rte_spinlock.h:12,
                     from ../src/lib/eal/x86/include/rte_rwlock.h:13,
                     from ../src/lib/eal/include/rte_eal_memconfig.h:10,
                     from ../src/lib/eal/include/rte_memory.h:25,
                     from ../src/lib/eal/include/rte_malloc.h:16,
                     from ../src/drivers/bus/pci/linux/pci_vfio.c:18:
    ../src/lib/eal/include/rte_common.h:691:54: error: invalid use of undefined type 'struct vfio_region_info_cap_sparse_mmap'
      691 |                         (type *)(((uintptr_t)_ptr) - offsetof(type, member)); \
          |                                                      ^~~~~~~~
    ../src/drivers/bus/pci/linux/pci_vfio.c:875:34: note: in expansion of macro 'container_of'
      875 |                         sparse = container_of(hdr,
          |                                  ^~~~~~~~~~~~
    ../src/drivers/bus/pci/linux/pci_vfio.c:877:35: error: invalid use of undefined type 'struct vfio_region_info_cap_sparse_mmap'
      877 |                         if (sparse->nr_areas > 0) {
          |                                   ^~
    ../src/drivers/bus/pci/linux/pci_vfio.c:878:58: error: invalid use of undefined type 'struct vfio_region_info_cap_sparse_mmap'
      878 |                                 maps[i].nr_areas = sparse->nr_areas;
          |                                                          ^~
    ../src/drivers/bus/pci/linux/pci_vfio.c:880:47: error: invalid application of 'sizeof' to incomplete type 'struct vfio_region_sparse_mmap_area'
      880 |                                         sizeof(*maps[i].areas) * maps[i].nr_areas, 0);
          |                                               ^
    ../src/drivers/bus/pci/linux/pci_vfio.c:885:61: error: invalid use of undefined type 'struct vfio_region_info_cap_sparse_mmap'
      885 |                                 memcpy(maps[i].areas, sparse->areas,
          |                                                             ^~
    ../src/drivers/bus/pci/linux/pci_vfio.c:886:47: error: invalid application of 'sizeof' to incomplete type 'struct vfio_region_sparse_mmap_area'
      886 |                                         sizeof(*maps[i].areas) * maps[i].nr_areas);
          |                                               ^
    [622/2671] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o
    [623/2671] Compiling C object drivers/libtmp_rte_bus_platform.a.p/bus_platform_platform.c.o
    ninja: build stopped: subcommand failed.
    INFO: autodetecting backend as ninja
    INFO: calculating backend command to run: /home/conan/workspace/prod-v2/bsr/69879/abeae/p/ninja6fed3c8400c5b/p/bin/ninja -j 3
    
    dpdk/24.07: ERROR: 
    Package 'd464e14efa63c947876b4a9f013096dd542d57ee' build failed
    dpdk/24.07: WARN: Build folder /home/conan/workspace/prod-v2/bsr/69879/abeae/p/b/dpdk18304c9f89969/b/build-release
    ERROR: dpdk/24.07: Error in build() method, line 145
    	meson.build()
    	ConanException: Error 1 while executing
    

Note: To save resources, CI tries to finish as soon as an error is found. For this reason you might find that not all the references have been launched or not all the configurations for a given reference. Also, take into account that we cannot guarantee the order of execution as it depends on CI workload and workers availability.

conan-center-bot avatar Aug 04 '24 16:08 conan-center-bot

Conan v1 pipeline :heavy_check_mark:

All green in build 2 (f550030dfc4e7fa031520e0f01dd432536516635):

  • dpdk/24.07: All packages built successfully! (All logs)

Conan v2 pipeline :x:

Note: Conan v2 builds are now mandatory. Please read our discussion about it.

The v2 pipeline failed. Please, review the errors and note this is required for pull requests to be merged. In case this recipe is still not ported to Conan 2.x, please, ping @conan-io/barbarians on the PR and we will help you.

Failure in build 2 (f550030dfc4e7fa031520e0f01dd432536516635):

  • dpdk/24.07: CI failed to create some packages (All logs)

    Logs for packageID d464e14efa63c947876b4a9f013096dd542d57ee:
    [settings]
    arch=x86_64
    build_type=Release
    compiler=gcc
    compiler.cppstd=17
    compiler.libcxx=libstdc++11
    compiler.version=11
    os=Linux
    [options]
    */*:shared=True
    
    [...]
          |                                  ^~~~~~~~~~~~
    ../src/lib/eal/include/rte_common.h:688:67: warning: initialization of 'const int *' from incompatible pointer type 'struct vfio_info_cap_header *' [-Wincompatible-pointer-types]
      688 |                         const typeof(((type *)0)->member) *_ptr = (ptr); \
          |                                                                   ^
    ../src/drivers/bus/pci/linux/pci_vfio.c:875:34: note: in expansion of macro 'container_of'
      875 |                         sparse = container_of(hdr,
          |                                  ^~~~~~~~~~~~
    In file included from /usr/include/time.h:37,
                     from ../src/lib/eal/include/rte_eal.h:15,
                     from ../src/lib/eal/include/rte_lcore.h:18,
                     from ../src/lib/eal/include/generic/rte_spinlock.h:20,
                     from ../src/lib/eal/x86/include/rte_spinlock.h:12,
                     from ../src/lib/eal/x86/include/rte_rwlock.h:13,
                     from ../src/lib/eal/include/rte_eal_memconfig.h:10,
                     from ../src/lib/eal/include/rte_memory.h:25,
                     from ../src/lib/eal/include/rte_malloc.h:16,
                     from ../src/drivers/bus/pci/linux/pci_vfio.c:18:
    ../src/lib/eal/include/rte_common.h:691:54: error: invalid use of undefined type 'struct vfio_region_info_cap_sparse_mmap'
      691 |                         (type *)(((uintptr_t)_ptr) - offsetof(type, member)); \
          |                                                      ^~~~~~~~
    ../src/drivers/bus/pci/linux/pci_vfio.c:875:34: note: in expansion of macro 'container_of'
      875 |                         sparse = container_of(hdr,
          |                                  ^~~~~~~~~~~~
    ../src/drivers/bus/pci/linux/pci_vfio.c:877:35: error: invalid use of undefined type 'struct vfio_region_info_cap_sparse_mmap'
      877 |                         if (sparse->nr_areas > 0) {
          |                                   ^~
    ../src/drivers/bus/pci/linux/pci_vfio.c:878:58: error: invalid use of undefined type 'struct vfio_region_info_cap_sparse_mmap'
      878 |                                 maps[i].nr_areas = sparse->nr_areas;
          |                                                          ^~
    ../src/drivers/bus/pci/linux/pci_vfio.c:880:47: error: invalid application of 'sizeof' to incomplete type 'struct vfio_region_sparse_mmap_area'
      880 |                                         sizeof(*maps[i].areas) * maps[i].nr_areas, 0);
          |                                               ^
    ../src/drivers/bus/pci/linux/pci_vfio.c:885:61: error: invalid use of undefined type 'struct vfio_region_info_cap_sparse_mmap'
      885 |                                 memcpy(maps[i].areas, sparse->areas,
          |                                                             ^~
    ../src/drivers/bus/pci/linux/pci_vfio.c:886:47: error: invalid application of 'sizeof' to incomplete type 'struct vfio_region_sparse_mmap_area'
      886 |                                         sizeof(*maps[i].areas) * maps[i].nr_areas);
          |                                               ^
    [625/2671] Generating drivers/rte_bus_uacce.pmd.c with a custom command
    [626/2671] Compiling C object drivers/libtmp_rte_bus_platform.a.p/bus_platform_platform.c.o
    ninja: build stopped: subcommand failed.
    INFO: autodetecting backend as ninja
    INFO: calculating backend command to run: /home/conan/workspace/prod-v2/bsr/69885/dfaec/p/ninja6fed3c8400c5b/p/bin/ninja -j 3
    
    dpdk/24.07: ERROR: 
    Package 'd464e14efa63c947876b4a9f013096dd542d57ee' build failed
    dpdk/24.07: WARN: Build folder /home/conan/workspace/prod-v2/bsr/69885/dfaec/p/b/dpdk4628ccb6a2bfb/b/build-release
    ERROR: dpdk/24.07: Error in build() method, line 148
    	meson.build()
    	ConanException: Error 1 while executing
    

Note: To save resources, CI tries to finish as soon as an error is found. For this reason you might find that not all the references have been launched or not all the configurations for a given reference. Also, take into account that we cannot guarantee the order of execution as it depends on CI workload and workers availability.

conan-center-bot avatar Aug 04 '24 16:08 conan-center-bot

@wadehunk Can you give this recipe version a try? It builds ok for me locally. I think the issue in CI is related to an old Linux kernel version being used there.

valgur avatar Aug 05 '24 13:08 valgur

@valgur Can confirm this builds locally with gcc11-ubuntu22.04 and gcc13-almalinux9.

Looks like the ubuntu16 CI image has kernel version 4.18, but installed kernel headers are for v4.4. The compilation error looks like it will need kernel headers >= 4.6.

wadehunk avatar Aug 05 '24 17:08 wadehunk

Conan v1 pipeline :heavy_check_mark:

All green in build 3 (66e6dfdf89dd6f2e3f5c2f98d0fc9afa0b938afe):

  • dpdk/24.07: All packages built successfully! (All logs)

conan-center-bot avatar Aug 05 '24 20:08 conan-center-bot

Conan v1 pipeline :heavy_check_mark:

All green in build 4 (66e6dfdf89dd6f2e3f5c2f98d0fc9afa0b938afe):

  • dpdk/24.07: All packages built successfully! (All logs)

Conan v2 pipeline :heavy_check_mark:

Note: Conan v2 builds are now mandatory. Please read our discussion about it.

All green in build 4 (66e6dfdf89dd6f2e3f5c2f98d0fc9afa0b938afe):

  • dpdk/24.07: All packages built successfully! (All logs)

conan-center-bot avatar Aug 05 '24 20:08 conan-center-bot

@AbrilRBS @uilianries @perseoGI The PR should be ready for review but the linter marks it as failing due to a dubious error. Maybe you can review the PR regardless of the CI failure. I tagged you just for visibility, not because it's urgent.

valgur avatar Aug 06 '24 14:08 valgur

Conan v1 pipeline :x:

Failure in build 5 (4e3b237cec6f6c565f6f9edb4ebced1568072275):

  • dpdk/24.07: Error running command conan export recipes/dpdk/all/conanfile.py dpdk/24.07@:
    WARN: *** Conan 1 is legacy and on a deprecation path ***
    WARN: *** Please upgrade to Conan 2 ***
    ERROR: Error loading conanfile at '/home/conan/workspace/prod-v1_cci_PR-24817/recipes/dpdk/all/conanfile.py': Current Conan version (1.64.1) does not satisfy the defined one (>=2.0).
    

Note: To save resources, CI tries to finish as soon as an error is found. For this reason you might find that not all the references have been launched or not all the configurations for a given reference. Also, take into account that we cannot guarantee the order of execution as it depends on CI workload and workers availability.

conan-center-bot avatar Aug 06 '24 14:08 conan-center-bot

Conan v1 pipeline :heavy_check_mark:

All green in build 6 (66e6dfdf89dd6f2e3f5c2f98d0fc9afa0b938afe):

  • dpdk/24.07: All packages built successfully! (All logs)

Conan v2 pipeline :heavy_check_mark:

Note: Conan v2 builds are now mandatory. Please read our discussion about it.

All green in build 6 (66e6dfdf89dd6f2e3f5c2f98d0fc9afa0b938afe):

  • dpdk/24.07: All packages built successfully! (All logs)

conan-center-bot avatar Aug 06 '24 15:08 conan-center-bot

Hi @valgur soon we will introduce a new linter, right now you can ignore that error... We will try to review this PR soon! Thank you as always :)

perseoGI avatar Aug 07 '24 09:08 perseoGI

Conan v1 pipeline :heavy_check_mark:

All green in build 7 (66e6dfdf89dd6f2e3f5c2f98d0fc9afa0b938afe):

  • dpdk/24.07: No packages built :warning: (All logs)

conan-center-bot avatar Sep 26 '24 14:09 conan-center-bot

Conan v1 pipeline :heavy_check_mark:

[!WARNING] Conan Center will stop receiving updates for Conan 1.x packages soon - please see announcement.

All green in build 8 (66e6dfdf89dd6f2e3f5c2f98d0fc9afa0b938afe):

  • dpdk/24.07: No packages built :warning: (All logs)

Conan v2 pipeline :heavy_check_mark:

Note: Conan v2 builds are now mandatory. Please read our discussion about it.

All green in build 8 (66e6dfdf89dd6f2e3f5c2f98d0fc9afa0b938afe):

  • dpdk/24.07: Built 1 packages out of 10 (All logs)

conan-center-bot avatar Oct 02 '24 13:10 conan-center-bot

Conan v1 pipeline :heavy_check_mark:

[!WARNING] Conan Center will stop receiving updates for Conan 1.x packages soon - please see announcement.

All green in build 10 (445791435ee6d24f439aecab94cd020051f60e76):

  • dpdk/24.07: No packages built :warning: (All logs)

Conan v2 pipeline :heavy_check_mark:

Note: Conan v2 builds are now mandatory. Please read our discussion about it.

All green in build 10 (445791435ee6d24f439aecab94cd020051f60e76):

  • dpdk/24.07: Built 1 packages out of 10 (All logs)

conan-center-bot avatar Oct 31 '24 22:10 conan-center-bot

Hey, any update on this? Would be nice it to be finally merged.

selevit avatar Jan 07 '25 16:01 selevit

I don't feel like closing 200 PRs yet, so you'll have to convince someone from the team to take care of the builds on this one.

valgur avatar Jan 07 '25 17:01 valgur

Is it going to be merged in?

dpronin avatar Jan 30 '25 20:01 dpronin

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
1 out of 2 committers have signed the CLA.

:white_check_mark: wadehunk
:x: Martin Valgur


Martin Valgur seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You have signed the CLA already but the status is still pending? Let us recheck it.

CLAassistant avatar Mar 09 '25 08:03 CLAassistant