conan icon indicating copy to clipboard operation
conan copied to clipboard

Missing binary even though conan search finds it

Open dyscalculia94 opened this issue 2 years ago • 3 comments

  • Operating System+version: Linux Mint 20.3 Cinnamon
  • Compiler+version: clang version 10.0.0-4ubuntu1
  • Conan version: 1.50.0
  • Python version: 3.8.10

Steps to reproduce (Include if Applicable)

  1. Running conan install -pr clang_debug . -if bin/ --update throws a bunch of missing binaries

Logs (Executed commands with output) (Include/Attach if Applicable)

Running conan remote list returns conancenter: https://center.conan.io [Verify SSL: True]

My clang_debug profile:

[settings]
os=Linux
os_build=Linux
arch=x86_64
arch_build=x86_64
compiler=clang
compiler.version=10
compiler.libcxx=libstdc++11
compiler.cppstd=14
build_type=Debug


[env]
CC=/usr/bin/clang
CXX=/usr/bin/clang++

My conanfile.py:

from conans import ConanFile, CMake, tools

class AnalysisConan(ConanFile):
    name = "analysis"
    version = "1.0"
    settings = "os", "compiler", "build_type", "arch"
    generators = "cmake_paths"
    requires = "openimageio/2.3.7.2"#, "libiconv/1.17"

Finally, running conan install -pr clang_debug . -if bin/ --update prints this out:```

Requirements
  ade/0.1.1f from 'conancenter' - Downloaded
  autoconf/2.71 from 'conancenter' - Downloaded
  automake/1.16.5 from 'conancenter' - Downloaded
  boost/1.78.0 from 'conancenter' - Downloaded
  brotli/1.0.9 from 'conancenter' - Downloaded
  bzip2/1.0.8 from 'conancenter' - Downloaded
  eigen/3.3.9 from 'conancenter' - Downloaded
  expat/2.4.8 from 'conancenter' - Downloaded
  ffmpeg/4.4 from 'conancenter' - Downloaded
  flac/1.3.3 from 'conancenter' - Downloaded
  fmt/8.1.1 from 'conancenter' - Downloaded
  freetype/2.11.1 from 'conancenter' - Downloaded
  giflib/5.2.1 from 'conancenter' - Downloaded
  gtk/system from 'conancenter' - Downloaded
  hdf5/1.12.1 from 'conancenter' - Downloaded
  jasper/2.0.33 from 'conancenter' - Downloaded
  jbig/20160605 from 'conancenter' - Downloaded
  lcms/2.13.1 from 'conancenter' - Downloaded
  libalsa/1.2.5.1 from 'conancenter' - Downloaded
  libbacktrace/cci.20210118 from 'conancenter' - Downloaded
  libcap/2.62 from 'conancenter' - Downloaded
  libde265/1.0.8 from 'conancenter' - Downloaded
  libdeflate/1.10 from 'conancenter' - Downloaded
  libfdk_aac/2.0.2 from 'conancenter' - Downloaded
  libffi/3.4.2 from 'conancenter' - Downloaded
  libheif/1.12.0 from 'conancenter' - Downloaded
  libiconv/1.16 from 'conancenter' - Downloaded
  libjpeg/9d from 'conancenter' - Downloaded
  libmp3lame/3.100 from 'conancenter' - Downloaded
  libpng/1.6.37 from 'conancenter' - Downloaded
  libsndfile/1.0.31 from 'conancenter' - Downloaded
  libsquish/1.15 from 'conancenter' - Downloaded
  libtiff/4.3.0 from 'conancenter' - Downloaded
  libtool/2.4.6 from 'conancenter' - Downloaded
  libvpx/1.11.0 from 'conancenter' - Downloaded
  libwebp/1.2.2 from 'conancenter' - Downloaded
  libx264/20191217 from 'conancenter' - Downloaded
  libx265/3.4 from 'conancenter' - Downloaded
  libxml2/2.9.14 from 'conancenter' - Downloaded
  m4/1.4.19 from 'conancenter' - Downloaded
  ogg/1.3.5 from 'conancenter' - Downloaded
  onetbb/2020.3 from 'conancenter' - Downloaded
  opencolorio/2.1.0 from 'conancenter' - Downloaded
  opencv/4.5.5 from 'conancenter' - Downloaded
  openexr/2.5.7 from 'conancenter' - Downloaded
  openh264/2.1.1 from 'conancenter' - Downloaded
  openimageio/2.3.7.2 from 'conancenter' - Downloaded
  openjpeg/2.4.0 from 'conancenter' - Downloaded
  openssl/1.1.1o from 'conancenter' - Downloaded
  opus/1.3.1 from 'conancenter' - Downloaded
  protobuf/3.17.1 from 'conancenter' - Downloaded
  ptex/2.4.0 from 'conancenter' - Downloaded
  pugixml/1.12.1 from 'conancenter' - Downloaded
  pulseaudio/14.2 from 'conancenter' - Downloaded
  pystring/1.1.3 from 'conancenter' - Downloaded
  quirc/1.1 from 'conancenter' - Downloaded
  tsl-robin-map/1.0.1 from 'conancenter' - Downloaded
  vaapi/system from 'conancenter' - Downloaded
  vdpau/system from 'conancenter' - Downloaded
  vorbis/1.3.7 from 'conancenter' - Downloaded
  vulkan-headers/1.3.211.0 from 'conancenter' - Downloaded
  vulkan-loader/1.3.211.0 from 'conancenter' - Downloaded
  wayland/1.20.0 from 'conancenter' - Downloaded
  xorg/system from 'conancenter' - Downloaded
  xz_utils/5.2.5 from 'conancenter' - Downloaded
  yaml-cpp/0.7.0 from 'conancenter' - Downloaded
  zlib/1.2.12 from 'conancenter' - Downloaded
  zstd/1.5.2 from 'conancenter' - Downloaded
Packages
  ade/0.1.1f:4ebd68c7311a450e176e0bb0ffc8882b6abd4482 - Missing
  autoconf/2.71:5ab84d6acfe1f23c4fae0ab88f26e3a396351ac9 - Download
  automake/1.16.5:258f6f05ca54813b3d7180161753df7f9ccf7e1d - Download
  boost/1.78.0:98094246420952eab592f95a5a99a5ed09e779e0 - Missing
  brotli/1.0.9:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9 - Download
  bzip2/1.0.8:23219b68e873594c97b915e5b682fd61d2caca86 - Download
  eigen/3.3.9:5ab84d6acfe1f23c4fae0ab88f26e3a396351ac9 - Download
  expat/2.4.8:f107943344aeffd2190b5bfc9516ac5e5cc868bf - Missing
  ffmpeg/4.4:e8487608a6fabf7b659bb3863cee556ff342972c - Missing
  flac/1.3.3:ddfe5f8d8713ba1b36b7c3abc635963db950901c - Missing
  fmt/8.1.1:518189a70e600f323cfde3a70a65f0d5ab9a10ea - Missing
  freetype/2.11.1:7c81318244ae90ae4401f48c7c35d83cda74da43 - Download
  giflib/5.2.1:aefdae7c0ad92293879899c21309c8e60ecebb8a - Download
  gtk/system:cc5e5ca8b619d2dffaaeae1e4924ae3ce085a8f1 - Download
  hdf5/1.12.1:dd3a266ced3d35b19cdd2afb59db13d30ae8e317 - Missing
  jasper/2.0.33:9847a07ff0c033b774ee63c429cc7a16ab6c40fb - Download
  jbig/20160605:698989beb298914c2b0d0a2f03262b7828bd36d0 - Download
  lcms/2.13.1:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9 - Missing
  libalsa/1.2.5.1:6232605ab953dfc4deeba04ad7936bd6514e4a60 - Download
  libbacktrace/cci.20210118:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9 - Download
  libcap/2.62:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9 - Missing
  libde265/1.0.8:e907ab56da208f9569d10623981804efe8ef4f5c - Missing
  libdeflate/1.10:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9 - Missing
  libfdk_aac/2.0.2:4ebd68c7311a450e176e0bb0ffc8882b6abd4482 - Missing
  libffi/3.4.2:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9 - Download
  libheif/1.12.0:212345031a146b5458db0d0e837d9af95cb840a0 - Missing
  libiconv/1.16:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9 - Download
  libjpeg/9d:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9 - Download
  libmp3lame/3.100:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9 - Download
  libpng/1.6.37:2148596ab5ded67db00344debefc9ccb8060352e - Download
  libsndfile/1.0.31:244e2036694f61c00771f1443b05053e29e20633 - Missing
  libsquish/1.15:4ebd68c7311a450e176e0bb0ffc8882b6abd4482 - Missing
  libtiff/4.3.0:28610262c5ae482418532e6e77118db48b5a933e - Missing
  libtool/2.4.6:99862aff33ecc6b40f05cc525b558780f5db8cac - Download
  libvpx/1.11.0:dcd66243bc948155f4f0f0cfd9360d4127dc8a27 - Missing
  libwebp/1.2.2:a09a552b2ea0e3af4ad938637eef2959778a4bcd - Missing
  libx264/20191217:3b18184b035dfe168837de7d82facd5fc5206fee - Download
  libx265/3.4:b0bb968b1ea177898e2255887164f9da9f588aa0 - Missing
  libxml2/2.9.14:4b8bcfd687ee0cb778b8e59589e8eb34d394d024 - Missing
  m4/1.4.19:cc9f9b2b9f92fc82888026414560bf79d8c3a052 - Download
  ogg/1.3.5:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9 - Missing
  onetbb/2020.3:388975d0e388b930ae8bf7be38463627332429c9 - Missing
  opencolorio/2.1.0:ade379e8d3b2b421dadb5aaf77fd523c5e57a22b - Missing
  opencv/4.5.5:5c50c9a7b4b0c110bebcb940592f772cd954219f - Missing
  openexr/2.5.7:a45ea4b6014968e6e9e934f0f5fa5a467fa981bf - Missing
  openh264/2.1.1:4ebd68c7311a450e176e0bb0ffc8882b6abd4482 - Missing
  openimageio/2.3.7.2:e681cd6c647ab27cc55544cea082bca09b24cffc - Missing
  openjpeg/2.4.0:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9 - Download
  openssl/1.1.1o:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9 - Missing
  opus/1.3.1:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9 - Download
  protobuf/3.17.1:fd5e4281291c630948790ffa396a8e6fbb9f42e6 - Missing
  ptex/2.4.0:a45ea4b6014968e6e9e934f0f5fa5a467fa981bf - Missing
  pugixml/1.12.1:4ebd68c7311a450e176e0bb0ffc8882b6abd4482 - Missing
  pulseaudio/14.2:b77dafbb410dfb4fc4ba4d776142e0a7ffd40d0c - Missing
  pystring/1.1.3:4ebd68c7311a450e176e0bb0ffc8882b6abd4482 - Missing
  quirc/1.1:48e7424851f7e11472debc691fdbbdb7a489b345 - Download
  tsl-robin-map/1.0.1:5ab84d6acfe1f23c4fae0ab88f26e3a396351ac9 - Download
  vaapi/system:5ab84d6acfe1f23c4fae0ab88f26e3a396351ac9 - Download
  vdpau/system:5ab84d6acfe1f23c4fae0ab88f26e3a396351ac9 - Download
  vorbis/1.3.7:28b9c709fc5411042bda7fd6a47ad0d4e620d64d - Download
  vulkan-headers/1.3.211.0:5ab84d6acfe1f23c4fae0ab88f26e3a396351ac9 - Download
  vulkan-loader/1.3.211.0:883f066ff242e0cc5f79101e485ebcc20a77a422 - Missing
  wayland/1.20.0:491924764982d2a8ce5f0d81f7f49331f933b2ff - Missing
  xorg/system:5ab84d6acfe1f23c4fae0ab88f26e3a396351ac9 - Download
  xz_utils/5.2.5:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9 - Download
  yaml-cpp/0.7.0:4ebd68c7311a450e176e0bb0ffc8882b6abd4482 - Missing
  zlib/1.2.12:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9 - Missing
  zstd/1.5.2:62a88ab7bbffda63e0c146e4fe66d5d90b946798 - Missing

Installing (downloading, building) binaries...
ERROR: Missing binary: ade/0.1.1f:4ebd68c7311a450e176e0bb0ffc8882b6abd4482
ERROR: Missing binary: boost/1.78.0:98094246420952eab592f95a5a99a5ed09e779e0
ERROR: Missing binary: expat/2.4.8:f107943344aeffd2190b5bfc9516ac5e5cc868bf
ERROR: Missing binary: ffmpeg/4.4:e8487608a6fabf7b659bb3863cee556ff342972c
ERROR: Missing binary: flac/1.3.3:ddfe5f8d8713ba1b36b7c3abc635963db950901c
ERROR: Missing binary: fmt/8.1.1:518189a70e600f323cfde3a70a65f0d5ab9a10ea
ERROR: Missing binary: hdf5/1.12.1:dd3a266ced3d35b19cdd2afb59db13d30ae8e317
ERROR: Missing binary: lcms/2.13.1:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9
ERROR: Missing binary: libcap/2.62:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9
ERROR: Missing binary: libde265/1.0.8:e907ab56da208f9569d10623981804efe8ef4f5c
ERROR: Missing binary: libdeflate/1.10:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9
ERROR: Missing binary: libfdk_aac/2.0.2:4ebd68c7311a450e176e0bb0ffc8882b6abd4482
ERROR: Missing binary: libheif/1.12.0:212345031a146b5458db0d0e837d9af95cb840a0
ERROR: Missing binary: libsndfile/1.0.31:244e2036694f61c00771f1443b05053e29e20633
ERROR: Missing binary: libsquish/1.15:4ebd68c7311a450e176e0bb0ffc8882b6abd4482
ERROR: Missing binary: libtiff/4.3.0:28610262c5ae482418532e6e77118db48b5a933e
ERROR: Missing binary: libvpx/1.11.0:dcd66243bc948155f4f0f0cfd9360d4127dc8a27
ERROR: Missing binary: libwebp/1.2.2:a09a552b2ea0e3af4ad938637eef2959778a4bcd
ERROR: Missing binary: libx265/3.4:b0bb968b1ea177898e2255887164f9da9f588aa0
ERROR: Missing binary: libxml2/2.9.14:4b8bcfd687ee0cb778b8e59589e8eb34d394d024
ERROR: Missing binary: ogg/1.3.5:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9
ERROR: Missing binary: onetbb/2020.3:388975d0e388b930ae8bf7be38463627332429c9
ERROR: Missing binary: opencolorio/2.1.0:ade379e8d3b2b421dadb5aaf77fd523c5e57a22b
ERROR: Missing binary: opencv/4.5.5:5c50c9a7b4b0c110bebcb940592f772cd954219f
ERROR: Missing binary: openexr/2.5.7:a45ea4b6014968e6e9e934f0f5fa5a467fa981bf
ERROR: Missing binary: openh264/2.1.1:4ebd68c7311a450e176e0bb0ffc8882b6abd4482
ERROR: Missing binary: openimageio/2.3.7.2:e681cd6c647ab27cc55544cea082bca09b24cffc
ERROR: Missing binary: openssl/1.1.1o:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9
ERROR: Missing binary: protobuf/3.17.1:fd5e4281291c630948790ffa396a8e6fbb9f42e6
ERROR: Missing binary: ptex/2.4.0:a45ea4b6014968e6e9e934f0f5fa5a467fa981bf
ERROR: Missing binary: pugixml/1.12.1:4ebd68c7311a450e176e0bb0ffc8882b6abd4482
ERROR: Missing binary: pulseaudio/14.2:b77dafbb410dfb4fc4ba4d776142e0a7ffd40d0c
ERROR: Missing binary: pystring/1.1.3:4ebd68c7311a450e176e0bb0ffc8882b6abd4482
ERROR: Missing binary: vulkan-loader/1.3.211.0:883f066ff242e0cc5f79101e485ebcc20a77a422
ERROR: Missing binary: wayland/1.20.0:491924764982d2a8ce5f0d81f7f49331f933b2ff
ERROR: Missing binary: yaml-cpp/0.7.0:4ebd68c7311a450e176e0bb0ffc8882b6abd4482
ERROR: Missing binary: zlib/1.2.12:72c3493baf37f6fd0e9e64ab36754d5a2f6479a9
ERROR: Missing binary: zstd/1.5.2:62a88ab7bbffda63e0c146e4fe66d5d90b946798

ade/0.1.1f: WARN: Can't find a 'ade/0.1.1f' package for the specified settings, options and dependencies:
- Settings: arch=x86_64, build_type=Debug, compiler=clang, compiler.cppstd=14, compiler.libcxx=libstdc++11, compiler.version=10, os=Linux
- Options: fPIC=True
- Dependencies: 
- Requirements: 
- Package ID: 4ebd68c7311a450e176e0bb0ffc8882b6abd4482

ERROR: Missing prebuilt package for 'ade/0.1.1f', 'boost/1.78.0', 'expat/2.4.8', 'ffmpeg/4.4', 'flac/1.3.3', 'fmt/8.1.1', 'hdf5/1.12.1', 'lcms/2.13.1', 'libcap/2.62', 'libde265/1.0.8', 'libdeflate/1.10', 'libfdk_aac/2.0.2', 'libheif/1.12.0', 'libsndfile/1.0.31', 'libsquish/1.15', 'libtiff/4.3.0', 'libvpx/1.11.0', 'libwebp/1.2.2', 'libx265/3.4', 'libxml2/2.9.14', 'ogg/1.3.5', 'onetbb/2020.3', 'opencolorio/2.1.0', 'opencv/4.5.5', 'openexr/2.5.7', 'openh264/2.1.1', 'openimageio/2.3.7.2', 'openssl/1.1.1o', 'protobuf/3.17.1', 'ptex/2.4.0', 'pugixml/1.12.1', 'pulseaudio/14.2', 'pystring/1.1.3', 'vulkan-loader/1.3.211.0', 'wayland/1.20.0', 'yaml-cpp/0.7.0', 'zlib/1.2.12', 'zstd/1.5.2'
Use 'conan search ade/0.1.1f --table=table.html -r=remote' and open the table.html file to see available packages
Or try to build locally from sources with '--build=missing'

More Info at 'https://docs.conan.io/en/latest/faq/troubleshooting.html#error-missing-prebuilt-package'

Running conan search ade/0.1.1f prints this out:

Existing package recipes:

ade/0.1.1f

Is this a bug in conan or am I doing something wrong?

P. S. Revisions for all of these packages are 0. E.g:

ade/0.1.1f: Not found in local cache, looking in remotes...
ade/0.1.1f: Trying with 'conancenter'...
Downloading conanmanifest.txt completed [0.17k]                                          
Downloading conanfile.py completed [3.58k]                                               
Downloading conan_export.tgz completed [0.25k]                                           
Decompressing conan_export.tgz completed [0.00k]                                         
ade/0.1.1f: Downloaded recipe revision 0

dyscalculia94 avatar Jul 23 '22 20:07 dyscalculia94

you need run " conan install -pr clang_debug . -if bin/ --update --build=missing" ,need add "--build=missing"

youngday avatar Jul 24 '22 02:07 youngday

Hi, Thanks for the help.

I did do that yesterday, and I had some further problems, so I thought that might not be the correct avenue to pursue.

I did it again today, and I have a different problem which I didn't have yesterday (can't remember exactly what was yesterday's problem). The problem I have now is while trying to build OpenColorIO/2.1.0:

CMake Error at source_subfolder/share/cmake/utils/CppVersion.cmake:19 (set_property):
  set_property could not find CACHE variable CMAKE_CXX_STANDARD.  Perhaps it
  has not yet been created.
Call Stack (most recent call first):
  source_subfolder/CMakeLists.txt:104 (include)

Not sure if this is something that we need to add a patch for in conan-center-index repo.

dyscalculia94 avatar Jul 24 '22 11:07 dyscalculia94

Hi @dyscalculia94 thanks for reporting this issue and for pasting the logs.

It would appear that your dependency graph is resolved and the recipe references are correctly found and retrieved from Conan Center, but that binary packages for some of them are not present for the particular configuration you are requesting (clang 10 on Linux x86_64 built with the Debug configuration). Conan Center does build a comprehensive number of configurations, however, it is always possible for user to request binary packages built with configurations not convered by Conan Center.

As @youngday kindly suggests - adding --build missing will cause Conan to build the missing packages from source.

As for conan search, it works in different modes:

  • conan search ade/0.1.1f for an incomplete reference name, it will find matching recipe reference names.
  • conan search ade/0.1.1f@ will look for the specific reference in the local cache - and report all binary packages present for that recipe, if any are available.
  • conan search ade/0.1.1f@ -r remotename will look for this information in the remote

We understand this can lead to confusion, so the syntax of these commands in improving in Conan 2.0.

As for the issue building opencolorio/2.1.0 from source, this is indeed an issue that requires investigation. I have opened an issue in Conan Center to track this: https://github.com/conan-io/conan-center-index/issues/11905

jcar87 avatar Jul 25 '22 09:07 jcar87

Closing as the linked issue in CCI has been closed, openimageio has been correctly building for a while now, and the rest of the issues brought up here have been addressed too

AbrilRBS avatar Apr 23 '24 14:04 AbrilRBS