ucx icon indicating copy to clipboard operation
ucx copied to clipboard

Proposal to add external ucx detection for spack

Open RichardYCJ opened this issue 3 years ago • 3 comments

Hi @hppritcha,

I'm wondering if it is possible to add spec detection for external ucx by spack.

Since sometimes the library is provided by hardware manufacturer with optimized configuration, say embedded in NVidia OFED/HPCX toolkit. And I'd prefer to reuse it to build my own MPI. But spack requires the detailed variants of ucx packages to build, some may not but whether it is +thread_multiple is important in case to build with multi-thread support.

Technically speaking, I think it is doable cuz ucx_info -b can provide most of the info about the variants.

Though I'm not a spack developer, here's a brief intro to add external detection support in case you need it. A global attribute executables should first be declared to search for (say "^ucx_info$") in the bash environment, and then an method called determine_variants should be implemented to check and return the variants.

A somewhat detailed tutorial can be find here and there're also good examples in the spack buildin packages like openmpi/package.py.

RichardYCJ avatar Sep 05 '22 02:09 RichardYCJ

yes this would be a good idea to add to ucx package.

hppritcha avatar Sep 06 '22 14:09 hppritcha

i'm assigning to myself but it will be on the lower end of my priority queue, so if someone else wants to take it that would be great.

hppritcha avatar Sep 06 '22 14:09 hppritcha

Good to here that, I might also give it a try. But since I'm neither a spack nor ucx developer. I might take some time to do so.

RichardYCJ avatar Sep 08 '22 07:09 RichardYCJ