cmssw icon indicating copy to clipboard operation
cmssw copied to clipboard

Add Kalos heterogenous CLUE library as an external to CMSSW

Open rovere opened this issue 1 year ago • 11 comments

Given a coming PR to CMSSW to enable the heterogeneous clustering using CLUE in HGCal CE-E detector at HLT for Phase2, see the evolving development branch here, I would like to add the Kalos library, that contains the Alpaka version of CLUE, as an external to CMSSW. It is a header-only library. The source code is available at this link.

@felicepantaleo @fwyzard @SohamBhattacharya @smuzaffar

rovere avatar May 24 '24 13:05 rovere

cms-bot internal usage

cmsbuild avatar May 24 '24 13:05 cmsbuild

A new Issue was created by @rovere.

@makortel, @sextonkennedy, @smuzaffar, @rappoccio, @antoniovilela, @Dr15Jones can you please review it and eventually sign/assign? Thanks.

cms-bot commands are listed here

cmsbuild avatar May 24 '24 13:05 cmsbuild

thanks @rovere .

the requirements listed in the repo readme are quite strict and obsolete:

The pre-requisite dependencies are >=gcc7, <=gcc8.3, Boost, TBB. Fork this repo if developers. If CUDA/nvcc are found on the machine, the compilation is performed automatically also for the GPU case. The path to the nvcc compiler will be automatically taken from the machine. In this case, >=cuda10 and <=nvcc11.2 are also required.

Did you check that you can build it and run with a recent CMSSW environment?

felicepantaleo avatar May 24 '24 13:05 felicepantaleo

thanks @rovere .

the requirements listed in the repo readme are quite strict and obsolete:

The pre-requisite dependencies are >=gcc7, <=gcc8.3, Boost, TBB. Fork this repo if developers. If CUDA/nvcc are found on the machine, the compilation is performed automatically also for the GPU case. The path to the nvcc compiler will be automatically taken from the machine. In this case, >=cuda10 and <=nvcc11.2 are also required.

Did you check that you can build it and run with a recent CMSSW environment?

@felicepantaleo everything is running fine in the latest CMSSW_14_1_X IB.

rovere avatar May 24 '24 13:05 rovere

>=gcc7, <=gcc8.3 ? For 14.0.X and above we only have >=GCC 12

smuzaffar avatar May 24 '24 13:05 smuzaffar

@smuzaffar those requirements, as @felicepantaleo said, are rather old and referring to slc7 ages. I tested the library in our more recent environment and it works fine. I will work on the requirements and update them to more recent standards, assuming the CI machinery at CERN allows me to do so.

rovere avatar May 24 '24 13:05 rovere

assign core,heterogeneous,hlt,reconstruction,upgrade

makortel avatar May 24 '24 13:05 makortel

New categories assigned: core,heterogeneous,hlt,reconstruction,upgrade

@Dr15Jones,@Martin-Grunewald,@mmusich,@fwyzard,@jfernan2,@makortel,@makortel,@mandrenguyen,@smuzaffar,@srimanob,@subirsarkar you have been requested to review this Pull request/Issue and eventually sign? Thanks

cmsbuild avatar May 24 '24 13:05 cmsbuild

I'd like to understand better the long-term plan. Is the external setup intended as a temporary or long-term solution? Does the Kalos library have any CMS-specifics, or is it fully generic?

(in a way this situation reminds me of the initial mkFit integration)

makortel avatar May 24 '24 14:05 makortel

Ciao @makortel, the plan would be to have a standalone library that CMS could use in CMSSW and other experiments elsewhere. The library has been "packaged and included" under the key4hep umbrella see here.

The final goal would be to have a unique external library that could be plugged into several places.

On a side note, extracting the "kernels" needed by CMSSW/HGCAL from Kalos would be a "relatively simple" exercise if that solution is preferred.

rovere avatar May 24 '24 14:05 rovere

Thanks @rovere, that answers to all my questions.

makortel avatar May 24 '24 20:05 makortel

clue was added to cmsdist/cmssw for the CMSSW 14.1.x release cycle.

fwyzard avatar Feb 19 '25 09:02 fwyzard

+heterogeneous

fwyzard avatar Feb 19 '25 09:02 fwyzard

@cmsbuild, please close

fwyzard avatar Feb 19 '25 09:02 fwyzard

+hlt

  • for the record

mmusich avatar Feb 19 '25 10:02 mmusich