cmssw icon indicating copy to clipboard operation
cmssw copied to clipboard

Integrating PyTorch in Alpaka heterogeneous core

Open lukaszmichalskii opened this issue 8 months ago • 35 comments

PR description:

This PR enables seamless integration between PyTorch and the Alpaka-based heterogeneous computing backend, supporting inference workflows with usage of pytorch library with PortableCollections objects. It provides:

  • Compatibility with Alpaka device/queue abstractions.
  • Support for automatic conversion of optimized SoA to torch tensors, with memory blobs reusage.
  • Support for both just-in-time (JIT) and ahead-of-time (AOT) model execution (Beta version for AOT).
  • Single-threading and CUDA stream management are handled by Guard objects specialized for each supported backend.

This implementation was presented and discussed at Core Software Meeting: https://indico.cern.ch/event/1538634/

PR validation:

Included demonstration code of interoperability between SoA constructs with PyTorch C++ API and CMSSW environment in plugins and test packages.

PyTorch Ahead-of-time compilation

This pull request also investigates AOT compilation strategy but is in beta version (proof of concept) not yet ready for production usage.

GPU support

CUDA backend is supported and tested, ROCm is not yet supported: cms-sw/cmsdist#9786

FYI @valsdav @ericcano @felicepantaleo @chrisizeh @leobeltra

lukaszmichalskii avatar Apr 30 '25 09:04 lukaszmichalskii

cms-bot internal usage<!-- bot cache: {"commits":{"0a7ec1459ed13c3442396569085c0c01d0e5fd9a":{"files":["PhysicsTools/PyTorch/test/BuildFile.xml"],"squashed":true,"time":1746615458},"0edf74606820388aae97d89ccd6cf0071112be95":{"files":["PhysicsTools/PyTorch/interface/AlpakaConfig.h","PhysicsTools/PyTorch/interface/Model.h","PhysicsTools/PyTorch/plugins/alpaka/AotRegressionProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/CombinatoricsProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/DataProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/JitClassificationProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/JitRegressionProducer.cc","PhysicsTools/PyTorch/python/modules.py","PhysicsTools/PyTorch/python/options.py","PhysicsTools/PyTorch/test/testPipeline.py"],"squashed":true,"time":1749030168},"185f42016f77f8856bed97a450da41e024220be8":{"files":["PhysicsTools/PyTorch/plugins/alpaka/DataProducer.cc","PhysicsTools/PyTorch/test/testModelCuda.cc","PhysicsTools/PyTorch/test/BuildFile.xml","PhysicsTools/PyTorch/plugins/alpaka/AotRegressionProducer.cc","PhysicsTools/PyTorch/test/testTorchFromBufferPinnedMemory.cu"],"squashed":true,"time":1749123945},"1a2b7685987b9cf90d3d225a76dfbf707103d076":{"files":["PhysicsTools/PyTorch/plugins/alpaka/DataProducer.cc","PhysicsTools/PyTorch/test/testModelCuda.cc","PhysicsTools/PyTorch/test/BuildFile.xml","PhysicsTools/PyTorch/plugins/alpaka/AotRegressionProducer.cc","PhysicsTools/PyTorch/test/testTorchFromBufferPinnedMemory.cu"],"squashed":true,"time":1749123950},"1ac47aa7e1d473bf4765e854876b782ca0d41d45":{"files":["PhysicsTools/PyTorch/models/aot_regression_model_cpu_el8_amd64_gcc12.pt2","PhysicsTools/PyTorch/models/aot_regression_model_cpu_el9_amd64_gcc12.pt2","PhysicsTools/PyTorch/models/aot_regression_model_cuda_el8_amd64_gcc12.pt2","PhysicsTools/PyTorch/models/aot_regression_model_cuda_el9_amd64_gcc12.pt2","PhysicsTools/PyTorch/plugins/alpaka/AotRegressionProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/CombinatoricsProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/DataProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/JitClassificationProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/JitRegressionProducer.cc","PhysicsTools/PyTorch/python/options.py","PhysicsTools/PyTorch/scripts/compile.sh","PhysicsTools/PyTorch/scripts/link.sh","PhysicsTools/PyTorch/test/testPipeline.py"],"squashed":true,"time":1749106918},"24084f841291b97a710570080d3714054228ca5e":{"files":["PhysicsTools/PyTorch/data/regression_cpu.pt2","PhysicsTools/PyTorch/models/jit_classification_model.pt","PhysicsTools/PyTorch/scripts/pytorch_aot_compile.sh","PhysicsTools/PyTorchAlpaka/interface/Environment.h","PhysicsTools/PyTorch/scripts/pytorch_aot_rename.sh","DataFormats/PyTorchTest/interface/Device.h","PhysicsTools/PyTorch/scripts/pytorch_aot_link.sh","PhysicsTools/PyTorchAlpakaTest/test/testPyTorchAlpakaHeterogeneousPipeline.py","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/MaskedNet.cc","DataFormats/PyTorchTest/interface/alpaka/Collections.h","PhysicsTools/PyTorch/models/aot_regression_model_cpu_el8_amd64_gcc12.pt2","PhysicsTools/PyTorch/test/alpaka/testModelAOT.cc","PhysicsTools/PyTorch/scripts/rename_aot.sh","PhysicsTools/PyTorchAlpaka/interface/alpaka/ROCmSerialSyncHandle.h","PhysicsTools/PyTorch/plugins/alpaka/Kernels.dev.cc","PhysicsTools/PyTorch/test/testJitLoad.cc","DataFormats/PortableTestObjects/src/alpaka/classes_cuda_def.xml","PhysicsTools/PyTorchAlpaka/test/testRunner.cc","PhysicsTools/PyTorch/plugins/alpaka/DataProducer.cc","PhysicsTools/PyTorch/test/testModelJit.cc","PhysicsTools/PyTorchAlpakaTest/interface/MaskHost.h","PhysicsTools/PyTorch/plugins/PyTorchService.cc","PhysicsTools/PyTorch/test/testTensorStride.cu","PhysicsTools/PyTorchAlpakaTest/test/BuildFile.xml","PhysicsTools/PyTorch/models/aot_regression_model_cuda_el8_amd64_gcc12.pt2","PhysicsTools/PyTorchAlpakaTest/BuildFile.xml","PhysicsTools/PyTorch/plugins/alpaka/JitRegressionProducer.cc","PhysicsTools/PyTorch/models/jit_multi_branch_model.pt","PhysicsTools/PyTorch/test/testPipeline.sh","PhysicsTools/PyTorch/test/testModelCuda.cc","PhysicsTools/PyTorchAlpakaTest/python/SimpleNet.py","DataFormats/PyTorchTest/src/alpaka/classes_rocm.h","PhysicsTools/PyTorch/scripts/pytorch_aot_auto_compilation.sh","PhysicsTools/PyTorch/test/testBase.h","DataFormats/PortableTestObjects/interface/TestHostCollection.h","PhysicsTools/PyTorch/interface/ScriptModuleLoad.h","DataFormats/PyTorchTest/BuildFile.xml","DataFormats/PyTorchTest/interface/Host.h","PhysicsTools/PyTorch/test/alpaka/testSOAtoTorch.dev.cc","DataFormats/PyTorchTest/src/classes.cc","PhysicsTools/PyTorch/plugins/BuildFile.xml","PhysicsTools/PyTorch/test/testTorchFromBlobStride.cu","PhysicsTools/PyTorch/models/aot_classification_model_cpu_el8_amd64_gcc12.pt2","PhysicsTools/PyTorch/interface/Nvtx.h","PhysicsTools/PyTorch/test/alpaka/testTorchExecutionControlGuard.cc","PhysicsTools/PyTorch/plugins/alpaka/AotClassificationProducer.cc","PhysicsTools/PyTorch/scripts/pytorch_aot_link_cuda.sh","PhysicsTools/PyTorch/BuildFile.xml","PhysicsTools/PyTorch/scripts/link.sh","DataFormats/PortableTestObjects/interface/alpaka/TestDeviceCollection.h","DataFormats/PortableTestObjects/interface/TestSoA.h","PhysicsTools/PyTorch/test/testUtilities.h","PhysicsTools/PyTorchAlpakaTest/interface/MaskSoA.h","DataFormats/PyTorchTest/src/classes.h","PhysicsTools/PyTorch/test/testExportLinearDnn.py","DataFormats/PortableTestObjects/src/classes_def.xml","PhysicsTools/PyTorchAlpakaTest/plugins/InspectionSink.cc","PhysicsTools/PyTorch/interface/ModelAOT.h","PhysicsTools/PyTorchAlpakaTest/interface/alpaka/MaskDevice.h","PhysicsTools/PyTorch/test/testTorchlibModelsCpu.cc","DataFormats/PyTorchTest/src/classes_def.xml","PhysicsTools/PyTorch/models/jit_regression_model.pt","PhysicsTools/PyTorchAlpaka/interface/NvtxRAII.h","DataFormats/PyTorchTest/src/alpaka/classes_rocm_def.xml","PhysicsTools/PyTorch/python/options.py","PhysicsTools/PyTorch/test/testTorchTensorStride.cu","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/SimpleNet.cc","PhysicsTools/PyTorchAlpaka/test/alpaka/testSoAToTorch.dev.cc","DataFormats/PortableTestObjects/src/classes.cc","PhysicsTools/PyTorchAlpaka/test/alpaka/testAlpakaModel.cc","PhysicsTools/PyTorchAlpaka/interface/Converter.h","PhysicsTools/PyTorch/test/testTorchFromBufferPinnedMemory.cu","PhysicsTools/PyTorch/interface/Model.h","PhysicsTools/PyTorchAlpaka/interface/SoAMetadata.h","PhysicsTools/PyTorchAlpaka/interface/alpaka/AlpakaModel.h","PhysicsTools/PyTorchAlpaka/interface/QueueGuard.h","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/TinyResNet.cc","PhysicsTools/PyTorchAlpaka/test/alpaka/testSoADataTypes.dev.cc","PhysicsTools/PyTorch/plugins/alpaka/CombinatoricsProducer.cc","PhysicsTools/PyTorch/test/testTorchlibModels.h","PhysicsTools/PyTorchAlpakaTest/plugins/BuildFile.xml","PhysicsTools/PyTorch/test/alpaka/testPortableInferenceJIT.cc","DataFormats/PyTorchTest/interface/Layout.h","PhysicsTools/PyTorch/models/aot_classification_model_cuda_el8_amd64_gcc12.pt2","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/MultiHeadNet.cc","PhysicsTools/PyTorch/python/modules.py","DataFormats/PyTorchTest/src/alpaka/classes_cuda_def.xml","PhysicsTools/PyTorch/test/testPipelineStandalone.sh","PhysicsTools/PyTorch/scripts/pytorch_aot_compile_cuda.sh","DataFormats/PyTorchTest/src/alpaka/classes_cuda.h","PhysicsTools/PyTorch/plugins/alpaka/JitClassificationProducer.cc","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/DataSource.cc","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/CommonKernels.dev.cc","PhysicsTools/PyTorch/test/BuildFile.xml","PhysicsTools/PyTorch/test/testPipeline.py","PhysicsTools/PyTorch/test/testRunner.cc","PhysicsTools/PyTorch/interface/Converter.h","PhysicsTools/PyTorch/scripts/compile.sh","PhysicsTools/PyTorch/test/testTorchlibModelsCuda.cc","PhysicsTools/PyTorch/test/alpaka/testModelJIT.cc","PhysicsTools/PyTorchAlpakaTest/python/options_cff.py","PhysicsTools/PyTorch/test/alpaka/testModelAlpakaNamespace.cc","PhysicsTools/PyTorch/test/Nvtx.h","PhysicsTools/PyTorch/plugins/alpaka/Kernels.h","PhysicsTools/PyTorchAlpaka/README.md","PhysicsTools/PyTorch/test/alpaka/testPortableInferenceAOT.dev.cc","PhysicsTools/PyTorch/interface/AlpakaConfig.h","PhysicsTools/PyTorch/README.md","PhysicsTools/PyTorch/scripts/aot.sh","PhysicsTools/PyTorch/test/testModelAot.cc","PhysicsTools/PyTorch/test/create_linear_dnn.py","PhysicsTools/PyTorch/plugins/alpaka/AotRegressionProducer.cc","PhysicsTools/PyTorch/test/alpaka/testTorchDeviceMatchAlpaka.cc","PhysicsTools/PyTorchAlpakaTest/python/MultiHeadNet.py","PhysicsTools/PyTorch/test/testTorchBase.h","PhysicsTools/PyTorch/scripts/link_cuda.sh","PhysicsTools/PyTorch/test/testModelCpu.cc","PhysicsTools/PyTorch/test/alpaka/testSOADataTypes.dev.cc","PhysicsTools/PyTorchAlpakaTest/python/TinyResNet.py","PhysicsTools/PyTorchAlpakaTest/python/MaskedNet.py","PhysicsTools/PyTorchAlpaka/interface/alpaka/Config.h","PhysicsTools/PyTorchAlpaka/BuildFile.xml","PhysicsTools/PyTorch/scripts/compile_cuda.sh","PhysicsTools/PyTorch/interface/SoAMetadata.h","PhysicsTools/PyTorch/interface/TorchCompat.h","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/CommonKernels.h","PhysicsTools/PyTorch/data/regression_cuda.pt2","PhysicsTools/PyTorch/interface/Config.h","DataFormats/PortableTestObjects/src/alpaka/classes_rocm_def.xml","PhysicsTools/PyTorchAlpakaTest/README.md","PhysicsTools/PyTorchAlpaka/test/BuildFile.xml"],"squashed":true,"time":1759468274},"24513c45f019f16cf5cd751fd9050499b04a9684":{"files":["PhysicsTools/PyTorch/plugins/alpaka/AotRegressionProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/CombinatoricsProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/DataProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/JitClassificationProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/JitRegressionProducer.cc","PhysicsTools/PyTorch/test/BuildFile.xml","PhysicsTools/PyTorch/test/alpaka/testPortableInferenceAOT.dev.cc","PhysicsTools/PyTorch/test/alpaka/testPortableInferenceJIT.cc","PhysicsTools/PyTorch/test/alpaka/testTorchExecutionControlGuard.cc","PhysicsTools/PyTorch/test/testPipeline.py"],"squashed":true,"time":1749031059},"3ba3ba4a3e6c0a9812de91bad540fd55260cd48a":{"files":["DataFormats/PyTorch/BuildFile.xml","DataFormats/PyTorch/interface/Device.h","DataFormats/PyTorch/interface/Host.h","DataFormats/PyTorch/interface/Layout.h","DataFormats/PyTorch/interface/alpaka/Collections.h","DataFormats/PyTorch/src/alpaka/classes_cuda.h","DataFormats/PyTorch/src/alpaka/classes_cuda_def.xml","DataFormats/PyTorch/src/alpaka/classes_rocm.h","DataFormats/PyTorch/src/alpaka/classes_rocm_def.xml","DataFormats/PyTorch/src/classes.cc","DataFormats/PyTorch/src/classes.h","DataFormats/PyTorch/src/classes_def.xml","PhysicsTools/PyTorch/BuildFile.xml","PhysicsTools/PyTorch/README.md","PhysicsTools/PyTorch/interface/AlpakaConfig.h","PhysicsTools/PyTorch/interface/Config.h","PhysicsTools/PyTorch/interface/Converter.h","PhysicsTools/PyTorch/interface/Model.h","PhysicsTools/PyTorch/interface/Nvtx.h","PhysicsTools/PyTorch/interface/SoAMetadata.h","PhysicsTools/PyTorch/models/aot_regression_model_cpu_el9_amd64_gcc12.pt2","PhysicsTools/PyTorch/models/aot_regression_model_cuda_el9_amd64_gcc12.pt2","PhysicsTools/PyTorch/models/jit_classification_model.pt","PhysicsTools/PyTorch/models/jit_multi_branch_model.pt","PhysicsTools/PyTorch/models/jit_regression_model.pt","PhysicsTools/PyTorch/plugins/BuildFile.xml","PhysicsTools/PyTorch/plugins/alpaka/AotRegressionProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/CombinatoricsProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/DataProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/JitClassificationProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/Kernels.dev.cc","PhysicsTools/PyTorch/plugins/alpaka/Kernels.h","PhysicsTools/PyTorch/python/aot_inductor_export.py","PhysicsTools/PyTorch/python/modules.py","PhysicsTools/PyTorch/python/options.py","PhysicsTools/PyTorch/scripts/compile.sh","PhysicsTools/PyTorch/scripts/compile_cuda.sh","PhysicsTools/PyTorch/scripts/link.sh","PhysicsTools/PyTorch/scripts/link_cuda.sh","PhysicsTools/PyTorch/scripts/rename_aot.sh","PhysicsTools/PyTorch/test/BuildFile.xml","PhysicsTools/PyTorch/test/alpaka/testModelAOT.cc","PhysicsTools/PyTorch/test/alpaka/testModelAlpakaNamespace.cc","PhysicsTools/PyTorch/test/alpaka/testModelJIT.cc","PhysicsTools/PyTorch/test/alpaka/testPortableInferenceAOT.dev.cc","PhysicsTools/PyTorch/test/alpaka/testPortableInferenceJIT.cc","PhysicsTools/PyTorch/test/alpaka/testSOADataTypes.dev.cc","PhysicsTools/PyTorch/test/alpaka/testSOAtoTorch.dev.cc","PhysicsTools/PyTorch/test/alpaka/testTorchDeviceMatchAlpaka.cc","PhysicsTools/PyTorch/test/alpaka/testTorchExecutionControlGuard.cc","PhysicsTools/PyTorch/test/create_linear_dnn.py","PhysicsTools/PyTorch/test/create_simple_dnn.py","PhysicsTools/PyTorch/test/testBase.h","PhysicsTools/PyTorch/test/testBaseCUDA.h","PhysicsTools/PyTorch/test/testModel.cc","PhysicsTools/PyTorch/test/testPipeline.py","PhysicsTools/PyTorch/test/testPipeline.sh","PhysicsTools/PyTorch/test/testTensorStride.cu","PhysicsTools/PyTorch/test/testTorch.cc","PhysicsTools/PyTorch/test/testTorchFromBlobStride.cu","PhysicsTools/PyTorch/test/testTorchFromBufferPinnedMemory.cu","PhysicsTools/PyTorch/test/testTorchSimpleDnn.cc","PhysicsTools/PyTorch/test/testTorchSimpleDnnCUDA.cc","PhysicsTools/PyTorch/test/testUtilities.h","PhysicsTools/PyTorch/test/time_serie_prediction.cpp"],"squashed":true,"time":1745479264},"3e87013b51f1829bce1dad0ce6145e10d73c9610":{"files":["DataFormats/PyTorch/src/alpaka/classes_cuda.h","DataFormats/PyTorch/src/alpaka/classes_rocm.h","DataFormats/PyTorch/src/classes.h","DataFormats/PyTorchTest/BuildFile.xml","DataFormats/PyTorchTest/interface/Device.h","DataFormats/PyTorchTest/interface/Host.h","DataFormats/PyTorchTest/interface/Layout.h","DataFormats/PyTorchTest/interface/alpaka/Collections.h","DataFormats/PyTorchTest/src/alpaka/classes_cuda.h","DataFormats/PyTorchTest/src/alpaka/classes_cuda_def.xml","DataFormats/PyTorchTest/src/alpaka/classes_rocm.h","DataFormats/PyTorchTest/src/alpaka/classes_rocm_def.xml","DataFormats/PyTorchTest/src/classes.cc","DataFormats/PyTorchTest/src/classes.h","DataFormats/PyTorchTest/src/classes_def.xml","PhysicsTools/PyTorch/README.md","PhysicsTools/PyTorch/plugins/BuildFile.xml","PhysicsTools/PyTorch/plugins/alpaka/AotRegressionProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/CombinatoricsProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/DataProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/JitClassificationProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/Kernels.h","PhysicsTools/PyTorch/test/BuildFile.xml","PhysicsTools/PyTorch/test/testPipelineStandalone.sh"],"squashed":true,"time":1745913093},"46072a6486081a8beec18ce8776c4d29982403ac":{"files":["PhysicsTools/PyTorch/README.md","PhysicsTools/PyTorch/interface/Converter.h","PhysicsTools/PyTorch/interface/SoAWrapper.h","PhysicsTools/PyTorch/plugins/alpaka/AotRegressionProducer.cc","PhysicsTools/PyTorch/plugins/alpaka/JitClassificationProducer.cc","PhysicsTools/PyTorch/test/BuildFile.xml","PhysicsTools/PyTorch/test/alpaka/testPortableInferenceAOT.dev.cc","PhysicsTools/PyTorch/test/alpaka/testPortableInferenceJIT.cc","PhysicsTools/PyTorch/test/alpaka/testSOADataTypes.dev.cc","PhysicsTools/PyTorch/test/alpaka/testSOAtoTorch.dev.cc","PhysicsTools/PyTorch/test/alpaka/testTorchExecutionControlGuard.cc"],"squashed":true,"time":1745993058},"4688d61f6b927073b5f0aac8a56785445df966e6":{"files":[],"squashed":true,"time":1759468274},"46f009e18a18f0e85aa1fe91ad4dee8059d28656":{"files":["PhysicsTools/PyTorch/data/regression_cpu.pt2","PhysicsTools/PyTorch/data/regression_cuda.pt2"],"squashed":true,"time":1759487769},"56a2dd8af9275861b40ad6d89288e2622a20bcd8":{"files":[],"squashed":false,"time":1762177227},"61f7f887b822b4ac6f8457b5133480e5d16cc744":{"files":[],"squashed":true,"time":1759487769},"6dee00f77e94c4bc5f80cb7887a324ad4d776dee":{"files":["PhysicsTools/PyTorch/scripts/compile.sh","PhysicsTools/PyTorch/scripts/compile_cuda.sh","PhysicsTools/PyTorch/scripts/link.sh","PhysicsTools/PyTorch/scripts/link_cuda.sh"],"squashed":true,"time":1749041713},"7643547050e6e8fa6a018d3dfc3e1398046811b7":{"files":["PhysicsTools/PyTorch/plugins/alpaka/DataProducer.cc","PhysicsTools/PyTorch/test/testModelCuda.cc","PhysicsTools/PyTorch/test/BuildFile.xml","PhysicsTools/PyTorch/plugins/alpaka/AotRegressionProducer.cc","PhysicsTools/PyTorch/test/testTorchFromBufferPinnedMemory.cu"],"squashed":true,"time":1749123946},"78aa2ebad7d6bb8c39bd29a5f218c942c7b16eba":{"files":["PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/TinyResNet.cc","PhysicsTools/PyTorchAlpaka/interface/GetDevice.h","PhysicsTools/PyTorchAlpaka/interface/alpaka/AlpakaModel.h","PhysicsTools/PyTorch/BuildFile.xml","DataFormats/PortableTestObjects/interface/TestSoA.h","PhysicsTools/PyTorchAlpakaTest/test/runPyTorchAlpakaTest.py","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/MaskedNet.cc","PhysicsTools/PyTorch/test/BuildFile.xml","PhysicsTools/PyTorchAlpaka/BuildFile.xml","DataFormats/PortableTestObjects/src/classes.cc","PhysicsTools/PyTorchAlpaka/interface/TensorHandle.h","PhysicsTools/PyTorch/test/testModelJit.cc","PhysicsTools/PyTorchAlpakaTest/test/BuildFile.xml","PhysicsTools/PyTorchAlpaka/interface/QueueGuard.h","PhysicsTools/PyTorch/interface/TorchInterface.h","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/CommonKernels.dev.cc","DataFormats/PortableTestObjects/src/alpaka/classes_rocm.h","DataFormats/PortableTestObjects/src/alpaka/classes_cuda.h","PhysicsTools/PyTorch/test/testTorchlibModelsCpu.cc","PhysicsTools/PyTorch/plugins/PyTorchService.cc","PhysicsTools/PyTorch/test/testJitLoad.cc","PhysicsTools/PyTorchAlpakaTest/test/TinyResNet.py","DataFormats/PortableTestObjects/interface/TorchTestHostCollection.h","DataFormats/PortableTestObjects/interface/alpaka/TorchTestDeviceCollection.h","PhysicsTools/PyTorchAlpakaTest/plugins/InspectionSink.cc","PhysicsTools/PyTorchAlpakaTest/python/MultiHeadNet.py","PhysicsTools/PyTorchAlpakaTest/interface/alpaka/MaskDevice.h","PhysicsTools/PyTorchAlpaka/interface/TensorRegistry.h","PhysicsTools/PyTorch/interface/TorchCompat.h","DataFormats/PortableTestObjects/src/classes.h","PhysicsTools/PyTorchAlpakaTest/python/MaskedNet.py","DataFormats/PortableTestObjects/interface/TorchTestSoA.h","PhysicsTools/PyTorchAlpaka/test/testRunner.cc","PhysicsTools/PyTorchAlpaka/interface/Converter.h","DataFormats/PortableTestObjects/interface/alpaka/TestDeviceCollection.h","PhysicsTools/PyTorchAlpakaTest/python/options_cff.py","PhysicsTools/PyTorchAlpaka/test/alpaka/testSoADataTypes.dev.cc","PhysicsTools/PyTorchAlpaka/interface/SoAConversion.h","PhysicsTools/PyTorch/README.md","PhysicsTools/PyTorchAlpaka/interface/NvtxRAII.h","PhysicsTools/PyTorch/interface/ScriptModuleLoad.h","PhysicsTools/PyTorch/scripts/pytorch_aot_auto_compilation.sh","PhysicsTools/PyTorchAlpakaTest/python/SimpleNet.py","DataFormats/PortableTestObjects/interface/TestHostCollection.h","PhysicsTools/PyTorchAlpakaTest/BuildFile.xml","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/DataSource.cc","PhysicsTools/PyTorchAlpakaTest/test/MultiHeadNet.py","PhysicsTools/PyTorchAlpaka/README.md","PhysicsTools/PyTorchAlpaka/interface/alpaka/Config.h","PhysicsTools/PyTorchAlpakaTest/test/SimpleNet.py","PhysicsTools/PyTorch/test/testExportLinearDnn.py","PhysicsTools/PyTorch/test/Nvtx.h","PhysicsTools/PyTorch/interface/ModelAOT.h","PhysicsTools/PyTorchAlpakaTest/python/TinyResNet.py","PhysicsTools/PyTorch/interface/Model.h","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/CommonKernels.h","PhysicsTools/PyTorch/src/ScriptedModuleLoad.cc","PhysicsTools/PyTorch/test/testModelAot.cc","PhysicsTools/PyTorchAlpaka/interface/alpaka/ROCmSerialSyncHandle.h","PhysicsTools/PyTorchAlpakaTest/plugins/BuildFile.xml","PhysicsTools/PyTorchAlpaka/interface/Policy.h","PhysicsTools/PyTorchAlpakaTest/plugins/Environment.h","PhysicsTools/PyTorchAlpaka/test/alpaka/testAlpakaModel.cc","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/SimpleNet.cc","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/MultiHeadNet.cc","PhysicsTools/PyTorchAlpakaTest/interface/MaskSoA.h","PhysicsTools/PyTorchAlpaka/test/BuildFile.xml","PhysicsTools/PyTorch/test/testTorchlibModelsCuda.cc","PhysicsTools/PyTorch/scripts/aot_inductor_export.py","PhysicsTools/PyTorch/test/testRunner.cc","PhysicsTools/PyTorchAlpakaTest/test/MaskedNet.py","PhysicsTools/PyTorch/test/testTorchBase.h","PhysicsTools/PyTorchAlpakaTest/test/testPyTorchAlpakaHeterogeneousPipeline.py","PhysicsTools/PyTorch/test/testUtilities.h","PhysicsTools/PyTorch/python/aot_inductor_export.py","PhysicsTools/PyTorch/test/testTorchTensorStride.cu","PhysicsTools/PyTorch/plugins/BuildFile.xml","PhysicsTools/PyTorchAlpakaTest/interface/MaskHost.h","PhysicsTools/PyTorchAlpaka/test/alpaka/testSoAToTorch.dev.cc","PhysicsTools/PyTorchAlpaka/interface/Environment.h","PhysicsTools/PyTorch/test/testTorchlibModels.h","PhysicsTools/PyTorchAlpaka/interface/SoAMetadata.h"],"squashed":true,"time":1760166142},"897fe53e1a98371942dbf1816c68f66e09dae90b":{"files":["PhysicsTools/PyTorchAlpakaTest/interface/alpaka/MaskDevice.h","PhysicsTools/PyTorch/test/testTorchFromBufferPinnedMemory.cu","PhysicsTools/PyTorchAlpaka/test/alpaka/testSoADataTypes.dev.cc","DataFormats/PortableTestObjects/src/classes.h","DataFormats/PortableTestObjects/interface/alpaka/LogitsDeviceCollection.h","PhysicsTools/PyTorchAlpaka/README.md","PhysicsTools/PyTorchAlpaka/interface/SoAConversion.h","DataFormats/PortableTestObjects/interface/alpaka/MaskDeviceCollection.h","PhysicsTools/PyTorch/interface/TorchInterface.h","DataFormats/PortableTestObjects/src/alpaka/classes_rocm_def.xml","PhysicsTools/PyTorch/scripts/pytorch_aot_compile_cuda.sh","DataFormats/PortableTestObjects/src/classes.cc","PhysicsTools/PyTorch/scripts/pytorch_aot_rename.sh","PhysicsTools/PyTorch/examples/pytorch_aot_auto_compilation.sh","PhysicsTools/PyTorch/examples/pytorch_aot_rename.sh","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/CommonKernels.dev.cc","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/TinyResNet.cc","PhysicsTools/PyTorch/examples/pytorch_aot_link_cuda.sh","PhysicsTools/PyTorch/README.md","DataFormats/PortableTestObjects/interface/ParticleSoA.h","DataFormats/PortableTestObjects/interface/ImageHostCollection.h","DataFormats/PortableTestObjects/interface/alpaka/MultiHeadNetDeviceCollection.h","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/CommonKernels.h","DataFormats/PortableTestObjects/interface/MaskHostCollection.h","PhysicsTools/PyTorch/examples/pytorch_aot_compile.sh","DataFormats/PortableTestObjects/src/alpaka/classes_rocm.h","DataFormats/PortableTestObjects/interface/alpaka/ImageDeviceCollection.h","PhysicsTools/PyTorch/scripts/pytorch_aot_auto_compilation.sh","PhysicsTools/PyTorch/scripts/pytorch_aot_link.sh","DataFormats/PortableTestObjects/interface/MultiHeadNetSoA.h","DataFormats/PortableTestObjects/interface/alpaka/TorchTestDeviceCollection.h","DataFormats/PortableTestObjects/interface/MaskSoA.h","PhysicsTools/PyTorch/examples/pytorch_aot_inductor_export.py","PhysicsTools/PyTorchAlpaka/interface/alpaka/AlpakaModel.h","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/MultiHeadNet.cc","PhysicsTools/PyTorchAlpakaTest/plugins/InspectionSink.cc","PhysicsTools/PyTorchAlpakaTest/interface/MaskHost.h","DataFormats/PortableTestObjects/interface/SimpleNetHostCollection.h","DataFormats/PortableTestObjects/interface/SimpleNetSoA.h","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/DataSource.cc","PhysicsTools/PyTorch/scripts/pytorch_aot_link_cuda.sh","PhysicsTools/PyTorch/scripts/pytorch_aot_compile.sh","PhysicsTools/PyTorchAlpaka/test/alpaka/testSoAToTorch.dev.cc","DataFormats/PortableTestObjects/interface/alpaka/ParticleDeviceCollection.h","DataFormats/PortableTestObjects/interface/TorchTestSoA.h","DataFormats/PortableTestObjects/src/alpaka/classes_cuda.h","PhysicsTools/PyTorchAlpaka/interface/TensorHandle.h","PhysicsTools/PyTorch/examples/pytorch_aot_link.sh","PhysicsTools/PyTorchAlpaka/interface/GetDevice.h","PhysicsTools/PyTorchAlpaka/interface/Policy.h","PhysicsTools/PyTorch/scripts/aot_inductor_export.py","PhysicsTools/PyTorchAlpaka/test/BuildFile.xml","DataFormats/PortableTestObjects/interface/LogitsSoA.h","DataFormats/PortableTestObjects/interface/TorchTestHostCollection.h","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/SimpleNet.cc","DataFormats/PortableTestObjects/interface/ParticleHostCollection.h","DataFormats/PortableTestObjects/src/classes_def.xml","PhysicsTools/PyTorch/examples/pytorch_aot_compile_cuda.sh","DataFormats/PortableTestObjects/interface/MultiHeadNetHostCollection.h","DataFormats/PortableTestObjects/src/alpaka/classes_cuda_def.xml","DataFormats/PortableTestObjects/interface/LogitsHostCollection.h","DataFormats/PortableTestObjects/interface/alpaka/SimpleNetDeviceCollection.h","PhysicsTools/PyTorchAlpaka/interface/TensorRegistry.h","DataFormats/PortableTestObjects/interface/ImageSoA.h","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/MaskedNet.cc","PhysicsTools/PyTorchAlpakaTest/interface/MaskSoA.h","PhysicsTools/PyTorch/test/BuildFile.xml"],"squashed":true,"time":1762175947},"96e7fcba8697fe5c1efa3c9b789e60175b4cc561":{"files":["PhysicsTools/PyTorchAlpaka/test/alpaka/testSoADataTypes.dev.cc","PhysicsTools/PyTorchAlpaka/interface/Policy.h","PhysicsTools/PyTorch/test/testTorchFromBufferPinnedMemory.cu","PhysicsTools/PyTorchAlpaka/interface/GetDevice.h","PhysicsTools/PyTorchAlpaka/test/alpaka/testSoAToTorch.dev.cc","DataFormats/PortableTestObjects/interface/alpaka/LogitsDeviceCollection.h","PhysicsTools/PyTorchAlpaka/interface/TensorHandle.h","DataFormats/PortableTestObjects/interface/alpaka/ParticleDeviceCollection.h","PhysicsTools/PyTorchAlpaka/interface/TensorRegistry.h","PhysicsTools/PyTorchAlpaka/interface/SoAConversion.h","DataFormats/PortableTestObjects/interface/alpaka/SimpleNetDeviceCollection.h"],"squashed":true,"time":1762177227},"9b7b13e71627c7a03bdf948b139e39ea43f798c9":{"files":["PhysicsTools/PyTorch/plugins/alpaka/DataProducer.cc","PhysicsTools/PyTorch/test/testModelCuda.cc","PhysicsTools/PyTorch/test/BuildFile.xml","PhysicsTools/PyTorch/plugins/alpaka/AotRegressionProducer.cc","PhysicsTools/PyTorch/test/testTorchFromBufferPinnedMemory.cu"],"squashed":true,"time":1749123953},"a175708c52b57f0d80802ce05813bdbdd81c6a52":{"files":["PhysicsTools/PyTorch/interface/Model.h","PhysicsTools/PyTorch/interface/SoAMetadata.h","PhysicsTools/PyTorch/test/alpaka/testModelAlpakaNamespace.cc","PhysicsTools/PyTorch/test/testModel.cc"],"squashed":true,"time":1746622425},"a4211a07e56eabeb7aaaa570d28cf2973346872a":{"files":["PhysicsTools/PyTorch/plugins/alpaka/DataProducer.cc","PhysicsTools/PyTorch/test/testModelCuda.cc","PhysicsTools/PyTorch/test/BuildFile.xml","PhysicsTools/PyTorch/plugins/alpaka/AotRegressionProducer.cc","PhysicsTools/PyTorch/test/testTorchFromBufferPinnedMemory.cu"],"squashed":true,"time":1749123948},"a587c05ec9252501b105139cb8c405ce53395811":{"files":["DataFormats/PyTorchTest/interface/Device.h"],"squashed":true,"time":1745921570},"b81a950db160fc1c86508137be5615a427395bd2":{"files":["PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/TinyResNet.cc","PhysicsTools/PyTorchAlpaka/interface/GetDevice.h","PhysicsTools/PyTorchAlpaka/interface/alpaka/AlpakaModel.h","PhysicsTools/PyTorch/BuildFile.xml","DataFormats/PortableTestObjects/interface/TestSoA.h","PhysicsTools/PyTorchAlpakaTest/test/runPyTorchAlpakaTest.py","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/MaskedNet.cc","PhysicsTools/PyTorch/test/BuildFile.xml","PhysicsTools/PyTorchAlpaka/BuildFile.xml","DataFormats/PortableTestObjects/src/classes.cc","PhysicsTools/PyTorchAlpaka/interface/TensorHandle.h","PhysicsTools/PyTorch/test/testModelJit.cc","PhysicsTools/PyTorchAlpakaTest/test/BuildFile.xml","PhysicsTools/PyTorchAlpaka/interface/QueueGuard.h","PhysicsTools/PyTorch/interface/TorchInterface.h","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/CommonKernels.dev.cc","DataFormats/PortableTestObjects/src/alpaka/classes_rocm.h","DataFormats/PortableTestObjects/src/alpaka/classes_cuda.h","PhysicsTools/PyTorch/test/testTorchlibModelsCpu.cc","PhysicsTools/PyTorch/plugins/PyTorchService.cc","PhysicsTools/PyTorch/test/testJitLoad.cc","PhysicsTools/PyTorchAlpakaTest/test/TinyResNet.py","DataFormats/PortableTestObjects/interface/TorchTestHostCollection.h","DataFormats/PortableTestObjects/interface/alpaka/TorchTestDeviceCollection.h","PhysicsTools/PyTorchAlpakaTest/plugins/InspectionSink.cc","PhysicsTools/PyTorchAlpakaTest/python/MultiHeadNet.py","PhysicsTools/PyTorchAlpakaTest/interface/alpaka/MaskDevice.h","PhysicsTools/PyTorchAlpaka/interface/TensorRegistry.h","PhysicsTools/PyTorch/interface/TorchCompat.h","DataFormats/PortableTestObjects/src/classes.h","PhysicsTools/PyTorchAlpakaTest/python/MaskedNet.py","DataFormats/PortableTestObjects/interface/TorchTestSoA.h","PhysicsTools/PyTorchAlpaka/test/testRunner.cc","PhysicsTools/PyTorchAlpaka/interface/Converter.h","DataFormats/PortableTestObjects/interface/alpaka/TestDeviceCollection.h","PhysicsTools/PyTorchAlpakaTest/python/options_cff.py","PhysicsTools/PyTorchAlpaka/test/alpaka/testSoADataTypes.dev.cc","PhysicsTools/PyTorchAlpaka/interface/SoAConversion.h","PhysicsTools/PyTorch/README.md","PhysicsTools/PyTorchAlpaka/interface/NvtxRAII.h","PhysicsTools/PyTorch/interface/ScriptModuleLoad.h","PhysicsTools/PyTorch/scripts/pytorch_aot_auto_compilation.sh","PhysicsTools/PyTorchAlpakaTest/python/SimpleNet.py","DataFormats/PortableTestObjects/interface/TestHostCollection.h","PhysicsTools/PyTorchAlpakaTest/BuildFile.xml","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/DataSource.cc","PhysicsTools/PyTorchAlpakaTest/test/MultiHeadNet.py","PhysicsTools/PyTorchAlpaka/README.md","PhysicsTools/PyTorchAlpaka/interface/alpaka/Config.h","PhysicsTools/PyTorchAlpakaTest/test/SimpleNet.py","PhysicsTools/PyTorch/test/testExportLinearDnn.py","PhysicsTools/PyTorch/test/Nvtx.h","PhysicsTools/PyTorch/interface/ModelAOT.h","PhysicsTools/PyTorchAlpakaTest/python/TinyResNet.py","PhysicsTools/PyTorch/interface/Model.h","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/CommonKernels.h","PhysicsTools/PyTorch/src/ScriptedModuleLoad.cc","PhysicsTools/PyTorch/test/testModelAot.cc","PhysicsTools/PyTorchAlpaka/interface/alpaka/ROCmSerialSyncHandle.h","PhysicsTools/PyTorchAlpakaTest/plugins/BuildFile.xml","PhysicsTools/PyTorchAlpaka/interface/Policy.h","PhysicsTools/PyTorchAlpakaTest/plugins/Environment.h","PhysicsTools/PyTorchAlpaka/test/alpaka/testAlpakaModel.cc","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/SimpleNet.cc","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/MultiHeadNet.cc","PhysicsTools/PyTorchAlpakaTest/interface/MaskSoA.h","PhysicsTools/PyTorchAlpaka/test/BuildFile.xml","PhysicsTools/PyTorch/test/testTorchlibModelsCuda.cc","PhysicsTools/PyTorch/scripts/aot_inductor_export.py","PhysicsTools/PyTorch/test/testRunner.cc","PhysicsTools/PyTorchAlpakaTest/test/MaskedNet.py","PhysicsTools/PyTorch/test/testTorchBase.h","PhysicsTools/PyTorchAlpakaTest/test/testPyTorchAlpakaHeterogeneousPipeline.py","PhysicsTools/PyTorch/test/testUtilities.h","PhysicsTools/PyTorch/python/aot_inductor_export.py","PhysicsTools/PyTorch/test/testTorchTensorStride.cu","PhysicsTools/PyTorch/plugins/BuildFile.xml","PhysicsTools/PyTorchAlpakaTest/interface/MaskHost.h","PhysicsTools/PyTorchAlpaka/test/alpaka/testSoAToTorch.dev.cc","PhysicsTools/PyTorchAlpaka/interface/Environment.h","PhysicsTools/PyTorch/test/testTorchlibModels.h","PhysicsTools/PyTorchAlpaka/interface/SoAMetadata.h"],"squashed":true,"time":1760516007},"c01d07f67496598ae4d95d8c71898b2dfd226a49":{"files":["PhysicsTools/PyTorch/scripts/rename_aot.sh","PhysicsTools/PyTorch/test/alpaka/testModelAOT.cc","PhysicsTools/PyTorch/test/testUtilities.h","PhysicsTools/PyTorch/test/BuildFile.xml","PhysicsTools/PyTorch/test/alpaka/testTorchDeviceMatchAlpaka.cc","PhysicsTools/PyTorch/interface/Converter.h","PhysicsTools/PyTorch/test/alpaka/testTorchExecutionControlGuard.cc","PhysicsTools/PyTorch/test/alpaka/testPortableInferenceAOT.dev.cc","PhysicsTools/PyTorch/scripts/link_cuda.sh","PhysicsTools/PyTorch/plugins/alpaka/CombinatoricsProducer.cc","PhysicsTools/PyTorch/scripts/compile.sh","DataFormats/PyTorchTest/interface/alpaka/Collections.h","PhysicsTools/PyTorch/test/testTorchFromBlobStride.cu","DataFormats/PyTorchTest/interface/Layout.h","PhysicsTools/PyTorch/README.md","PhysicsTools/PyTorch/plugins/alpaka/Kernels.h","PhysicsTools/PyTorch/plugins/alpaka/JitClassificationProducer.cc","PhysicsTools/PyTorch/interface/SoAMetadata.h","PhysicsTools/PyTorch/test/alpaka/testModelJIT.cc","PhysicsTools/PyTorch/interface/Nvtx.h","PhysicsTools/PyTorch/plugins/alpaka/AotRegressionProducer.cc","PhysicsTools/PyTorch/scripts/compile_cuda.sh","PhysicsTools/PyTorch/plugins/alpaka/DataProducer.cc","PhysicsTools/PyTorch/scripts/link.sh","PhysicsTools/PyTorch/test/testModel.cc","PhysicsTools/PyTorch/interface/AlpakaConfig.h","DataFormats/PyTorchTest/interface/Device.h","PhysicsTools/PyTorch/interface/Model.h","PhysicsTools/PyTorch/test/alpaka/testModelAlpakaNamespace.cc","PhysicsTools/PyTorch/test/alpaka/testSOAtoTorch.dev.cc","PhysicsTools/PyTorch/test/alpaka/testPortableInferenceJIT.cc","PhysicsTools/PyTorch/test/alpaka/testSOADataTypes.dev.cc","PhysicsTools/PyTorch/interface/SoAWrapper.h","PhysicsTools/PyTorch/plugins/alpaka/Kernels.dev.cc","DataFormats/PyTorchTest/interface/Host.h","PhysicsTools/PyTorch/interface/Config.h","PhysicsTools/PyTorch/test/testTensorStride.cu"],"squashed":true,"time":1746000054},"cd3feb9e1d94f799bd984bd87ad53a74bb72930f":{"files":[],"squashed":true,"time":1749206568},"d67f5110210e749d4755c9d813537243cabd4de4":{"files":["PhysicsTools/PyTorch/interface/Converter.h","PhysicsTools/PyTorch/interface/Model.h"],"squashed":true,"time":1745576333},"de86f2327e5efb2396d87077ceda0814e2f552ec":{"files":["PhysicsTools/PyTorch/test/BuildFile.xml","PhysicsTools/PyTorch/test/testModel.cc","PhysicsTools/PyTorch/test/testModelCpu.cc","PhysicsTools/PyTorch/test/testModelCuda.cc","PhysicsTools/PyTorch/test/testTensorStride.cu","PhysicsTools/PyTorch/test/testTorchFromBlobStride.cu","PhysicsTools/PyTorch/test/testTorchFromBufferPinnedMemory.cu"],"squashed":true,"time":1749122412},"df86f605b96f2688ace00182a1804c7838248fe8":{"files":["PhysicsTools/PyTorch/README.md","PhysicsTools/PyTorch/interface/AlpakaConfig.h","PhysicsTools/PyTorch/interface/Model.h","PhysicsTools/PyTorch/models/aot_classification_model_cpu_el8_amd64_gcc12.pt2","PhysicsTools/PyTorch/models/aot_classification_model_cuda_el8_amd64_gcc12.pt2","PhysicsTools/PyTorch/plugins/alpaka/AotClassificationProducer.cc","PhysicsTools/PyTorch/python/aot_inductor_export.py","PhysicsTools/PyTorch/python/modules.py","PhysicsTools/PyTorch/python/options.py","PhysicsTools/PyTorch/scripts/aot.sh","PhysicsTools/PyTorch/test/testPipeline.py"],"squashed":true,"time":1749206568},"e2e0d956a4bcc1566206371e70ae27fcaadcfa29":{"files":["PhysicsTools/PyTorch/plugins/alpaka/DataProducer.cc","PhysicsTools/PyTorch/test/testModelCuda.cc","PhysicsTools/PyTorch/test/BuildFile.xml","PhysicsTools/PyTorch/plugins/alpaka/AotRegressionProducer.cc","PhysicsTools/PyTorch/test/testTorchFromBufferPinnedMemory.cu"],"squashed":true,"time":1749123951},"e63dec03beb23eb5ee50ea7b2db2fefd133c2beb":{"files":["PhysicsTools/PyTorch/plugins/alpaka/DataProducer.cc","PhysicsTools/PyTorch/test/testModelCuda.cc","PhysicsTools/PyTorch/test/BuildFile.xml","PhysicsTools/PyTorch/plugins/alpaka/AotRegressionProducer.cc","PhysicsTools/PyTorch/test/testTorchFromBufferPinnedMemory.cu"],"squashed":true,"time":1749128295},"ee72386c7d21ded2af4e6ce48373b523e49e5acf":{"files":["PhysicsTools/PyTorch/plugins/alpaka/DataProducer.cc","PhysicsTools/PyTorch/test/testModelCuda.cc","PhysicsTools/PyTorch/test/BuildFile.xml","PhysicsTools/PyTorch/plugins/alpaka/AotRegressionProducer.cc","PhysicsTools/PyTorch/test/testTorchFromBufferPinnedMemory.cu"],"squashed":true,"time":1749123955},"f38496d1359bc57e70b197ed46dbbf59143408ae":{"files":["PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/TinyResNet.cc","PhysicsTools/PyTorchAlpaka/interface/GetDevice.h","PhysicsTools/PyTorchAlpaka/interface/alpaka/AlpakaModel.h","PhysicsTools/PyTorch/BuildFile.xml","DataFormats/PortableTestObjects/interface/TestSoA.h","PhysicsTools/PyTorchAlpakaTest/test/runPyTorchAlpakaTest.py","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/MaskedNet.cc","PhysicsTools/PyTorch/test/BuildFile.xml","PhysicsTools/PyTorchAlpaka/BuildFile.xml","DataFormats/PortableTestObjects/src/classes.cc","PhysicsTools/PyTorchAlpaka/interface/TensorHandle.h","PhysicsTools/PyTorch/test/testModelJit.cc","PhysicsTools/PyTorchAlpakaTest/test/BuildFile.xml","PhysicsTools/PyTorchAlpaka/interface/QueueGuard.h","PhysicsTools/PyTorch/interface/TorchInterface.h","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/CommonKernels.dev.cc","DataFormats/PortableTestObjects/src/alpaka/classes_rocm.h","DataFormats/PortableTestObjects/src/alpaka/classes_cuda.h","PhysicsTools/PyTorch/test/testTorchlibModelsCpu.cc","PhysicsTools/PyTorch/plugins/PyTorchService.cc","PhysicsTools/PyTorch/test/testJitLoad.cc","PhysicsTools/PyTorchAlpakaTest/test/TinyResNet.py","DataFormats/PortableTestObjects/interface/TorchTestHostCollection.h","DataFormats/PortableTestObjects/interface/alpaka/TorchTestDeviceCollection.h","PhysicsTools/PyTorchAlpakaTest/plugins/InspectionSink.cc","PhysicsTools/PyTorchAlpakaTest/python/MultiHeadNet.py","PhysicsTools/PyTorchAlpakaTest/interface/alpaka/MaskDevice.h","PhysicsTools/PyTorchAlpaka/interface/TensorRegistry.h","PhysicsTools/PyTorch/interface/TorchCompat.h","DataFormats/PortableTestObjects/src/classes.h","PhysicsTools/PyTorchAlpakaTest/python/MaskedNet.py","DataFormats/PortableTestObjects/interface/TorchTestSoA.h","PhysicsTools/PyTorchAlpaka/test/testRunner.cc","PhysicsTools/PyTorchAlpaka/interface/Converter.h","DataFormats/PortableTestObjects/interface/alpaka/TestDeviceCollection.h","PhysicsTools/PyTorchAlpakaTest/python/options_cff.py","PhysicsTools/PyTorchAlpaka/test/alpaka/testSoADataTypes.dev.cc","PhysicsTools/PyTorchAlpaka/interface/SoAConversion.h","PhysicsTools/PyTorch/README.md","PhysicsTools/PyTorchAlpaka/interface/NvtxRAII.h","PhysicsTools/PyTorch/interface/ScriptModuleLoad.h","PhysicsTools/PyTorch/scripts/pytorch_aot_auto_compilation.sh","PhysicsTools/PyTorchAlpakaTest/python/SimpleNet.py","DataFormats/PortableTestObjects/interface/TestHostCollection.h","PhysicsTools/PyTorchAlpakaTest/BuildFile.xml","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/DataSource.cc","PhysicsTools/PyTorchAlpakaTest/test/MultiHeadNet.py","PhysicsTools/PyTorchAlpaka/README.md","PhysicsTools/PyTorchAlpaka/interface/alpaka/Config.h","PhysicsTools/PyTorchAlpakaTest/test/SimpleNet.py","PhysicsTools/PyTorch/test/testExportLinearDnn.py","PhysicsTools/PyTorch/test/Nvtx.h","PhysicsTools/PyTorch/interface/ModelAOT.h","PhysicsTools/PyTorchAlpakaTest/python/TinyResNet.py","PhysicsTools/PyTorch/interface/Model.h","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/CommonKernels.h","PhysicsTools/PyTorch/src/ScriptedModuleLoad.cc","PhysicsTools/PyTorch/test/testModelAot.cc","PhysicsTools/PyTorchAlpaka/interface/alpaka/ROCmSerialSyncHandle.h","PhysicsTools/PyTorchAlpakaTest/plugins/BuildFile.xml","PhysicsTools/PyTorchAlpaka/interface/Policy.h","PhysicsTools/PyTorchAlpakaTest/plugins/Environment.h","PhysicsTools/PyTorchAlpaka/test/alpaka/testAlpakaModel.cc","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/SimpleNet.cc","PhysicsTools/PyTorchAlpakaTest/plugins/alpaka/MultiHeadNet.cc","PhysicsTools/PyTorchAlpakaTest/interface/MaskSoA.h","PhysicsTools/PyTorchAlpaka/test/BuildFile.xml","PhysicsTools/PyTorch/test/testTorchlibModelsCuda.cc","PhysicsTools/PyTorch/scripts/aot_inductor_export.py","PhysicsTools/PyTorch/test/testRunner.cc","PhysicsTools/PyTorchAlpakaTest/test/MaskedNet.py","PhysicsTools/PyTorch/test/testTorchBase.h","PhysicsTools/PyTorchAlpakaTest/test/testPyTorchAlpakaHeterogeneousPipeline.py","PhysicsTools/PyTorch/test/testUtilities.h","PhysicsTools/PyTorch/python/aot_inductor_export.py","PhysicsTools/PyTorch/test/testTorchTensorStride.cu","PhysicsTools/PyTorch/plugins/BuildFile.xml","PhysicsTools/PyTorchAlpakaTest/interface/MaskHost.h","PhysicsTools/PyTorchAlpaka/test/alpaka/testSoAToTorch.dev.cc","PhysicsTools/PyTorchAlpaka/interface/Environment.h","PhysicsTools/PyTorch/test/testTorchlibModels.h","PhysicsTools/PyTorchAlpaka/interface/SoAMetadata.h"],"squashed":true,"time":1760164109}},"emoji":{"2844370362":"+1","2857956462":"+1","2858568048":"+1","2858930311":"+1","2939792816":"+1","2943205185":"+1","2943206864":"+1","2944923815":"+1","2949371993":"+1","2992380307":"+1","2992383003":"+1","2998018308":"+1","3032565472":"+1","3032569599":"+1","3204253877":"+1","3365118067":"+1","3367939657":"+1","3367939708":"+1","3370737867":"+1","3410277045":"+1","3481022723":"+1"},"last_seen_sha":"56a2dd8af9275861b40ad6d89288e2622a20bcd8","signatures":{"2998018308":"df86f605b96f2688ace00182a1804c7838248fe8","3204253877":"df86f605b96f2688ace00182a1804c7838248fe8","3410277045":"b81a950db160fc1c86508137be5615a427395bd2"}} -->

cmsbuild avatar Apr 30 '25 09:04 cmsbuild

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47984/44654

  • Found files with invalid states:

    • DataFormats/PyTorch/src/classes.h:
      • Added: 3ba3ba4a3e6c0a9812de91bad540fd55260cd48a
      • Deleted: 3e87013b51f1829bce1dad0ce6145e10d73c9610
    • PhysicsTools/PyTorch/interface/SoAMetadata.h:
      • Added: 3ba3ba4a3e6c0a9812de91bad540fd55260cd48a
      • Deleted: 46072a6486081a8beec18ce8776c4d29982403ac
    • DataFormats/PyTorch/src/alpaka/classes_rocm_def.xml:
      • Added: 3ba3ba4a3e6c0a9812de91bad540fd55260cd48a
      • Deleted: 3e87013b51f1829bce1dad0ce6145e10d73c9610
    • DataFormats/PyTorch/interface/alpaka/Collections.h:
      • Added: 3ba3ba4a3e6c0a9812de91bad540fd55260cd48a
      • Deleted: 3e87013b51f1829bce1dad0ce6145e10d73c9610
    • DataFormats/PyTorch/src/classes_def.xml:
      • Added: 3ba3ba4a3e6c0a9812de91bad540fd55260cd48a
      • Deleted: 3e87013b51f1829bce1dad0ce6145e10d73c9610
    • DataFormats/PyTorch/src/alpaka/classes_rocm.h:
      • Added: 3ba3ba4a3e6c0a9812de91bad540fd55260cd48a
      • Deleted: 3e87013b51f1829bce1dad0ce6145e10d73c9610
    • DataFormats/PyTorch/BuildFile.xml:
      • Added: 3ba3ba4a3e6c0a9812de91bad540fd55260cd48a
      • Deleted: 3e87013b51f1829bce1dad0ce6145e10d73c9610
    • DataFormats/PyTorch/interface/Layout.h:
      • Added: 3ba3ba4a3e6c0a9812de91bad540fd55260cd48a
      • Deleted: 3e87013b51f1829bce1dad0ce6145e10d73c9610
    • DataFormats/PyTorch/interface/Host.h:
      • Added: 3ba3ba4a3e6c0a9812de91bad540fd55260cd48a
      • Deleted: 3e87013b51f1829bce1dad0ce6145e10d73c9610
    • DataFormats/PyTorch/src/alpaka/classes_cuda.h:
      • Added: 3ba3ba4a3e6c0a9812de91bad540fd55260cd48a
      • Deleted: 3e87013b51f1829bce1dad0ce6145e10d73c9610
    • DataFormats/PyTorch/interface/Device.h:
      • Added: 3ba3ba4a3e6c0a9812de91bad540fd55260cd48a
      • Deleted: 3e87013b51f1829bce1dad0ce6145e10d73c9610
    • DataFormats/PyTorch/src/classes.cc:
      • Added: 3ba3ba4a3e6c0a9812de91bad540fd55260cd48a
      • Deleted: 3e87013b51f1829bce1dad0ce6145e10d73c9610
    • DataFormats/PyTorch/src/alpaka/classes_cuda_def.xml:
      • Added: 3ba3ba4a3e6c0a9812de91bad540fd55260cd48a
      • Deleted: 3e87013b51f1829bce1dad0ce6145e10d73c9610
  • There are other open Pull requests which might conflict with changes you have proposed:

    • File PhysicsTools/PyTorch/BuildFile.xml modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/BuildFile.xml modified in PR(s): #45441, #47951
    • File PhysicsTools/PyTorch/test/create_simple_dnn.py modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testBase.h modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testBaseCUDA.h modified in PR(s): #45441, #47951
    • File PhysicsTools/PyTorch/test/testTorchFromBufferPinnedMemory.cu modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testTorchSimpleDnn.cc modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testTorchSimpleDnnCUDA.cc modified in PR(s): #45441

Code check has found code style and quality issues which could be resolved by applying following patch(s)

  • code-format: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47984/44654/code-format.patch e.g. curl -k https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47984/44654/code-format.patch | patch -p1 You can also run scram build code-format to apply code format directly

cmsbuild avatar Apr 30 '25 09:04 cmsbuild

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47984/44655

  • There are other open Pull requests which might conflict with changes you have proposed:
    • File PhysicsTools/PyTorch/BuildFile.xml modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/BuildFile.xml modified in PR(s): #45441, #47951
    • File PhysicsTools/PyTorch/test/create_simple_dnn.py modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testBase.h modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testBaseCUDA.h modified in PR(s): #45441, #47951
    • File PhysicsTools/PyTorch/test/testTorchFromBufferPinnedMemory.cu modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testTorchSimpleDnn.cc modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testTorchSimpleDnnCUDA.cc modified in PR(s): #45441

cmsbuild avatar Apr 30 '25 10:04 cmsbuild

A new Pull Request was created by @lukaszmichalskii for master.

It involves the following packages:

  • DataFormats/PyTorchTest (****)
  • PhysicsTools/PyTorch (ml)

The following packages do not have a category, yet:

DataFormats/PyTorchTest Please create a PR for https://github.com/cms-sw/cms-bot/blob/master/categories_map.py to assign category

@cmsbuild, @valsdav, @y19y19 can you please review it and eventually sign? Thanks. @missirol, @mmusich, @rovere this is something you requested to watch as well. @antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

cmsbuild avatar Apr 30 '25 10:04 cmsbuild

enable gpu

valsdav avatar May 01 '25 08:05 valsdav

please test

valsdav avatar May 07 '25 10:05 valsdav

-1

Failed Tests: Build ClangBuild Size: This PR adds an extra 20KB to repository Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-c68a5d/45909/summary.html COMMIT: c01d07f67496598ae4d95d8c71898b2dfd226a49 CMSSW: CMSSW_15_1_X_2025-05-06-2300/el8_amd64_gcc12 Additional Tests: CUDA,ROCM User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/47984/45909/install.sh to create a dev area with all the needed externals and cmssw changes.

Build

I found compilation error when building:

>> Compiling  src/PhysicsTools/PyTorch/test/testModel.cc
/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02888/el8_amd64_gcc12/external/gcc/12.3.1-40d504be6370b5a30e3947a6e575ca28/bin/c++ -c -DCMS_MICRO_ARCH='x86-64-v3' -DGNU_GCC -D_GNU_SOURCE -DCMSSW_GIT_HASH='CMSSW_15_1_X_2025-05-06-2300' -DPROJECT_NAME='CMSSW' -DPROJECT_VERSION='CMSSW_15_1_X_2025-05-06-2300' -Isrc -Ipoison -I/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02888/el8_amd64_gcc12/cms/cmssw/CMSSW_15_1_X_2025-05-06-2300/src -I/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02888/el8_amd64_gcc12/external/pytorch/2.6.0-a6d0e4413a9e766b40a2b79f83b4b176/include -I/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02888/el8_amd64_gcc12/external/pytorch/2.6.0-a6d0e4413a9e766b40a2b79f83b4b176/include/torch/csrc/api/include -I/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02888/el8_amd64_gcc12/external/cppunit/1.15.x-25a760f1303b0fca73df75b14e1358bc/include -I/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02888/el8_amd64_gcc12/external/cuda/12.8.1-f1c01abd08373a07ceeffab8d5f1930a/include -I/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02888/el8_amd64_gcc12/external/protobuf/3.21.9-1126508a53768c90e66f6bf1821ac03a/include -I/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02888/el8_amd64_gcc12/external/zlib/1.2.13-d217cdbdd8d586e845e05946de2796be/include -O3 -pthread -pipe -Werror=main -Werror=pointer-arith -Werror=overlength-strings -Wno-vla -Werror=overflow -std=c++20 -ftree-vectorize -Werror=array-bounds -Werror=format-contains-nul -Werror=type-limits -fvisibility-inlines-hidden -fno-math-errno --param vect-max-version-for-alias-checks=50 -Xassembler --compress-debug-sections -Wno-error=array-bounds -Warray-bounds -fuse-ld=bfd -march=x86-64-v3 -felide-constructors -fmessage-length=0 -Wall -Wno-non-template-friend -Wno-long-long -Wreturn-type -Wextra -Wpessimizing-move -Wclass-memaccess -Wno-cast-function-type -Wno-unused-but-set-parameter -Wno-ignored-qualifiers -Wno-unused-parameter -Wunused -Wparentheses -Werror=return-type -Werror=missing-braces -Werror=unused-value -Werror=unused-label -Werror=address -Werror=format -Werror=sign-compare -Werror=write-strings -Werror=delete-non-virtual-dtor -Werror=strict-aliasing -Werror=narrowing -Werror=unused-but-set-variable -Werror=reorder -Werror=unused-variable -Werror=conversion-null -Werror=return-local-addr -Wnon-virtual-dtor -Werror=switch -fdiagnostics-show-option -Wno-unused-local-typedefs -Wno-attributes -Wno-psabi -DBOOST_DISABLE_ASSERTS -flto=auto -fipa-icf -flto-odr-type-merging -fno-fat-lto-objects -Wodr -fPIC -MMD -MF tmp/el8_amd64_gcc12/src/PhysicsTools/PyTorch/test/testModel/testModel.cc.d src/PhysicsTools/PyTorch/test/testModel.cc -o tmp/el8_amd64_gcc12/src/PhysicsTools/PyTorch/test/testModel/testModel.cc.o
>> Compiling  src/PhysicsTools/PyTorch/test/testRunner.cc
/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02888/el8_amd64_gcc12/external/gcc/12.3.1-40d504be6370b5a30e3947a6e575ca28/bin/c++ -c -DCMS_MICRO_ARCH='x86-64-v3' -DGNU_GCC -D_GNU_SOURCE -DCMSSW_GIT_HASH='CMSSW_15_1_X_2025-05-06-2300' -DPROJECT_NAME='CMSSW' -DPROJECT_VERSION='CMSSW_15_1_X_2025-05-06-2300' -Isrc -Ipoison -I/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02888/el8_amd64_gcc12/cms/cmssw/CMSSW_15_1_X_2025-05-06-2300/src -I/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02888/el8_amd64_gcc12/external/pytorch/2.6.0-a6d0e4413a9e766b40a2b79f83b4b176/include -I/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02888/el8_amd64_gcc12/external/pytorch/2.6.0-a6d0e4413a9e766b40a2b79f83b4b176/include/torch/csrc/api/include -I/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02888/el8_amd64_gcc12/external/cppunit/1.15.x-25a760f1303b0fca73df75b14e1358bc/include -I/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02888/el8_amd64_gcc12/external/cuda/12.8.1-f1c01abd08373a07ceeffab8d5f1930a/include -I/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02888/el8_amd64_gcc12/external/protobuf/3.21.9-1126508a53768c90e66f6bf1821ac03a/include -I/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02888/el8_amd64_gcc12/external/zlib/1.2.13-d217cdbdd8d586e845e05946de2796be/include -O3 -pthread -pipe -Werror=main -Werror=pointer-arith -Werror=overlength-strings -Wno-vla -Werror=overflow -std=c++20 -ftree-vectorize -Werror=array-bounds -Werror=format-contains-nul -Werror=type-limits -fvisibility-inlines-hidden -fno-math-errno --param vect-max-version-for-alias-checks=50 -Xassembler --compress-debug-sections -Wno-error=array-bounds -Warray-bounds -fuse-ld=bfd -march=x86-64-v3 -felide-constructors -fmessage-length=0 -Wall -Wno-non-template-friend -Wno-long-long -Wreturn-type -Wextra -Wpessimizing-move -Wclass-memaccess -Wno-cast-function-type -Wno-unused-but-set-parameter -Wno-ignored-qualifiers -Wno-unused-parameter -Wunused -Wparentheses -Werror=return-type -Werror=missing-braces -Werror=unused-value -Werror=unused-label -Werror=address -Werror=format -Werror=sign-compare -Werror=write-strings -Werror=delete-non-virtual-dtor -Werror=strict-aliasing -Werror=narrowing -Werror=unused-but-set-variable -Werror=reorder -Werror=unused-variable -Werror=conversion-null -Werror=return-local-addr -Wnon-virtual-dtor -Werror=switch -fdiagnostics-show-option -Wno-unused-local-typedefs -Wno-attributes -Wno-psabi -DBOOST_DISABLE_ASSERTS -flto=auto -fipa-icf -flto-odr-type-merging -fno-fat-lto-objects -Wodr -fPIC -MMD -MF tmp/el8_amd64_gcc12/src/PhysicsTools/PyTorch/test/testModel/testRunner.cc.d src/PhysicsTools/PyTorch/test/testRunner.cc -o tmp/el8_amd64_gcc12/src/PhysicsTools/PyTorch/test/testModel/testRunner.cc.o
In file included from src/PhysicsTools/PyTorch/test/testModel.cc:5:
src/PhysicsTools/PyTorch/test/testUtilities.h:4:10: fatal error: boost/filesystem.hpp: No such file or directory
    4 | #include 
      |          ^~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
gmake: *** [tmp/el8_amd64_gcc12/src/PhysicsTools/PyTorch/test/testModel/testModel.cc.o] Error 1
>> Building binary testModel

Clang Build

I found compilation error while trying to compile with clang. Command used:

USER_CUDA_FLAGS='--expt-relaxed-constexpr' USER_CXXFLAGS='-Wno-register -fsyntax-only' /usr/bin/time -v scram build -k -j 32 COMPILER='llvm compile'

>> Local Products Rules ..... done
>> Creating project symlinks
>> Entering Package PhysicsTools/PyTorch
>> Entering Package DataFormats/PyTorchTest
>> Compile sequence completed for CMSSW CMSSW_15_1_X_2025-05-06-2300
gmake: *** [There are compilation/build errors. Please see the detail log above.] Error 1
Command exited with non-zero status 1
	Command being timed: "scram build -k -j 32 COMPILER=llvm compile BUILD_LOG=yes"
	User time (seconds): 907.23
	System time (seconds): 91.81
	Percent of CPU this job got: 655%

cmsbuild avatar May 07 '25 10:05 cmsbuild

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47984/44735

  • There are other open Pull requests which might conflict with changes you have proposed:
    • File PhysicsTools/PyTorch/BuildFile.xml modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/BuildFile.xml modified in PR(s): #45441, #47951
    • File PhysicsTools/PyTorch/test/create_simple_dnn.py modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testBase.h modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testBaseCUDA.h modified in PR(s): #45441, #47951
    • File PhysicsTools/PyTorch/test/testTorchFromBufferPinnedMemory.cu modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testTorchSimpleDnn.cc modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testTorchSimpleDnnCUDA.cc modified in PR(s): #45441

cmsbuild avatar May 07 '25 12:05 cmsbuild

Pull request #47984 was updated. @cmsbuild, @valsdav, @y19y19 can you please check and sign again.

cmsbuild avatar May 07 '25 13:05 cmsbuild

please test

valsdav avatar May 07 '25 13:05 valsdav

-1

Failed Tests: ClangBuild Size: This PR adds an extra 16KB to repository Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-c68a5d/45917/summary.html COMMIT: 0a7ec1459ed13c3442396569085c0c01d0e5fd9a CMSSW: CMSSW_15_1_X_2025-05-07-1100/el8_amd64_gcc12 Additional Tests: CUDA,ROCM User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/47984/45917/install.sh to create a dev area with all the needed externals and cmssw changes.

Clang Build

I found compilation warning while trying to compile with clang. Command used:

USER_CUDA_FLAGS='--expt-relaxed-constexpr' USER_CXXFLAGS='-Wno-register -fsyntax-only' /usr/bin/time -v scram build -k -j 32 COMPILER='llvm compile'

See details on the summary page.

cmsbuild avatar May 07 '25 13:05 cmsbuild

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47984/44741

  • There are other open Pull requests which might conflict with changes you have proposed:
    • File PhysicsTools/PyTorch/BuildFile.xml modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/BuildFile.xml modified in PR(s): #45441, #47951
    • File PhysicsTools/PyTorch/test/create_simple_dnn.py modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testBase.h modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testBaseCUDA.h modified in PR(s): #45441, #47951
    • File PhysicsTools/PyTorch/test/testTorchFromBufferPinnedMemory.cu modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testTorchSimpleDnn.cc modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testTorchSimpleDnnCUDA.cc modified in PR(s): #45441

cmsbuild avatar May 07 '25 14:05 cmsbuild

Pull request #47984 was updated. @cmsbuild, @valsdav, @y19y19 can you please check and sign again.

cmsbuild avatar May 07 '25 14:05 cmsbuild

please test

valsdav avatar May 07 '25 14:05 valsdav

-1

Failed Tests: UnitTests RelVals cudaUnitTests rocmUnitTests Size: This PR adds an extra 24KB to repository Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-c68a5d/45926/summary.html COMMIT: a175708c52b57f0d80802ce05813bdbdd81c6a52 CMSSW: CMSSW_15_1_X_2025-05-07-1100/el8_amd64_gcc12 Additional Tests: CUDA,ROCM User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/47984/45926/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found 7 errors in the following unit tests:

---> test testModelAOTSerialSync had ERRORS
---> test testPortableInferenceAOTSerialSync had ERRORS
---> test testTensorStride had ERRORS
and more ...

RelVals

----- Begin Fatal Exception 07-May-2025 17:38:59 CEST-----------------------
An exception of category 'FallbackFileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=MixingModule label='mix'
   [2] Calling RootInputFileSequence::initTheFile()
   [3] Calling StorageFactory::open()
   [4] Calling XrdFile::open()
Exception Message:
Failed to open the file 'root://xrootd-cms.infn.it//store/relval/CMSSW_13_0_11/RelValMinBias_14TeV/GEN-SIM-RECO/130X_mcRun3_2023_realistic_withEarly2023BS_v1_FastSim-v1/2580000/d4976755-655b-4715-bc0f-745eb585befe.root'
   Additional Info:
      [a] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://cms-xrd-global.cern.ch//eos/cms/store/relval/CMSSW_13_0_11/RelValMinBias_14TeV/GEN-SIM-RECO/130X_mcRun3_2023_realistic_withEarly2023BS_v1_FastSim-v1/2580000/d4976755-655b-4715-bc0f-745eb585befe.root
      [b] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_13_0_11/RelValMinBias_14TeV/GEN-SIM-RECO/130X_mcRun3_2023_realistic_withEarly2023BS_v1_FastSim-v1/2580000/d4976755-655b-4715-bc0f-745eb585befe.root
      [c] Input file root://xrootd-cms.infn.it//store/relval/CMSSW_13_0_11/RelValMinBias_14TeV/GEN-SIM-RECO/130X_mcRun3_2023_realistic_withEarly2023BS_v1_FastSim-v1/2580000/d4976755-655b-4715-bc0f-745eb585befe.root could not be opened.
      [d] XrdCl::File::Open(name='root://xrootd-cms.infn.it//store/relval/CMSSW_13_0_11/RelValMinBias_14TeV/GEN-SIM-RECO/130X_mcRun3_2023_realistic_withEarly2023BS_v1_FastSim-v1/2580000/d4976755-655b-4715-bc0f-745eb585befe.root', flags=0x10, permissions=0660) => error '[ERROR] Server responded with an error: [3011] No servers are available to read the file.
' (errno=3011, code=400). No additional data servers were found.
      [e] Last URL tried: root://cms-xrd-global.cern.ch:1094//store/relval/CMSSW_13_0_11/RelValMinBias_14TeV/GEN-SIM-RECO/130X_mcRun3_2023_realistic_withEarly2023BS_v1_FastSim-v1/2580000/d4976755-655b-4715-bc0f-745eb585befe.root?tried=+1213xrootd-redic.pi.infn.it&xrdcl.requuid=d2e8a5a5-a02a-4ae7-9edb-a7d526477f84
      [f] Problematic data server: cms-xrd-global.cern.ch:1094
      [g] Disabled source: cms-xrd-global.cern.ch:1094
----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 07-May-2025 17:38:35 CEST-----------------------
An exception of category 'FallbackFileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=MixingModule label='mix'
   [2] Calling RootInputFileSequence::initTheFile()
   [3] Calling StorageFactory::open()
   [4] Calling XrdFile::open()
Exception Message:
Failed to open the file 'root://xrootd-cms.infn.it//store/relval/CMSSW_12_0_0_pre4/RelValMinBias_13/GEN-SIM/113X_mc2017_realistic_v5-v1/00000/1888d3ef-3019-4e81-bf79-7e50c5657e64.root'
   Additional Info:
      [a] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://cms-xrd-global.cern.ch//eos/cms/store/relval/CMSSW_12_0_0_pre4/RelValMinBias_13/GEN-SIM/113X_mc2017_realistic_v5-v1/00000/1888d3ef-3019-4e81-bf79-7e50c5657e64.root
      [b] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_12_0_0_pre4/RelValMinBias_13/GEN-SIM/113X_mc2017_realistic_v5-v1/00000/1888d3ef-3019-4e81-bf79-7e50c5657e64.root
      [c] Input file root://xrootd-cms.infn.it//store/relval/CMSSW_12_0_0_pre4/RelValMinBias_13/GEN-SIM/113X_mc2017_realistic_v5-v1/00000/1888d3ef-3019-4e81-bf79-7e50c5657e64.root could not be opened.
      [d] XrdCl::File::Open(name='root://xrootd-cms.infn.it//store/relval/CMSSW_12_0_0_pre4/RelValMinBias_13/GEN-SIM/113X_mc2017_realistic_v5-v1/00000/1888d3ef-3019-4e81-bf79-7e50c5657e64.root', flags=0x10, permissions=0660) => error '[ERROR] Server responded with an error: [3011] No servers are available to read the file.
' (errno=3011, code=400). No additional data servers were found.
      [e] Last URL tried: root://cms-xrd-global.cern.ch:1094//store/relval/CMSSW_12_0_0_pre4/RelValMinBias_13/GEN-SIM/113X_mc2017_realistic_v5-v1/00000/1888d3ef-3019-4e81-bf79-7e50c5657e64.root?tried=+1213llrxrd-redir.in2p3.fr&xrdcl.requuid=d2115431-695b-4caf-828b-5c988581efb7
      [f] Problematic data server: cms-xrd-global.cern.ch:1094
      [g] Disabled source: cms-xrd-global.cern.ch:1094
----- End Fatal Exception -------------------------------------------------

CUDA Unit Tests

I found 3 errors in the following unit tests:

---> test testModelAOTCudaAsync had ERRORS
---> test TestPipelineCuda had ERRORS
---> test testPortableInferenceAOTCudaAsync had ERRORS

ROCm Unit Tests

I found 1 errors in the following unit tests:

---> test TestPipelineROCm had ERRORS

CUDA Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 1
  • DQMHistoTests: Total histograms compared: 0
  • DQMHistoTests: Total failures: 0
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 0
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0 KiB( 0 files compared)
  • Checked 0 log files, 0 edm output root files, 1 DQM output files

ROCM Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 1
  • DQMHistoTests: Total histograms compared: 0
  • DQMHistoTests: Total failures: 0
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 0
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0 KiB( 0 files compared)
  • Checked 0 log files, 0 edm output root files, 1 DQM output files

cmsbuild avatar May 07 '25 19:05 cmsbuild

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47984/45049

  • There are other open Pull requests which might conflict with changes you have proposed:
    • File PhysicsTools/PyTorch/BuildFile.xml modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/BuildFile.xml modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/create_simple_dnn.py modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testBase.h modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testBaseCUDA.h modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testTorchFromBufferPinnedMemory.cu modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testTorchSimpleDnn.cc modified in PR(s): #45441
    • File PhysicsTools/PyTorch/test/testTorchSimpleDnnCUDA.cc modified in PR(s): #45441

cmsbuild avatar Jun 04 '25 12:06 cmsbuild

Pull request #47984 was updated. @cmsbuild, @valsdav, @y19y19 can you please check and sign again.

cmsbuild avatar Jun 04 '25 12:06 cmsbuild

please test

valsdav avatar Jun 04 '25 12:06 valsdav

please abort test

valsdav avatar Jun 05 '25 08:06 valsdav

please test

valsdav avatar Jun 05 '25 08:06 valsdav

-1

Failed Tests: UnitTests Size: This PR adds an extra 16KB to repository Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-c68a5d/46559/summary.html COMMIT: 24513c45f019f16cf5cd751fd9050499b04a9684 CMSSW: CMSSW_15_1_X_2025-06-04-2300/el8_amd64_gcc12 Additional Tests: CUDA,ROCM User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/47984/46559/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found 4 errors in the following unit tests:

---> test testTensorStride had ERRORS
---> test testModel had ERRORS
---> test testTorchFromBufferPinnedMemory had ERRORS
and more ...

Comparison Summary

Summary:

CUDA Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 7
  • DQMHistoTests: Total histograms compared: 53211
  • DQMHistoTests: Total failures: 38
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 53173
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
  • Checked 24 log files, 30 edm output root files, 7 DQM output files
  • TriggerResults: no differences found

ROCM Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 24 differences found in the comparisons
  • DQMHistoTests: Total files compared: 7
  • DQMHistoTests: Total histograms compared: 53211
  • DQMHistoTests: Total failures: 2750
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 50461
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
  • Checked 24 log files, 30 edm output root files, 7 DQM output files

cmsbuild avatar Jun 05 '25 10:06 cmsbuild

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47984/45065

  • Found files with invalid states:
    • PhysicsTools/PyTorch/models/aot_regression_model_cpu_el9_amd64_gcc12.pt2:
      • Added: c01d07f67496598ae4d95d8c71898b2dfd226a49
      • Deleted: 1ac47aa7e1d473bf4765e854876b782ca0d41d45
    • PhysicsTools/PyTorch/models/aot_regression_model_cuda_el9_amd64_gcc12.pt2:
      • Added: c01d07f67496598ae4d95d8c71898b2dfd226a49
      • Deleted: 1ac47aa7e1d473bf4765e854876b782ca0d41d45
    • PhysicsTools/PyTorch/test/testModel.cc:
      • Added: c01d07f67496598ae4d95d8c71898b2dfd226a49
      • Modified: a175708c52b57f0d80802ce05813bdbdd81c6a52
      • Deleted: de86f2327e5efb2396d87077ceda0814e2f552ec

Code check has found code style and quality issues which could be resolved by applying following patch(s)

  • code-format: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47984/45065/code-format.patch e.g. curl -k https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47984/45065/code-format.patch | patch -p1 You can also run scram build code-format to apply code format directly

cmsbuild avatar Jun 05 '25 13:06 cmsbuild

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47984/45068

  • Found files with invalid states:
    • PhysicsTools/PyTorch/models/aot_regression_model_cpu_el9_amd64_gcc12.pt2:
      • Added: 185f42016f77f8856bed97a450da41e024220be8
      • Deleted: ee72386c7d21ded2af4e6ce48373b523e49e5acf
    • PhysicsTools/PyTorch/models/aot_regression_model_cuda_el9_amd64_gcc12.pt2:
      • Added: 185f42016f77f8856bed97a450da41e024220be8
      • Deleted: ee72386c7d21ded2af4e6ce48373b523e49e5acf
    • PhysicsTools/PyTorch/test/testModel.cc:
      • Added: 185f42016f77f8856bed97a450da41e024220be8
      • Modified: a4211a07e56eabeb7aaaa570d28cf2973346872a
      • Deleted: e63dec03beb23eb5ee50ea7b2db2fefd133c2beb

cmsbuild avatar Jun 05 '25 15:06 cmsbuild

Pull request #47984 was updated. @cmsbuild, @valsdav, @y19y19 can you please check and sign again.

cmsbuild avatar Jun 05 '25 15:06 cmsbuild

please test

valsdav avatar Jun 05 '25 15:06 valsdav

+1

Size: This PR adds an extra 492KB to repository Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-c68a5d/46566/summary.html COMMIT: e63dec03beb23eb5ee50ea7b2db2fefd133c2beb CMSSW: CMSSW_15_1_X_2025-06-05-1100/el8_amd64_gcc12 Additional Tests: CUDA,ROCM User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/47984/46566/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • You potentially removed 3 lines from the logs
  • Reco comparison results: 5 differences found in the comparisons
  • DQMHistoTests: Total files compared: 50
  • DQMHistoTests: Total histograms compared: 4048495
  • DQMHistoTests: Total failures: 28
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 4048447
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 49 files compared)
  • Checked 215 log files, 184 edm output root files, 50 DQM output files
  • TriggerResults: no differences found

CUDA Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 71 differences found in the comparisons
  • DQMHistoTests: Total files compared: 7
  • DQMHistoTests: Total histograms compared: 53211
  • DQMHistoTests: Total failures: 3768
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 49443
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
  • Checked 24 log files, 30 edm output root files, 7 DQM output files
  • TriggerResults: no differences found

ROCM Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 25 differences found in the comparisons
  • DQMHistoTests: Total files compared: 7
  • DQMHistoTests: Total histograms compared: 53211
  • DQMHistoTests: Total failures: 4270
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 48941
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
  • Checked 24 log files, 30 edm output root files, 7 DQM output files

cmsbuild avatar Jun 05 '25 19:06 cmsbuild

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47984/45083

  • Found files with invalid states:
    • PhysicsTools/PyTorch/models/aot_regression_model_cpu_el9_amd64_gcc12.pt2:
      • Added: 185f42016f77f8856bed97a450da41e024220be8
      • Deleted: ee72386c7d21ded2af4e6ce48373b523e49e5acf
    • PhysicsTools/PyTorch/models/aot_regression_model_cuda_el9_amd64_gcc12.pt2:
      • Added: 185f42016f77f8856bed97a450da41e024220be8
      • Deleted: ee72386c7d21ded2af4e6ce48373b523e49e5acf
    • PhysicsTools/PyTorch/test/testModel.cc:
      • Added: 185f42016f77f8856bed97a450da41e024220be8
      • Modified: a4211a07e56eabeb7aaaa570d28cf2973346872a
      • Deleted: e63dec03beb23eb5ee50ea7b2db2fefd133c2beb

cmsbuild avatar Jun 06 '25 12:06 cmsbuild

Pull request #47984 was updated. @cmsbuild, @valsdav, @y19y19 can you please check and sign again.

cmsbuild avatar Jun 06 '25 12:06 cmsbuild

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47984/45085

cmsbuild avatar Jun 06 '25 13:06 cmsbuild

Pull request #47984 was updated. @cmsbuild, @valsdav, @y19y19 can you please check and sign again.

cmsbuild avatar Jun 06 '25 13:06 cmsbuild