Sergio López
Sergio López
No, there's no limitation, it's simply that we have a couple of use cases on aarch64 (krunkit and muvm) but none on x86_64. Do you have one on that arch?
This depends on #280, creating this as a draft until it's merged.
Rebased, working and ready to be reviewed!
@asahilina could you please confirm this fixes the issue you were seeing in #204 ?
I'm afraid the situation the Vulkan-related packages in CentOS Stream 9 is kind of broken (i.e. `spirv-headers-devel` is nowhere to be found, even though some packages that depend on it...
v2: - Extend the existing Containerfile instead of building a new one. - Use ubi9 instead of Fedora 40. - Add a cli option to request GPU offloading.
> I'm curious if we need the llama.cpp downgrade and would be nice to see the total size difference between cpuonly and a cpuonly+kompute container image Sadly, we do need...
Should I add a commit renaming the directory? Feels weird keeping the name `cpuonly`
Creating this one as a draft since it depends on #256. I'll rebase it once that one gets merged.