Steve Grubb
Steve Grubb
The clone3 syscall moves most parameters to struct clone_args. Flags, pidfd, exit_signal, and cgroup are of interest. The pidfd is only of interest if it has been resolved to the...
This patch changes the log verbosity of the redhat Dockerfile to be controlled by an argument. It will default to off to maintain the original behavior. It can be overridden...
ctx_gguf is initialized by gguf_init_from_file. It appears to be otherwise unused throughout the function. Someone more familar with the code might want to consider if gguf_init_from_file is necessary at all....
**Describe the bug** When building the 2024.3 release using the Red Hat Dockerfile and with the unit tests enabled, the build eventually ends with the following: [2024-08-28 14:35:19.804][22736][serving][info][llmtemplate_test.cpp:491] Closing configFile...
This is a series of patches that update Dockerfile.redhat.
### Bug Description I was following the custom tool calling example with the add and multiply functions. Whatever function gets used first, the results are printed. Whichever function is second,...
I am using the latest version I just pip installed 0.0.45. In my environment (Fedora 39) I have export DOCKER_BINARY="podman" When I build, pretty much following the example, I get...
### System Info It's using the versions downloaded by pip install during the llama stack build. I have an nvidia GPU ### Information - [X] The official example scripts -...
### System Info Cuda 12.6, torch 2.5.1, nvidia gpu ### Information - [X] The official example scripts - [ ] My own modified scripts ### 🐛 Describe the bug I'm...
In Dockerfile.redhat, it has a default INSTALL_DRIVER_VERSION="23.22.26516". There is not a corresponding entry in install_redhat_gpu_drivers.sh or install_ubuntu_gpu_drivers.sh. The Dockerfile build fails after 5 minutes.