Talha Niazi

icon indicating a website link https://talnz007.github.io/Portfolio.github.io/

icon location Islamabad, Pakistan icon location Building intelligent systems to bring AI beyond research into real-world applications. Skilled in Python, PyTorch, NLP, and computer vision.

Results 2 issues of Talha Niazi

Unable to Build llama-cpp-python with Vulkan (Core Dump on Model Load)

1 comment

I have successfully built llama.cpp with Vulkan, and it works fine on my AMD RX 580 GPU. I have tested the following models on llama.cpp with Vulkan, and they all...

Add Support for llama.cpp Models

5 comment

I’d like to suggest adding **support for llama.cpp models** to expand Alpaca’s compatibility, especially for users with older AMD GPUs that can leverage Vulkan for GPU-accelerated inference. This would allow...

enhancement
instance