bitsandbytes
bitsandbytes copied to clipboard
# Fix for matmul_4bit out Parameter Issue
fix: matmul_4bit out parameter handling for 1D and 2D tensors
- Fix incorrect handling of out parameter in matmul_4bit for 1D tensors
- Improve shape validation in gemv_4bit.out to handle 1D tensor cases
- Ensure proper tensor reshaping and memory handling in CUDA kernels
- Update conditional logic in matmul_4bit to consistently handle OUT parameter
This fixes GitHub issue #1235 where the out parameter was not working correctly for matrix multiplication operations, particularly with 1D input tensors.