bitsandbytes icon indicating copy to clipboard operation
bitsandbytes copied to clipboard

# Fix for matmul_4bit out Parameter Issue

Open ved1beta opened this issue 6 months ago • 0 comments

fix: matmul_4bit out parameter handling for 1D and 2D tensors

  • Fix incorrect handling of out parameter in matmul_4bit for 1D tensors
  • Improve shape validation in gemv_4bit.out to handle 1D tensor cases
  • Ensure proper tensor reshaping and memory handling in CUDA kernels
  • Update conditional logic in matmul_4bit to consistently handle OUT parameter

This fixes GitHub issue #1235 where the out parameter was not working correctly for matrix multiplication operations, particularly with 1D input tensors.

ved1beta avatar May 28 '25 10:05 ved1beta