Rick Sherman

icon company Datadog icon location St. Louis, MO USA icon location Manager, Advocacy @ Datadog

Results 11 comments of Rick Sherman

bitsandbytes 0.39.0?

I've made some solid progress on porting over 0.39.0 to rocm. It currently compiles and will load models in 4-bit but generation returns gibberish. There's still two major things to...