Vishal Goklani
Vishal Goklani
I see this on Ubuntu
Thanks @damitkwr
thanks! I'm just running `execute_command(...)` for one liners currently with TS.MRANGE, but a little worried about how i'm going to pipeline ...
@rezaep the URL is dead, i wish you had just posted the solution here.
I'm looking for the chapter code 6 code too. Thanks!
Thanks! and thanks for writing the book!!! If you're even in NYC one day, let's grab coffee.
@trunghlt thanks for sharing - do you have any benchmarks that compare the speed improvement with CTranslate2?
thanks @trunghlt what type of hardware are you running? A100s? also, are you using int8 for inference? which models have you converted successfully?
thanks @trannhatquy how good is the quantization? Do you have a ppl comparison? I'm planning to use MPT-7B and eventually MPT-30B
I'd like to see the conversion scripts too, and I'm offering to help clean them up! Could you please share the link. thanks!