Vishal Goklani

Results 62 comments of Vishal Goklani

thanks! I'm just running `execute_command(...)` for one liners currently with TS.MRANGE, but a little worried about how i'm going to pipeline ...

@rezaep the URL is dead, i wish you had just posted the solution here.

I'm looking for the chapter code 6 code too. Thanks!

Thanks! and thanks for writing the book!!! If you're even in NYC one day, let's grab coffee.

@trunghlt thanks for sharing - do you have any benchmarks that compare the speed improvement with CTranslate2?

thanks @trunghlt what type of hardware are you running? A100s? also, are you using int8 for inference? which models have you converted successfully?

thanks @trannhatquy how good is the quantization? Do you have a ppl comparison? I'm planning to use MPT-7B and eventually MPT-30B

I'd like to see the conversion scripts too, and I'm offering to help clean them up! Could you please share the link. thanks!