Oren

maybe serverless functions with webhook?

Hi @pkieltyka Thanks for the follow-up! We ended up figuring it out for new relic and open telemetry at CohereAI. Really appreciate the help!

> > Any update? > > The above problem seems relavant to mine, but the author did not post any details. > > My failure looks like this:  >...

@ptillet any updates on if INT4 support is on the roadmap?

Thanks for the update @ptillet can you elaborate on what you mean by CUDA interop? and how that would relate to storing in INT4 than at runtime quantize back to...

Plz keep open

@karan6181 the size is about 1 TB and about 100k unique keys