Brandon Ogle

I haven't had the need to do any work around `vacuum` just yet, and to be honest I have been thinking I would just invoke `vacuum` on some schedule from...

> Hello ! > > Sorry for my long absence. > This seems straightforward to implement, if it suffices to add a constructor to allow passing a custom endpoint to...

looks good to me. As mentioned inline, you will want to update the initialization of `TokenInfo` before merging.

Hey, curious if there is any movement on adding the stream api to tch-rs. I am working on an inference pipeline where having control over the cuda stream would be...

Ah, I see. I myself am using the vendored cuda installation from pytorch as a means to reduce the size of our docker image. However we have had to patch...

I am realizing for the example I described, you wouldn't actually get any parallelism from the addition of threads since the copy (assuming its synchronous) and inference kernels will be...