Brian Bakerman

Having a similar issue. I'm trying to get Faster Whisper to run off a docker build. I'm trying to use the docker image: pytorch/pytorch:2.1.0-cuda11.8-cudnn8-runtime Unfortunately, getting this libcudnn_ops_infer.so.8 issue as...

Seems like the newest one of those images uses CUDA11.2, which I'm not sure will work for me here. I updated my docker file like so (I got the LD_LIBRARY_PATH...

Unfortunately the nvidia/cuda:12.2.2-cudnn8-runtime-ubuntu22.04 docker image is too large for my machine to handle; still not sure why the original pytorch image doesn't accomplish what I need. Do I need to...

The primary use case is to keep track of the total runtime for my servers. In Replicate, for example, I don't have access to raw usage data programmatically and this...