John Hawkins

icon indicating a website link getting-data-science-done.com icon indicating an email [email protected]

icon company Playground XYZ icon location Sydney icon location Computer Scientist with a PhD in Applied Machine Learning. Working as a Data Scientist in multiple industries, focusing on what solves problems.

Results 2 comments of John Hawkins

[how-to-run-inference-cloud-run-gpu-vllm]:

My best bet at this time is that the problem is caused by an incompatibility in CUDA support The vLLM containers are built for CUDA 12.4 but Google Cloud Run...

[how-to-run-inference-cloud-run-gpu-vllm]:

Thanks for the rapid response and solution Much appreciated @saraford