Patrick Coppock

Looks good—thanks @karljang!

Ubuntu 20.04 with Python 3.8, version 2.10 **tensorflow**, and version 3.19 **google.protobuf** works fine for running BERT. As @arjunsuresh, I'm running without Docker. I'll draft a Dockerfile.

The PyTorch on [https://pypi.jetson-ai-lab.dev/sbsa/cu128/](https://pypi.jetson-ai-lab.dev/sbsa/cu128/) isn't built with CUDA which necessitates first installing PyTorch with index url [https://download.pytorch.org/whl/cu128](https://download.pytorch.org/whl/cu128) and then installing vllm. Is this a mistake?