Keyun Tong

Support SSL Key Rotation in HTTP Server

1

Some production setup requires TLS key/cert rotation in HTTP server. This change use watchfiles to async'ly monitor the updates of ssl key, cert, and CA files, and update the SSLContext...

Avoid overwriting vllm_compile_cache.py

1

When vLLM is reusing a previously compile torch.compile cache files, it should not modify/overwrite it, since nothing is expected to be changed under the same hash. After the change, verified...