FastChat
FastChat copied to clipboard
Documentation for using Cacheflow worker with updated dependency in pyproject.toml
trafficstars
There isn't any documentation of Cacheflow worker using ray cluster.
Can you please provide the updated dependency even though under optional for using the cacheflow worker to serve the model.