aphrodite-engine
aphrodite-engine copied to clipboard
[Bug]: YAML run option no longer available in 0.9.0
Your current environment
The output of `python env.py`
```text Your output of `python env.py` here ```Model Input Dumps
No response
🐛 Describe the bug
This has nothing to do with actually running the model, but I noticed that I am unable to launch with a configuration file now.
When running:
uv run aphrodite yaml config.yaml
I am met with the following error:
usage: aphrodite [-h] [-v] {chat,complete,run,bench,collect-env,run-batch} ...
aphrodite: error: argument subparser: invalid choice: 'yaml' (choose from 'chat', 'complete', 'run', 'bench', 'collect-env', 'run-batch')
Additionally, specifying the model path in the aphrodite run command fails, as it is trying to parse it into a HuggingFace repository name and not the path specified. There are no additional ways for me to force the recognition of a local path with this new update.
The config format has changed between the releases. You can now use a config file by doing aphrodite run --config config.yaml