aphrodite-engine icon indicating copy to clipboard operation
aphrodite-engine copied to clipboard

[Bug]: YAML run option no longer available in 0.9.0

Open prolix-oc opened this issue 3 months ago • 1 comments

Your current environment

The output of `python env.py` ```text Your output of `python env.py` here ```

Model Input Dumps

No response

🐛 Describe the bug

This has nothing to do with actually running the model, but I noticed that I am unable to launch with a configuration file now.

When running: uv run aphrodite yaml config.yaml

I am met with the following error:

usage: aphrodite [-h] [-v] {chat,complete,run,bench,collect-env,run-batch} ...
aphrodite: error: argument subparser: invalid choice: 'yaml' (choose from 'chat', 'complete', 'run', 'bench', 'collect-env', 'run-batch')

Additionally, specifying the model path in the aphrodite run command fails, as it is trying to parse it into a HuggingFace repository name and not the path specified. There are no additional ways for me to force the recognition of a local path with this new update.

prolix-oc avatar Sep 06 '25 04:09 prolix-oc

The config format has changed between the releases. You can now use a config file by doing aphrodite run --config config.yaml

AlpinDale avatar Sep 10 '25 13:09 AlpinDale