anansi
anansi copied to clipboard
allow users to specify custom, fine-tuned embedding models that fit within any existing model class
we will likely want to exclusively this from a configuration file on startup (likely using the same config.yaml
) - which allows us to:
- validate that the custom models exist and can operate on a piece of content in an expected manner (simply a warmup eval)
- continue to expand upon the existing
config.yaml
file and keep the general configuration of the binary efficient.