fabric
fabric copied to clipboard
[Feature request]: Set default models per Pattern
What do you need?
I believe it would enhance the results of Fabric if users could assign different default models (LLMs) to specific Patterns. Each LLM excels in different scenarios—some are proficient in coding, others in understanding intent, or in utilizing up-to-date data. Therefore, it's logical to align specific patterns with models that suit them best.
Proposal:
- Configurable Default Models: Introduce a configuration file where patterns can be mapped to their preferred default LLM. If a specific model isn't designated, the system defaults to the Fabric default set by the user.
- Creator Presets: Allow the Pattern authors to provide a model option. This could be the model they tested their Pattern on, or the best model they have found for their pattern.
- Import Creator Presets: Allow the user, through a CLI command, to import the presets providing the user has an API key for those models.
- CLI Command: Implement a CLI command to manage this configuration file. Users can add, remove, or update mappings between patterns and default models directly from the command line. This should be retained after updates.
- Opt-in: To prevent unexpected charges, this feature should be disabled by default. Users can enable it through a clearly defined setting during setup.
This enhancement would not only optimize the system's performance by leveraging specialized models but also empower users to tailor AI interactions to their specific needs effectively.