fabric
fabric copied to clipboard
Pass the temperature and top p parameters to ollama backend correctly
What this Pull Request (PR) does
This PR is to pass the temperature and top p parameters to ollama backend correctly
Reference for ollama api
- https://github.com/ollama/ollama-python/blob/main/ollama/_types.py#L96
- https://github.com/ollama/ollama/blob/main/docs/api.md#generate-a-chat-completion
Related issues
closes #423