data-formulator
data-formulator copied to clipboard
Add support for third-party LLM endpoints
Related to #49
Add support for third-party LLM endpoints, such as Ollama, in the data formulator.
-
Backend Changes:
- Update
get_client
function inpy-src/data_formulator/agents/client_utils.py
to handle third-party LLM endpoints using LiteLLM. - Add import for LiteLLM in
py-src/data_formulator/agents/client_utils.py
.
- Update
-
Frontend Changes:
- Add UI options for third-party LLM endpoints in
src/views/ModelSelectionDialog.tsx
. - Update the endpoint display logic in
src/views/ModelSelectionDialog.tsx
to include Ollama.
- Add UI options for third-party LLM endpoints in
-
Documentation:
- Add instructions for setting up third-party LLM endpoints in
DEVELOPMENT.md
.
- Add instructions for setting up third-party LLM endpoints in