jan
jan copied to clipboard
janhq
feat: support Nvidia NIMs remote API
Problem A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Request from user: https://build.nvidia.com/explore/discover so this is something I came across. With this we can get access to dbrx, mixtral8x22b through nvdia api will be good to have them
Success Criteria A clear and concise description of what you want to happen.
Additional context Add any other context or screenshots about the feature request here.
@0xSage Could I try this first issue I might need help doing this since I will be a beginner
Mixtral is https://build.nvidia.com/mistralai/mixtral-8x22b-instruct Dbrx https://docs.api.nvidia.com/nim/reference/databricks-dbrx-instruct-infer
hi @Realmbird, feel free to pick it up and draft a PR 🙏 We highly value the contributions of users
Fixed models not holding params currently working on fixing ids with / in name
Need to correct the URL for API key in the settings: https://discord.com/channels/1107178041848909847/1186884274637516860/1248139642352697375 Please refer to this correct flow, thank you @namchuai