Together AI - no longer offering a free model
It looks like Together AI has dropped their meta-llama/Llama-3.3-70B-Instruct-Turbo-Free. So need to figure out alternate options for a free or low cost models include.
Current status/next step:
- Need to research options and identify alternate service providers. Note that there are more than one AI integration example that uses Together AI as the serverless LLM provider.
Currently not in the scope: code change.
https://github.com/cheahjs/free-llm-api-resources?tab=readme-ov-file#free-providers could be a good starting point. We currently have integrations that use Langchain.js and OpenAI compatible REST APIs.
@YasharF I'd like to work on this, please assign this to me
@leonace924 what do you mean?
@YasharF is it fine to put the PR for this issue?
@leonace924 Is the issue asking for a code change?
@YasharF Hello again, Mistral La Plateforme (Experiment plan) is a strong candidate. It offers generous token limits and OpenAI-compatible APIs, making it suitable for LangChain.js integrations. However, the free tier requires opting into data training, so it may not be appropriate for sensitive or user-generated data.