LLMstudio
LLMstudio copied to clipboard
TensorOpsAI
Framework to bring LLM applications to production
## LLMstudio Version 1.0.0 ### What was done in this PR: - modularization: - llmstudio-core - llmstudio-proxy - llmstudio - llmstudio-tracking - add tests - add CI ### How it...
# Summary 1. Remove Azure clients. 2. Build headers, payload and endpoint. 3. Send calls using requests. 4. Deal with aditional final chunk sent by Llama endpoint. 5. Created `06_fix_azure_llama.ipynb`...
Still very WIP ## LLMstudio Version X.X.X ### What was done in this PR: - libs/core -> llmstudio_core ### How it was tested: - tbd ### Additional notes: - Any...
### WIP # Summary 1. Creat `06_explore_aws_bedrock.ipynb` to test Boto3 streaming and non-streaming calls, as well as raw Python (without Boto3) streaming and non-streaming code. 2. Test Converse-stream api in...
### Feature Request Can you add of gpt-4o? ### Motivation It is much cheaper than gpt-4 ### Your contribution I would like to contribute to this feature but I know...
## Summary This pull request includes the following updates: 1. **Max Tokens Parameter in LLM Initialization**: - Updated the `__init__.py` of the LLM module to utilize the `max_tokens` parameter, enhancing...
Metadata
Owner
Metadata
Framework to bring LLM applications to production