OpenLLM icon indicating copy to clipboard operation
OpenLLM copied to clipboard

Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.

Results 151 OpenLLM issues
Sort by recently updated
recently updated
newest added

Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 3.1.3 to 4.3.3. Release notes Sourced from actions/upload-artifact's releases. v4.3.3 What's Changed updating @actions/artifact dependency to v2.1.6 by @​eggyhead in actions/upload-artifact#565 Full Changelog: https://github.com/actions/upload-artifact/compare/v4.3.2...v4.3.3 v4.3.2 What's Changed...

dependencies
github_actions

I fixed the link to bentoml in the readme

updates: - [github.com/pre-commit/mirrors-eslint: v9.2.0 → v9.3.0](https://github.com/pre-commit/mirrors-eslint/compare/v9.2.0...v9.3.0)

Bumps [actions/checkout](https://github.com/actions/checkout) from 4.1.5 to 4.1.6. Release notes Sourced from actions/checkout's releases. v4.1.6 What's Changed Check platform to set archive extension appropriately by @​cory-miller in actions/checkout#1732 Update for 4.1.6 release...

dependencies
github_actions

Bumps [github/codeql-action](https://github.com/github/codeql-action) from 3.25.3 to 3.25.5. Changelog Sourced from github/codeql-action's changelog. CodeQL Action Changelog See the releases page for the relevant changes to the CodeQL CLI and language packs. Note...

dependencies
github_actions

Bumps [aquasecurity/trivy-action](https://github.com/aquasecurity/trivy-action) from 0.19.0 to 0.20.0. Release notes Sourced from aquasecurity/trivy-action's releases. v0.20.0 What's Changed Make 'hide-progress' input working again by @​uridium in aquasecurity/trivy-action#323 feat(image): add --docker-host option for GH...

dependencies
github_actions

Bumps [actions/download-artifact](https://github.com/actions/download-artifact) from 3.0.2 to 4.1.7. Release notes Sourced from actions/download-artifact's releases. v4.1.7 What's Changed Update @​actions/artifact dependency by @​bethanyj28 in actions/download-artifact#325 Full Changelog: https://github.com/actions/download-artifact/compare/v4.1.6...v4.1.7 v4.1.6 What's Changed updating @actions/artifact...

dependencies
github_actions

Hello, I'm struggling with getting a clean install running. I tried this with both python 3.10 and 3.11, after not seeing a vllm-flash-attn package available for 3.12. Here's my version...

how can i use openllm for local lora model?