Justin Law

_The template below is mostly useful for bug reports and support questions. Feel free to remove anything which doesn't apply to you and add more information where it makes sense._...

spike: UDS Core LFAI infrastructure bundle

19

LFAI delivery requires a production-ready infrastructure bundle that will bootstrap an RKE2 cluster and setup the networking, auth, CRDs and policies necessary for the rest of the LFAI applications layers...

### Describe what should be investigated or refactored We need to add some more pre-commits to align with more best practices, including Dockerfile, Zarf, UDS, and Helm chart linting. ###...

spike: NVIDIA GPU operator Zarf package

2

LFAI delivery requires a production-ready NVIDIA GPU operator Zarf package that will bootstrap a containerized version of the necessary NVIDIA CUDA drivers, container toolkit, feature discovery and device plugin components...

**To-do List:** - [ ] Remove all custom validation methods already covered by OpenAI's Python Library - [ ] Create Pydantic models using the Pydantic validator and model pattern for...

chore(docs): markdown linting and improved documentation

1

- moves all quick start and deployment documentation to the docs website - updates all docs website content, including requirements and instructions - keeps developer documentation (local Python or Typescript)...

feat: enhance vLLM backend and expose more params

7

See https://github.com/defenseunicorns/leapfrogai/issues/835 for more details on rationale and findings. ### BREAKING CHANGES: - deprecates many of TheBloke's quantized models ### CHANGES: - upgrades vLLM from 0.4.2 to 0.5.4 for: -...

feat(api): registry1 and package flavor patterns

1

### DESCRIPTION > [!CAUTION] > DO NOT MERGE Creates a Registry1 flavor for the LeapfrogAI API and improves documentation on how to use the API. Refactors Make recipes, values files,...

### User Story **As a** a delivery engineer **I want** to activate, define a background color, and provide text content on a top and/or bottom banner in the UI **So...

bug(ui): html code block rendering

1

### Environment Device and OS: Ubuntu 22.04 App/package versions: main (latest) Kubernetes distro being used: UDS K3d (latest) Other: N/A ### Steps to reproduce Ask the LLM to write code...