Simo Lin

[model-gateway] clean up router manager function order

2

## Checklist - [ ] Format your code according to the [Format code with pre-commit](https://docs.sglang.ai/developer_guide/contribution_guide.html#format-code-with-pre-commit). - [ ] Add unit tests according to the [Run and add unit tests](https://docs.sglang.ai/developer_guide/contribution_guide.html#run-and-add-unit-tests). -...

## What type of PR is this? /kind feature ## What this PR does / why we need it: ## Which issue(s) this PR fixes: Fixes # ## Special notes...

Task 4: BaseModel Controller PVC Handling

4

# Task 4: BaseModel Controller PVC Handling ## Overview Update the BaseModel controller to handle the complete PVC storage flow: validation, job creation, and status management. This replaces the original...

Task 7: Integration Tests

1

# Task 7: Integration Tests ## Overview Create comprehensive integration tests to validate the end-to-end PVC storage support functionality. ## Scope - Unit tests for individual components - Integration tests...

Task 8: Documentation

2

# Task 8: Documentation ## Overview Create comprehensive documentation for PVC storage support, including user guides, API documentation, troubleshooting guides, and architecture diagrams. ## Scope - User documentation for PVC...

# Task 6: RBAC and Kubernetes Manifests ## Overview Create and update Kubernetes manifests for RBAC permissions, ServiceAccounts, and other resources needed for PVC storage support. ## Scope - Create...

[ENHANCEMENT] helm chart for runtime, models, and services

2

## What would you like to be added? additional helm chart for serving runtime, models, and inference services ## Why is this needed? As of now, OME only provide basic...

Task 5: InferenceService PVC Volume Support

3

# Task 5: InferenceService PVC Volume Support ## Overview Update the InferenceService controller components to properly handle PVC volumes instead of host paths when BaseModel uses PVC storage. ## Scope...

# OEP-0004: PVC Storage Support for BaseModel and ClusterBaseModel - [Summary](#summary) - [Motivation](#motivation) - [Goals](#goals) - [Non-Goals](#non-goals) - [Proposal](#proposal) - [User Stories](#user-stories) - [Story 1: Using Models from Existing PVCs](#story-1-using-models-from-existing-pvcs)...