genai-toolbox icon indicating copy to clipboard operation
genai-toolbox copied to clipboard

Add Helm chart for Kubernetes deployment

Open brandon-powers opened this issue 10 months ago • 3 comments

Prerequisites

What are you trying to do that currently feels hard or impossible?

👋

Based on the existing documentation, we can create a Helm chart for making deployments of the MCP toolbox easier & standardized on Kubernetes.

As an example of a potential benefit, we could have values options for # of replicas (servers), horizontal auto-scaling (HPA), explicit resources, etc. for increased reliability.

Suggested Solution(s)

  • helm/genai-toolbox/ or helm-charts/ as a new top-level directory, containing:
    • Deployment - for the MCP server(s)
      • topologySpreadConstraints & [anti-]affinities to run instances across AWS AZs / GCP Zones.
    • Service - for access
    • HorizontalPodAutoscaler - for the auto-scaling option
    • ServiceAccount - can bring-your-own or option to define it in chart
    • Secret - for tools.yaml
    • ...

Alternatives Considered

No response

Additional Details

I'd be interested in contributing this; wanted to raise it for feedback.

brandon-powers avatar Apr 24 '25 22:04 brandon-powers

Thank you for opening this feature request!! Contributions are welcomed for this! :)

Yuan325 avatar Apr 28 '25 17:04 Yuan325

Thank you for opening this feature request!! Contributions are welcomed for this! :)

Sounds great! Started working on the chart, will open a PR here for review when ready.

brandon-powers avatar Apr 29 '25 04:04 brandon-powers

Just want to mention that this is now managed by #673

alessandro-festa avatar Jun 09 '25 08:06 alessandro-festa