volcano-sdk icon indicating copy to clipboard operation
volcano-sdk copied to clipboard

feat: add defaultHeaders support to all LLM providers

Open marckong opened this issue 2 months ago • 2 comments

Add defaultHeaders configuration option to all LLM providers (OpenAI, Anthropic, Azure, Mistral, Llama, Bedrock, Vertex Studio), enabling custom metadata and authentication mechanisms similar to the official OpenAI client.

  • Add mergeHeaders utility function for proper header precedence
  • Update all provider config types to include defaultHeaders field
  • Implement header merging in all fetch calls and SDK initializations
  • Priority: required headers > default headers (prevents auth override)

marckong avatar Oct 17 '25 00:10 marckong

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

CLAassistant avatar Oct 17 '25 00:10 CLAassistant

Needs documentation too.

subnetmarco avatar Oct 21 '25 05:10 subnetmarco