higress
higress copied to clipboard
🤖 AI Gateway | AI Native API Gateway
## Why do you need it? Is your feature request related to a problem? Please describe in details 需要接入一些商用的专用模型,并不是市面上看到的通用大模型厂商提供的模型,所以需要自己扩展一些provider ## How could it be? A clear and concise description of...
 https://www.bilibili.com/video/BV1qMvMeAEJy/?spm_id_from=333.337.search-card.all.click the video can show up the login box Tested in docker and docker-compose standalone packages Diff browsers no pop up the login box too
基于 LLM Mock Server 增强 ai-proxy 插件的 e2e 测试进度如下 ### 目前已支持 - baidu - doubao - minimax ### 待支持 #### 因响应格式与OpenAI不同,需在 Mock Server 中实现对应响应 - [ ] #1717 - [...
想通过kubeconfig实现在外部访问集群;如何实现类似SSL透传特性(nginx.ingress.kubernetes.io/ssl-passthrough: "true")解决证书认证问题。
### Ⅰ. Describe what this PR did This plugin prevents replay attacks by validating request nonce. Key features: - Nonce validation - Redis-based replay detection - Configurable TTL and validation...
## Why do you need it? Because running model services in an e2e environment or accessing the LLM provider's API is not very feasible. The e2e testing of plugins for...