aibrix
aibrix copied to clipboard
Run compatibility test as CI jobs
🚀 Feature Description and Motivation
This test should focus more on using openai python sdk to test different model endpoints and check compatible responses. if any gateway changes break such change, it should throws the errors.
Use Case
Test vLLM & AIBrix compatibility
Proposed Solution
No response