sglang
sglang copied to clipboard
[chore]Upgrade flashinfer to 0.5.3
Motivation
Close #13748
Modifications
Accuracy Tests
Benchmarking and Profiling
Checklist
- [ ] Format your code according to the Format code with pre-commit.
- [ ] Add unit tests according to the Run and add unit tests.
- [ ] Update documentation according to Write documentations.
- [ ] Provide accuracy and speed benchmark results according to Test the accuracy and Benchmark the speed.
- [ ] Follow the SGLang code style guidance.
- [ ] Work with maintainers to merge your PR. See the PR Merge Process
[!WARNING] You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!
seems flashinfer-cubin v0.5.3 is not ready: https://github.com/flashinfer-ai/flashinfer/issues/2133 temporarily remove it from pyproject.toml